The Relationship between the Consistency of Users' Ratings and Recommendation Calibration
Masoud Mansoury, Himan Abdollahpouri, Joris Rombouts, Mykola, Pechenizkiy

TL;DR
This paper investigates how the consistency of users' rating behaviors influences the calibration of recommendations, finding that more consistent raters tend to receive more calibrated recommendations, which impacts fairness and effectiveness.
Contribution
It provides empirical evidence linking user rating consistency to recommendation calibration, highlighting its importance for fairness in recommender systems.
Findings
Higher rating consistency correlates with better recommendation calibration.
Inconsistent raters receive less calibrated recommendations.
The study uses multiple algorithms and a movie dataset for analysis.
Abstract
Fairness in recommender systems has recently received attention from researchers. Unfair recommendations have negative impact on the effectiveness of recommender systems as it may degrade users' satisfaction, loyalty, and at worst, it can lead to or perpetuate undesirable social dynamics. One of the factors that may impact fairness is calibration, the degree to which users' preferences on various item categories are reflected in the recommendations they receive. The ability of a recommendation algorithm for generating effective recommendations may depend on the meaningfulness of the input data and the amount of information available in users' profile. In this paper, we aim to explore the relationship between the consistency of users' ratings behavior and the degree of calibrated recommendations they receive. We conduct our analysis on different groups of users based on the consistency…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsRecommender Systems and Techniques · Advanced Bandit Algorithms Research · Image and Video Quality Assessment
