Abstract
With the evolution of the Web, users are now encouraged to express their preferences on items. These are often conveyed through a rating value on a multi-point rating scale (for example from one to five). Ratings have however several known drawbacks, such as imprecision and inconsistency. We propose a new modality to express preferences: comparing items (“I prefer x to y”). In this initial work, we conduct two user-studies to understand the possible relevance of comparisons. This work shows that users are favorably predisposed to adopt this new modality. Moreover, it shows that preferences expressed as ratings are coherent with preferences expressed trough comparisons, and to some extent equivalent. As a proof of concept, a recommender is implemented using comparison data, where we show encouraging results when confronted to a classical rating-based recommender. As a consequence, asking users to express their preferences through comparisons, in place of ratings, is a promising new modality for preference-expression.
Access provided by Autonomous University of Puebla. Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Amatriain, X., Pujol, J.M., Oliver, N.: I like it.. I like it not: Evaluating User Ratings Noise in Recommender Systems. In: Proc. of UMAP Conf. (2009)
Amoo, T., Friedman, H.: Do numeric values influence subjects’ responses to rating scales? J. of International Marketing and Marketing Research 26, 41–46 (2001)
Brun, A., Hamad, A., Buffet, O., Boyer, A.: Towards preference relations in recommender systems. In: Workshop on Preference Learning at ECML-PKDD (2010)
Candillier, L., Meyer, F., Boullé, M.: Comparing state-of-the-art collaborative filtering systems. In: Proc. of 5th International Conference on Machine Learning and Data Mining in Pattern Recognition (MLMD), pp. 548–562 (2007)
Carterette, B., Bennett, P.: Evaluation measures for preference judgments. In: Proc. of the Annual ACM SIGIR Conference, pp. 685–686 (2008)
Carterette, B., Bennett, P., Chickering, D., Dumais, S.: Here or there; preference judgments for relevance. In: Proc. of ECIR, pp. 16–27 (2008)
Cena, F., Vernero, F., Gena, C.: Towards a customization of rating scales in adaptive systems. In: Proc. of the User Modeling, Adaptation, and Personalization (UMAP), pp. 369–374 (2010)
Chen, L., Pu, P.: Experiments on the preference-based organization interface in recommender systems. ACM Trans. Comput.-Hum. Interact 17, 5:1–5:33 (2010)
Cosley, D., Lam, S., Albert, I., Konstan, J., Riedl, J.: Is seeing believing?: how recommender system interfaces affect users’ opinions. In: Proc. of the Intelligent User Interfaces (IUI) (2003)
Jones, N., Brun, A., Boyer, A.: Initial Perspectives From Preferences Expressed Through Comparisons. In: Int. Conf. on Human-Computer Interaction (July 2011)
McGinty, L., Smyth, B.: Comparison-based recommendation. In: Craw, S., Preece, A.D. (eds.) ECCBR 2002. LNCS (LNAI), vol. 2416, pp. 575–589. Springer, Heidelberg (2002)
Preston, C., Colman, A.: Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences. Acta Psychologica 104(1), 1–15 (2000)
Schafer, B., Frankowski, D., Herlocker, J., Sen, S.: Collaborative Filtering Recommender Systems. In: The Adaptive Web. Methods and Strategies of Web Personalization, pp. 291–324. Springer, Heidelberg (2007)
Turney, P.: Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In: Proc. of the Association for Computational Linguistics (ACL), pp. 417–424 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jones, N., Brun, A., Boyer, A., Hamad, A. (2011). An Exploratory Work in Using Comparisons Instead of Ratings. In: Huemer, C., Setzer, T. (eds) E-Commerce and Web Technologies. EC-Web 2011. Lecture Notes in Business Information Processing, vol 85. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23014-1_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-23014-1_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23013-4
Online ISBN: 978-3-642-23014-1
eBook Packages: Computer ScienceComputer Science (R0)