Abstract
Rank aggregation is a pervading operation in IR technology. We hypothesize that the performance of score-based aggregation may be affected by artificial, usually meaningless deviations consistently occurring in the input score distributions, which distort the combined result when the individual biases differ from each other. We propose a score-based rank aggregation model where the source scores are normalized to a common distribution before being combined. Early experiments on available data from several TREC collections are shown to support our proposal.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Castells, P., Fernández, M., Vallet, D., Mylonas, P., Avrithis, Y.: Self-Tuning Personalised Information Retrieval in an Ontology-Based Framework. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM-WS 2005. LNCS, vol. 3762, pp. 977–986. Springer, Heidelberg (2005)
Croft, W.B.: Combining approaches to information retrieval. In: Advances in Information Retrieval: Recent Research from the Center for Intelligent Information Retrieval, pp. 1–36. Kluwer Academic Publishers, Dordrecht (2000)
Lee, J.H.: Analysis of multiple evidence combination. In: 20th ACM SIGIR Conf. on Research and Development in Information Retrieval (SIGIR 1997), New York, pp. 267–276 (1997)
Manmatha, R., Rath, R., Feng, F.: Modelling score distributions for combining the outputs of search engines. In: 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR, New Orleans, LA, pp. 267–275 (2001)
Masthoff, J.: Group Modeling: Selecting a Sequence of Television Items to Suit a Group of Viewers. User Modeling and User-Adapted Interaction 14(1), 37–85 (2004)
Montague, M., Aslam, J.A.: Relevance score normalization for metasearch. In: 10th Conf. on Information and Knowledge Management (CIKM 2001), Atlanta, GA, pp. 427–433 (2001)
Renda, M.E., Straccia, U.: Web metasearch: rank vs. score based rank aggregation methods. In: ACM symposium on Applied Computing, Melbourne, Florida, pp. 841–846 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernández, M., Vallet, D., Castells, P. (2006). Probabilistic Score Normalization for Rank Aggregation. In: Lalmas, M., MacFarlane, A., Rüger, S., Tombros, A., Tsikrika, T., Yavlinsky, A. (eds) Advances in Information Retrieval. ECIR 2006. Lecture Notes in Computer Science, vol 3936. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11735106_63
Download citation
DOI: https://doi.org/10.1007/11735106_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33347-0
Online ISBN: 978-3-540-33348-7
eBook Packages: Computer ScienceComputer Science (R0)