Article

Multidimensional Relevance: A New Aggregation Criterion

Authors:

Célia Costa Pereira,

Mauro Dragoni,

Gabriella PasiAuthors Info & Claims

ECIR '09: Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval

Pages 264 - 275

https://doi.org/10.1007/978-3-642-00958-7_25

Published: 18 April 2009 Publication History

Abstract

In this paper, a new model for aggregating multiple criteria evaluations for relevance assessment is proposed. An information retrieval context is considered, where relevance is modelled as a multidimensional property of documents. In the paper, the proposed aggregation operator is applied to define a model for personalized Information Retrieval (IR), in which four criteria are considered in order to assess document relevance: aboutness, coverage, appropriateness and reliability .

The originality of this approach lies in the aggregation of the considered criteria in a prioritized way, by considering the existence of a prioritization relationship over the criteria. Such a prioritization is modeled by making the weights associated with a criterion dependent upon the satisfaction of the higher-priority criteria. This way, it is possible to take into account the fact that the weight of a less important criterion should be proportional to the satisfaction degree of the more important criterion.

In the paper, some preliminary experimental results are also reported.

References

[1]

Artz, D., Gil, Y.: A survey of trust in computer science and the semantic web. Web Semant. 5(2), 58-71 (2007)

Crossref

Google Scholar

[2]

Barry, C.L.: User-defined relevance criteria: an exploratory study. J. Am. Soc. Inf. Sci. 45(3), 149-159 (1994)

Crossref

Google Scholar

[3]

Cooper, W.S.: On selecting a measure of retrieval effectiveness. J. Am. Soc. Inf. Sci. 24(2), 87-100 (1973)

Google Scholar

[4]

Miyamoto, S.: Information clustering based on fuzzy multisets. Inf. Process. Manage. 39(2), 195-213 (2003)

Crossref

Google Scholar

[5]

Mizzaro, S.: Relevance: the whole history. J. Am. Soc. Inf. Sci. 48(9), 810-832 (1997)

Crossref

Google Scholar

[6]

Mui, L., Mohtashemi, M., Halberstadt, A.: A computational model of trust and reputation. In: HICSS 2002, pp. 2431-2439 (2002)

Crossref

Google Scholar

[7]

Pasi, G., Bordogna, G., Villa, R.: A multi-criteria content-based filtering system. In: SIGIR 2007, pp. 775-776 (2007)

Crossref

Google Scholar

[8]

Salton, G., McGill, M.: Introduction to Modern Information Retrieval. McGraw-Hill Book Company, New York (1984)

Crossref

Google Scholar

[9]

Sanderson, M.: The reuters collection. In: Proceedings of the 16th BCS IRSG Colloquium (1994)

Google Scholar

[10]

Saracevic, T.: The stratified model of information retrieval interaction: Extension and applications. J. Am. Soc. Inf. Sci. 34, 313-327 (1997)

Google Scholar

[11]

Schamber, L., Eisenberg, M.: Relevance: The search for a definition. In: Proc. 51st Annual Meeting of the American Society for Information Science (1988)

Google Scholar

[12]

Taylor, A.R., Cool, C., Belkin, N.J., Amadio, W.J.: Relationships between categories of relevance criteria and stage in task completion. Inf. Process. Manage. 43(4), 1071-1084 (2007)

Crossref

Google Scholar

[13]

Xu, Y.C., Chen, Z.: Relevance judgment: What do information users consider beyond topicality? J. Am. Soc. Inf. Sci. Technol. 57(7), 961-973 (2006)

Crossref

Google Scholar

[14]

Yager, R.R.: Prioritized aggregation operators. Int. J. Approx. Reasoning 48(1), 263-274 (2008)

Crossref

Google Scholar

Cited By

View all

Upadhyay RAskari APasi GViviani M(2024)Beyond Topicality: Including Multidimensional Relevance in Cross-encoder Re-rankingAdvances in Information Retrieval10.1007/978-3-031-56027-9_16(262-277)Online publication date: 24-Mar-2024
https://dl.acm.org/doi/10.1007/978-3-031-56027-9_16
Putri D(2021)Multidimensional Relevance in Task-Specific RetrievalAdvances in Information Retrieval10.1007/978-3-030-72240-1_80(677-681)Online publication date: 28-Mar-2021
https://dl.acm.org/doi/10.1007/978-3-030-72240-1_80
Papadakos PKalipolitis O(2020)Dualism in Topical RelevanceAdvances in Information Retrieval10.1007/978-3-030-45442-5_40(320-327)Online publication date: 14-Apr-2020
https://dl.acm.org/doi/10.1007/978-3-030-45442-5_40
Show More Cited By

Multidimensional Relevance: A New Aggregation Criterion
1. Information systems

Recommendations

Multidimensional relevance: Prioritized aggregation in a personalized Information Retrieval setting

A new model for aggregating multiple criteria evaluations for relevance assessment is proposed. An Information Retrieval context is considered, where relevance is modeled as a multidimensional property of documents. The usefulness and effectiveness of ...
A Prioritized "And" Aggregation Operator for Multidimensional Relevance Assessment
AI*IA '09:: Proceedings of the XIth International Conference of the Italian Association for Artificial Intelligence Reggio Emilia on Emergent Perspectives in Artificial Intelligence

In this paper a new model is proposed for aggregating multiple criteria evaluations for relevance assessment based on a refinement of the "min" ("and") operator.

The peculiarity of such an operator which also distinguishes it from the traditional "min" ...
Multidimensional Relevance in Task-Specific Retrieval
Advances in Information Retrieval
Abstract
Several criteria of relevance have been proposed in the literature. However, relevance criteria are strongly related to the search task. Thus, it is important to employ the criteria that are useful for the considered search task. This research ...

Comments

Information & Contributors

Information

Published In

ECIR '09: Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval

April 2009

817 pages

ISBN:9783642009570

Editors:
Mohand Boughanem
Université de Toulouse - IRIT,, Toulouse Cedex 4,, France 31062,
,
Catherine Berrut
Laboratoire d'Informatique de Grenoble, BP 53,, Université Joseph Fourier,, Grenoble Cedex 9,, France 38041
,
Josiane Mothe
Université de Toulouse - IRIT,, Toulouse Cedex 4,, France 31062
,
Chantal Soule-Dupuy
Université de Toulouse - IRIT,, Toulouse Cedex 4,, France 31062

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 18 April 2009

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Upadhyay RAskari APasi GViviani M(2024)Beyond Topicality: Including Multidimensional Relevance in Cross-encoder Re-rankingAdvances in Information Retrieval10.1007/978-3-031-56027-9_16(262-277)Online publication date: 24-Mar-2024
https://dl.acm.org/doi/10.1007/978-3-031-56027-9_16
Putri D(2021)Multidimensional Relevance in Task-Specific RetrievalAdvances in Information Retrieval10.1007/978-3-030-72240-1_80(677-681)Online publication date: 28-Mar-2021
https://dl.acm.org/doi/10.1007/978-3-030-72240-1_80
Papadakos PKalipolitis O(2020)Dualism in Topical RelevanceAdvances in Information Retrieval10.1007/978-3-030-45442-5_40(320-327)Online publication date: 14-Apr-2020
https://dl.acm.org/doi/10.1007/978-3-030-45442-5_40
Uprety SDehdashti SFell LBruza PSong DFang YZhang YAllan JBalog KCarterette BGuo J(2019)Modelling Dynamic Interactions Between Relevance DimensionsProceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3341981.3344233(35-42)Online publication date: 26-Sep-2019
https://dl.acm.org/doi/10.1145/3341981.3344233
Cholvy Lda Costa Pereira C(2019)Usefulness of Information for Goal AchievementPRIMA 2019: Principles and Practice of Multi-Agent Systems10.1007/978-3-030-33792-6_8(123-137)Online publication date: 28-Oct-2019
https://dl.acm.org/doi/10.1007/978-3-030-33792-6_8
Dridi RTamine LSlimani Y(2019)Context-Aware Multi-criteria Recommendation Based on Spectral Graph PartitioningDatabase and Expert Systems Applications10.1007/978-3-030-27618-8_16(211-221)Online publication date: 26-Aug-2019
https://dl.acm.org/doi/10.1007/978-3-030-27618-8_16
Uprety SSong DSong DLiu TSun LBruza PMelucci MSebastiani FYang G(2018)Investigating Order Effects in Multidimensional Relevance Judgment using Query LogsProceedings of the 2018 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3234944.3234972(191-194)Online publication date: 10-Sep-2018
https://dl.acm.org/doi/10.1145/3234944.3234972
Uprety SSu YSong DLi JCollins-Thompson KMei QDavison BLiu YYilmaz E(2018)Modeling Multidimensional User Relevance in IR using Vector SpacesThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210130(993-996)Online publication date: 27-Jun-2018
https://dl.acm.org/doi/10.1145/3209978.3210130
Fotsoh ASallaberry CLe Parc-Lacayrelle A(2017)Named entity similarity computationProceedings of the 11th Workshop on Geographic Information Retrieval10.1145/3155902.3155903(1-8)Online publication date: 30-Nov-2017
https://dl.acm.org/doi/10.1145/3155902.3155903
Marrara SPasi GViviani M(2017)Aggregation operators in Information RetrievalFuzzy Sets and Systems10.1016/j.fss.2016.12.018324:C(3-19)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1016/j.fss.2016.12.018
Show More Cited By

Abstract

References

Cited By

Recommendations

Multidimensional relevance: Prioritized aggregation in a personalized Information Retrieval setting

A Prioritized "And" Aggregation Operator for Multidimensional Relevance Assessment

Multidimensional Relevance in Task-Specific Retrieval

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations