Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2600428.2602298acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
tutorial

The retrievability of documents

Published: 03 July 2014 Publication History

Abstract

Retrievability is an important and interesting indicator that can be used in a number of ways to analyse Information Retrieval systems and document collections. Rather than focusing totally on relevance, retrievability examines what is retrieved, how often it is retrieved, and whether a user is likely to retrieve a document or not. This is important because a document needs to be retrieved, before it can be judged for relevance. In this tutorial, we shall explain the concept of retrievability along with a number of retrievability measures, how it can be estimated and how it can be used for analysis. Since retrieval precedes relevance, we shall also provide an overview of how retrievability relates to effectiveness - describing some of the insights that researchers have discovered so far. We shall also show how retrievability relates to efficiency, and how the theory of retrievability can be used to improve both effectiveness and efficiency. Then we shall provide an overview of the different applications of retrievability such as Search Engine Bias, Corpus Profiling, etc., before wrapping up with challenges and opportunities. The final session of the day will look at example problems and ways to analyse and apply retrievability to other problems and domains.

References

[1]
L. Azzopardi. Query side evaluation: an empirical analysis of effectiveness and effort. In Proc. of the 32nd ACM SIGIR conference, pages 556--563, 2009.
[2]
L. Azzopardi. The economics in interactive ir. In Proc. of the 34th ACM SIGIR Conference, pages 15--24, 2011.
[3]
L. Azzopardi. Searching for unlawful carnal knowledge. In Proc. of the SIGIR Workshop: Search for Fun, volume 11, pages 17--18, 2011.
[4]
L. Azzopardi and M. de Rijke. Automatic construction of known-item finding test beds. In Proceedings of SIGIR '06, pages 603--604, 2006.
[5]
L. Azzopardi, M. de Rijke, and K. Balog. Building simulated queries for known-item topics: an analysis using six european languages. In Proc. of the 30th ACM SIGIR conference, pages 455--462, 2007.
[6]
L. Azzopardi and V. Vinay. Retrievability: An evaluation measure for information access tasks. In Proc. of the 17th ACM CIKM, pages 561--570, 2008.
[7]
K. Balog, L. Azzopardi, and M. de Rijke. Formal models for expert finding in enterprise corpora. In Proc. of the 29th ACM SIGIR Conference, pages 43--50, 2006.
[8]
R. T. Fernández, D. E. Losada, and L. A. Azzopardi. Extending the language modeling framework for sentence retrieval to include local context. Information Retrieval, 14(4):355--389, 2011.

Cited By

View all
  • (2024)Search under Uncertainty: Cognitive Biases and Heuristics - Tutorial on Modeling Search Interaction using Behavioral EconomicsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638297(427-430)Online publication date: 10-Mar-2024
  • (2024)Search under Uncertainty: Cognitive Biases and Heuristics: A Tutorial on Testing, Mitigating and Accounting for Cognitive Biases in Search ExperimentsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3661382(3013-3016)Online publication date: 10-Jul-2024
  • (2016)Simulation of InteractionProceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval10.1145/2911451.2914799(1227-1230)Online publication date: 7-Jul-2016

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval
July 2014
1330 pages
ISBN:9781450322577
DOI:10.1145/2600428
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 July 2014

Check for updates

Author Tags

  1. effectiveness
  2. evaluation
  3. retrievability

Qualifiers

  • Tutorial

Conference

SIGIR '14
Sponsor:

Acceptance Rates

SIGIR '14 Paper Acceptance Rate 82 of 387 submissions, 21%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Search under Uncertainty: Cognitive Biases and Heuristics - Tutorial on Modeling Search Interaction using Behavioral EconomicsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638297(427-430)Online publication date: 10-Mar-2024
  • (2024)Search under Uncertainty: Cognitive Biases and Heuristics: A Tutorial on Testing, Mitigating and Accounting for Cognitive Biases in Search ExperimentsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3661382(3013-3016)Online publication date: 10-Jul-2024
  • (2016)Simulation of InteractionProceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval10.1145/2911451.2914799(1227-1230)Online publication date: 7-Jul-2016

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media