Abstract
This paper analyzes the results of the INEX 2009 Ad Hoc Track, focusing on a variety of topics. First, we examine in detail the relevance judgments. Second, we study the resulting system rankings, for each of the four ad hoc tasks, and determine whether differences between the best scoring participants are statistically significant. Third, we restrict our attention to particular run types: element and passage runs, keyword and phrase query runs, and systems using a reference run with a solid article ranking. Fourth, we examine the relative effectiveness of content only (CO, or Keyword) search as well as content and structure (CAS, or structured) search. Fifth, we look at the ability of focused retrieval techniques to rank articles. Sixth, we study the length of retrieved results, and look at the impact of restricting result length.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Geva, S., Kamps, J., Lehtonen, M., Schenkel, R., Thom, J.A., Trotman, A.: Overview of the INEX 2009 ad hoc track. In: Geva, S., Kamps, J., Trotman, A. (eds.) Focused Retrieval and Evaluation. LNCS, pp. 4–25. Springer, Heidelberg (2010)
Kamps, J., Marx, M., de Rijke, M., Sigurbjörnsson, B.: XML retrieval: What to retrieve? In: Clarke, C., Cormack, G., Callan, J., Hawking, D., Smeaton, A. (eds.) Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 409–410. ACM Press, New York (2003)
Kamps, J., de Rijke, M., Sigurbjörnsson, B.: Length normalization in XML retrieval (extended abstract). In: Verbrugge, R., Taatgen, N., Schomaker, L. (eds.) BNAIC-2004: Proceedings of the 16th Belgium-Netherlands Conference on Artificial Intelligence, pp. 369–370 (2004)
Kamps, J., Koolen, M., Lalmas, M.: Locating relevant text within XML documents. In: Myaeng, S.-H., Oard, D.W., Sebastiani, F., Chua, T.-S., Leong, M.-K. (eds.) Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 847–849. ACM Press, New York (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kamps, J., Geva, S., Trotman, A. (2010). Analysis of the INEX 2009 Ad Hoc Track Results. In: Geva, S., Kamps, J., Trotman, A. (eds) Focused Retrieval and Evaluation. INEX 2009. Lecture Notes in Computer Science, vol 6203. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14556-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-14556-8_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14555-1
Online ISBN: 978-3-642-14556-8
eBook Packages: Computer ScienceComputer Science (R0)