Abstract
Starting in 1997, the National Institute of Standards and Technology conducted 3 years of evaluation of cross-language information retrieval systems in the Text REtrieval Conference (TREC). Twentytwo participating systems used topics (test questions) in one language to retrieve documents written in English, French, German, and Italian. A large-scale multilingual test collection has been built and a new technique for building such a collection in a distributed manner was devised.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Sheridan, P. and Ballerini, J. P. and and Schäuble P.: Building a Large Multilingual Test Collection from Comparable News Documents. In: Grefenstette, G. (ed.): Cross-Language Information Retrieval. Kluwer Academic Publishers, Boston (1998) chapter 11.
Sheridan, P. and Ballerini, J. P.: Experiments in Multilingual Information Retrieval using the SPIDER System. In: Proceedings of the 19th ACM SIGIR Conference on Research and Development in Information Retrieval, Zurich, Switzerland, (1996), 58–65.
Voorhees, E. and Harman, D. (1998): Overview of the Sixth Text REtrieval Conference (TREC-6). In: Proceedings of the Sixth Text REtrieval Conference (TREC-6). NIST Special Publication 500-240 (1998), 1–24. Also at http://trec.nist.gov/pubs.html
Schäuble, P. and Sheridan P. (1998): Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Sixth Text REtrieval Conference (TREC-6). NIST Special Publication 500-240 (1998), 31–44. Also at http://trec.nist.gov/pubs.html
Braschler, M., Krause, J., Peters C., and Schäuble P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Seventh Text REtrieval Conference (TREC-7). NIST Special Publication 500-242 (1999), 25–32. Also at http://trec.nist.gov/pubs.html
Braschler, M., Peters C., and Schäuble P.: Cross-Language Information Retrieval (CLIR) Track Overview. In: Proceedings of the Eighth Text REtrieval Conference (TREC-8). NIST Special Publication 500-246 (2000), 25–34. Also at http://trec.nist.gov/pubs.html
Voorhees, Ellen M.: Variations in Relevance Judgments and the Measurement of Retrieval Effectiveness. In: Proceedings of the 21st ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia (1998), 315–323.
Zobel, Justin: How Reliable are the Results of Large-Scale Information Retrieval Experiments? In: Proceedings of the 21st ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia (1998), 307–314.
Voorhees, E.M., and Harman, D.K.: Overview of the Eighth Text REtrieval Conference (TREC-8). In: Proceedings of the Eighth Text REtrieval Conference (TREC-8). NIST Special Publication 500-246 (2000), 1–24. Also at http://trec.nist.gov/pubs.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Harman, D. et al. (2001). CLIR Evaluation at TREC. In: Peters, C. (eds) Cross-Language Information Retrieval and Evaluation. CLEF 2000. Lecture Notes in Computer Science, vol 2069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44645-1_2
Download citation
DOI: https://doi.org/10.1007/3-540-44645-1_2
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42446-8
Online ISBN: 978-3-540-44645-3
eBook Packages: Springer Book Archive