article

Free access

BMIR-J2: a test collection for evaluation of Japanese information retrieval systems

Authors:

Teru Agata, and

Noriko KandoAuthors Info & Claims

ACM SIGIR Forum, Volume 33, Issue 1

Pages 13 - 17

https://doi.org/10.1145/331403.331406

Published: 01 September 1999 Publication History

PDF eReader

Abstract

BMIR-J2 is the first complete test collection generally available for evaluating Japanese information retrieval systems. BMIR-J2 features include a novel division of search requests based on various functions required to perform successful retrieval. BMIR-J2 and its smaller predecessor BMIR-J1 were constructed by a volunteer-based working group under the Information Processing Society of Japan. We hope that BMIR-J2 will come into wide use and that it will foster the development of Japanese IR systems.

Cited By

View all

Iqbal MTahir BMehmood M(2021)CURE: Collection for Urdu Information Retrieval Evaluation and Ranking2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2)10.1109/ICoDT252288.2021.9441510(1-6)Online publication date: 20-May-2021
https://doi.org/10.1109/ICoDT252288.2021.9441510
Sakai T(2020)Graded RelevanceEvaluating Information Retrieval and Access Tasks10.1007/978-981-15-5554-1_1(1-20)Online publication date: 2-Sep-2020
https://doi.org/10.1007/978-981-15-5554-1_1
Esmaili KAbolhassani HNeshati MBehrangi ERostami ANasiri M(2007)Mahak: A Test Collection for Evaluation of Farsi Information Retrieval Systems2007 IEEE/ACS International Conference on Computer Systems and Applications10.1109/AICCSA.2007.370697(639-644)Online publication date: May-2007
https://doi.org/10.1109/AICCSA.2007.370697
Show More Cited By

Index Terms

BMIR-J2: a test collection for evaluation of Japanese information retrieval systems
1. Information systems
  1. Information retrieval
  2. Information storage systems

Recommendations

Lessons from BMIR-J2: a test collection for Japanese IR systems
SIGIR '98: Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Read More
Evaluating scalability in information retrieval with multigraded relevance
AIRS'06: Proceedings of the Third Asia conference on Information Retrieval Technology

For the user’s point of view, in large environments, it can be desirable to have Information Retrieval Systems (IRS) that retrieve documents according to their relevance levels. Relevance levels have been studied in some previous Information Retrieval (...
Read More
Experiments with automatic indexing and a relational thesaurus in a Chinese information retrieval system
Read More

Comments

Information & Contributors

Information

Published In

ACM SIGIR Forum Volume 33, Issue 1

Fall 1999

45 pages

ISSN:0163-5840

DOI:10.1145/331403

Editor:
Susan Dumais
Microsoft Research, Redmond, WA

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 1999

Published in SIGIR Volume 33, Issue 1

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
263
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)11

Other Metrics

View Author Metrics

Citations

Cited By

View all

Iqbal MTahir BMehmood M(2021)CURE: Collection for Urdu Information Retrieval Evaluation and Ranking2021 International Conference on Digital Futures and Transformative Technologies (ICoDT2)10.1109/ICoDT252288.2021.9441510(1-6)Online publication date: 20-May-2021
https://doi.org/10.1109/ICoDT252288.2021.9441510
Sakai T(2020)Graded RelevanceEvaluating Information Retrieval and Access Tasks10.1007/978-981-15-5554-1_1(1-20)Online publication date: 2-Sep-2020
https://doi.org/10.1007/978-981-15-5554-1_1
Esmaili KAbolhassani HNeshati MBehrangi ERostami ANasiri M(2007)Mahak: A Test Collection for Evaluation of Farsi Information Retrieval Systems2007 IEEE/ACS International Conference on Computer Systems and Applications10.1109/AICCSA.2007.370697(639-644)Online publication date: May-2007
https://doi.org/10.1109/AICCSA.2007.370697
Sakai TKoyama MSuzuki MKumano AManabe TAdachi J(2003)BRIDJE over a language barrierProceedings of the sixth international workshop on Information retrieval with Asian languages - Volume 1110.3115/1118935.1118944(65-76)Online publication date: 7-Jul-2003
https://dl.acm.org/doi/10.3115/1118935.1118944
Kise KTsujino MMatsumoto K(2002)Spotting Where to Read on Pages - Retrieval of Relevant Parts from Page ImagesProceedings of the 5th International Workshop on Document Analysis Systems V10.5555/647798.736660(388-399)Online publication date: 19-Aug-2002
https://dl.acm.org/doi/10.5555/647798.736660
Kise KTsujino MMatsumoto K(2002)Spotting Where to Read on Pages - Retrieval of Relevant Parts from Page ImagesDocument Analysis Systems V10.1007/3-540-45869-7_43(388-399)Online publication date: 9-Aug-2002
https://doi.org/10.1007/3-540-45869-7_43
Sakai TSparck-Jones KKraft DCroft WHarper DZobel J(2001)Generic summaries for indexing in information retrievalProceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval10.1145/383952.383987(190-198)Online publication date: 1-Sep-2001
https://dl.acm.org/doi/10.1145/383952.383987
SAKAI T(2001)Japanese-English Cross-Language Information Retrieval Using Machine Translation and Pseudo-Relevance FeedbackInternational Journal of Computer Processing of Languages10.1142/S021942790100031X14:02(83-107)Online publication date: Jun-2001
https://doi.org/10.1142/S021942790100031X
Sakai TWong KLee DLee J(2000)MT-based Japanese-Enlish cross-language IR experiments using the TREC test collectionsProceedings of the fifth international workshop on on Information retrieval with Asian languages10.1145/355214.355240(181-188)Online publication date: 1-Nov-2000
https://dl.acm.org/doi/10.1145/355214.355240
Sakai TKajiura MSumita KWong KLee DLee J(2000)A first step towards flexible local feedback for ad hoc retrievalProceedings of the fifth international workshop on on Information retrieval with Asian languages10.1145/355214.355228(95-102)Online publication date: 1-Nov-2000
https://dl.acm.org/doi/10.1145/355214.355228

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Cited By

Index Terms

Recommendations

Lessons from BMIR-J2: a test collection for Japanese IR systems

Evaluating scalability in information retrieval with multigraded relevance

Experiments with automatic indexing and a relational thesaurus in a Chinese information retrieval system

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Get Access

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations