research-article

Translation enhancement: a new relevance feedback method for cross-language information retrieval

Authors:

Dan WuAuthors Info & Claims

CIKM '08: Proceedings of the 17th ACM conference on Information and knowledge management

Pages 729 - 738

https://doi.org/10.1145/1458082.1458180

Published: 26 October 2008 Publication History

Abstract

As an effective technique for improving retrieval effectiveness, relevance feedback (RF) has been widely studied in both monolingual and cross-language information retrieval (CLIR) settings. The studies of RF in CLIR have been focused on query expansion (QE), in which queries are reformulated before and/or after they are translated. However, RF in CLIR actually not only can help select better query terms, but also can enhance query translation by adjusting translation probabilities and even resolve some out-of-vocabulary terms. In this paper, we propose a novel RF method called translation enhancement (TE), which uses the extracted translation relationships from relevant documents to revise the translation probabilities of query terms and to identify extra translation alternatives if available so that the translated queries are more tuned to the current search. We studied TE using pseudo relevance feedback (PRF) and interactive relevance feedback (IRF). Our results show that TE can significantly improve CLIR with both types of RF methods, and that the improvement is comparable to that of QE. More importantly, the effects of TE and QE are complementary. Their integration can produce further improvement, and makes CLIR more robust for a variety of queries.

References

[1]

Allan, J. HARD Track Overview in TREC 2003 High Accuracy Retrieval from Documents. In 12th Text Retrieval Conference. pages 24--37. 2003.

[2]

Allan, J. Introduction to Topic Detection and Tracking. Topic Detection and Tracking, Event-based Information Organization. J. Allan (Eds). Kluwer Academic Publishers. pp:1--16. 2004.

Digital Library

[3]

Ballesteros, L. and Croft, W. B. Phrasal Translation and Query Expansion Techniques for Cross-Language Information Retrieval. In Proceedings of the 20th International ACM SIGIR Conference on Research and Development in Information Retrieval. pages 84--91. 1997.

Digital Library

[4]

Buckley, C., Salton, G., Allan, J. and Singhal, A. Automatic Query Expansion Using SMART: TREC 3. In The Third Text REtrieval Conference (TREC-3). 1994.

[5]

Darwish, K. and Oard, D. W. Probabilistic Structured Query Methods. In Proceedings of the 26th International ACM SIGIR Conference on Research and Development in Information Retrieval. pages 338--344. 2003.

Digital Library

[6]

Demner-Fushman, D. and Oard, D. W. The Effect of Bilingual Term List Size on Dictionary-Based Cross-Language Information Retrieval. In 36th Annual Hawaii International Conference on System Sciences (HICSS'03) - Track 4. 2003.

Digital Library

[7]

Gey, F. C. and Chen, A. TREC-9 Cross-Language Information Retrieval (English - Chinese) Overview. In TREC 2001. pages 1--10. 2001.

[8]

Harman, D. K. Relevance feedback revisited. In ACM-SIGIR 92. pages 1--10. 1992.

Digital Library

[9]

Harper, D. J. Relevance Feedback in document retrieval systems: an evaluation of probabilistic strategies. Jesus College, Cambridge University, 1980.

[10]

He, D., Oard, D. W., Wang, J., Luo, J., Demner-Fushman, D., Darwish, K., Resnik, P., Khudanpur, S., Nossal, M., Subotin, M. and Leuski, A. Making MIRACLEs: Interactive Translingual Search for Cebuano and Hindi. ACM Transactions on Asian Lnaguage Information Processing, 2(3): 219--244.2003

Digital Library

[11]

He, D., Wang, J., Oard, D. W. and Nossal, M. Comparing user-assisted and Automatic Query Translation. In Proceedings of CLEF'02. pages 400--415. 2002.

[12]

Hiemstra, D., Kraaij, W., Pohlmann, R. and Westerveld, T. Translation resources, merging strategies, and relevance feedback for cross-language information retrieval. In Proceedings of the 1st Cross-Language Evaluation Forum (CELF 2001). pages 102--115. 2001.

Digital Library

[13]

Ide, E. New experiments in relevance feedback. The SMART retrieval system, Experiments in automatic document processing. G. Salton (Eds). Prentice-Hall. pp:337--354. 1971.

[14]

Lavrenko, V., Choquette, M. and Croft, W. B. Corss-Lingual Relevance Models. Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. pages 175--182. 2002

Digital Library

[15]

Lavrenko, V. and Croft, W. B. Relevance-based Language Models. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. pages 120--127. 2001.

Digital Library

[16]

López-Ostenero, F., Gonzalo, J., Penas, A. and Verdejo, F. Noun Phrase Translation for Cross-Language Document Selection. In Proceedings of CLEF 2001. pages 1639--1650. 2001.

Digital Library

[17]

McNamee, P. and Mayfield, J. Comparing Cross-Language Query Expansion Techniques by Degrading Translation Resources. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. pages 159--166. 2002.

Digital Library

[18]

Oard, D. W. and Diekema, A. R. Cross-Language Information Retrieval. Annual Review of Information Science and Technology. B. Cronin (Eds). American Society for Information Science. 33 pp:223--256. 1998.

Digital Library

[19]

Oard, D. W. and Gonzalo, J. The CLEF2001 Interactive Track. In the Cross-Language Evaluation Forum (CLEF) 2001 pages 176. 2001.

Digital Library

[20]

Orengo, V. M. and Huyck, C. Relevance feedback and cross-language information retrieval. Information Processing and Management, 42(5): 1203--1217. 2006

Digital Library

[21]

Pirkola, A. The effects of query structure and dictionary setups in dictionary-based cross-language information retrieval. Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. pages 55--63. 1998

Digital Library

[22]

Ponte, J. M. Language models for relevance feedback. Advances in Information retrieval: Recent Research from the Center for Intelligent Information Retrieval. W. B. Croft (Eds). Kluwer Academic Publishers. pp:73--95. 2000.

[23]

Resnik, P., Oard, D. and Levow, G. Improved Cross-Language Retrieval using Backoff Translation. In First International Conference on Human Language Technologies. pages 1--3. 2001.

Digital Library

[24]

Rocchio, J. J. Relevance Feedback in Information Retrieval. the SMART Retrieval System. G. Salton (Eds). Prentice Hall, Inc. pp:313--323. 1971.

[25]

Salton, G. and Buckley, C. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41(4): 288--297.1990

[26]

Voorhees, E. M. Query Expansion Using Lexical-Semantic Relations. In Proceedings of SIGIR '94. pages 61--69. 1994.

Digital Library

[27]

Wang, J. and Oard, D. W. iCLEF 2001 at Maryland: Comparing Word-for-Word Gloss and MT. In 2nd Workshop of the Cross-Language Evaluation Forum, CLEF 2001. pages 336--354. 2001.

Digital Library

[28]

Wang, J. and Oard, D. W. Combining Bidirectional Translation and Synonymy for Cross-language Information Retrieval. In Proceedings of the ACM SIGIR 2006. pages 202--209. 2006.

Digital Library

[29]

Xu, J. and Croft, W. B. Improving the effectiveness of information retrieval with local context analysis. ACM Transactions on Information Systems, 18(1): 79--112. 2000

Digital Library

[30]

Xu, J., Fraser, A. and Weischedel, R. TREC 2001 Cross-lingual Retrieval at BBN. In Proceeding of TREC01. 2001.

[31]

Yarowsky, D. Unsupervised Word Sense Disambiguation Rivaling Supervised Methods In Proceeding of Meeting of the Association for Computational Linguistics (ACL-95). pages 189--196. 1995.

Digital Library

Cited By

Lee CCroft W(2014)Cross-Language Pseudo-Relevance Feedback Techniques for Informal TextProceedings of the 36th European Conference on IR Research on Advances in Information Retrieval - Volume 841610.5555/2964060.2964176(260-272)Online publication date: 13-Apr-2014
https://dl.acm.org/doi/10.5555/2964060.2964176
Lee CCroft W(2014)Cross-Language Pseudo-Relevance Feedback Techniques for Informal TextAdvances in Information Retrieval10.1007/978-3-319-06028-6_22(260-272)Online publication date: 2014
https://doi.org/10.1007/978-3-319-06028-6_22
Zhou DTruran MBrailsford TWade VAshman H(2012)Translation techniques in cross-language information retrievalACM Computing Surveys10.1145/2379776.237977745:1(1-44)Online publication date: 7-Dec-2012
https://dl.acm.org/doi/10.1145/2379776.2379777
Show More Cited By

Index Terms

Translation enhancement: a new relevance feedback method for cross-language information retrieval
1. Information systems
  1. Information retrieval
    1. Evaluation of retrieval results
      1. Relevance assessment

Recommendations

Enhancing query translation with relevance feedback in translingual information retrieval

As an effective technique for improving retrieval effectiveness, relevance feedback (RF) has been widely studied in both monolingual and translingual information retrieval (TLIR). The studies of RF in TLIR have been focused on query expansion (QE), in ...
Preliminary study into query translation for patent retrieval
PaIR '10: Proceedings of the 3rd international workshop on Patent information retrieval

Patent retrieval is a branch of Information Retrieval (IR) aiming to support patent professionals in retrieving patents that satisfy their information needs. Often, patent granting bodies require patents to be partially translated into one or more major ...
A study of using an out-of-box commercial MT system for query translation in CLIR
iNEWS '08: Proceedings of the 2nd ACM workshop on Improving non english web searching

Recent availability of commercial online machine translation (MT) systems makes it possible for layman Web users to utilize the MT capability for cross-language information retrieval (CLIR). To study the effectiveness of using MT for query translation, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '08: Proceedings of the 17th ACM conference on Information and knowledge management

October 2008

1562 pages

ISBN:9781595939913

DOI:10.1145/1458082

General Chair:
James G. Shanahan
Church and Duncan Group Inc, USA
,
Program Chairs:
Sihem Amer-Yahia
Yahoo! Research, USA
,
Ioana Manolescu
INRIA, France
,
Yi Zhang
University of California, Santa Cruz, USA
,
David A. Evans
JustSystems Evans Research, USA
,
Alek Kolcz
Microsoft Live Labs, USA
,
Key-Sun Choi
KAIST, Korea
,
Abdur Chowdury
Twitter, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIKM08

Sponsor:

CIKM08: Conference on Information and Knowledge Management

October 26 - 30, 2008

California, Napa Valley, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
367
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee CCroft W(2014)Cross-Language Pseudo-Relevance Feedback Techniques for Informal TextProceedings of the 36th European Conference on IR Research on Advances in Information Retrieval - Volume 841610.5555/2964060.2964176(260-272)Online publication date: 13-Apr-2014
https://dl.acm.org/doi/10.5555/2964060.2964176
Lee CCroft W(2014)Cross-Language Pseudo-Relevance Feedback Techniques for Informal TextAdvances in Information Retrieval10.1007/978-3-319-06028-6_22(260-272)Online publication date: 2014
https://doi.org/10.1007/978-3-319-06028-6_22
Zhou DTruran MBrailsford TWade VAshman H(2012)Translation techniques in cross-language information retrievalACM Computing Surveys10.1145/2379776.237977745:1(1-44)Online publication date: 7-Dec-2012
https://dl.acm.org/doi/10.1145/2379776.2379777
Wu DHe D(2012)Exploring the further integration of machine translation in English‐Chinese cross language information accessProgram10.1108/0033033121127649546:4(429-457)Online publication date: 21-Sep-2012
https://doi.org/10.1108/00330331211276495
Ye ZHuang JHe BLin H(2012)Mining a multilingual association dictionary from Wikipedia for cross-language information retrievalJournal of the American Society for Information Science and Technology10.1002/asi.2269663:12(2474-2487)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1002/asi.22696
Korra RSujatha PChetana SNaresh Kumar M(2011)Performance evaluation of Multilingual Information Retrieval (MLIR) system over Information Retrieval (IR) system2011 International Conference on Recent Trends in Information Technology (ICRTIT)10.1109/ICRTIT.2011.5972453(722-727)Online publication date: Jun-2011
https://doi.org/10.1109/ICRTIT.2011.5972453

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents