Article

Automatic transliteration for Japanese-to-English text retrieval

Authors:

Gregory Grefenstette,

David A. EvansAuthors Info & Claims

SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval

Pages 353 - 360

https://doi.org/10.1145/860435.860499

Published: 28 July 2003 Publication History

Abstract

For cross language information retrieval (CLIR) based on bilingual translation dictionaries, good performance depends upon lexical coverage in the dictionary. This is especially true for languages possessing few inter-language cognates, such as between Japanese and English. In this paper, we describe a method for automatically creating and validating candidate Japanese transliterated terms of English words. A phonetic English dictionary and a set of probabilistic mapping rules are used for automatically generating transliteration candidates. A monolingual Japanese corpus is then used for automatically validating the transliterated terms. We evaluate the usage of the extracted English-Japanese transliteration pairs with Japanese to English retrieval experiments over the CLEF bilingual test collections. The use of our automatically derived extension to a bilingual translation dictionary improves average precision, both before and after pseudo-relevance feedback, with gains ranging from 2.5% to 64.8%.

References

[1]

Ballesteros, L., and Croft, B. Dictionary Methods for Cross-Language Information Retrieval, In Proceedings of Database and Expert Systems Applications, 1996, 791--801.

Digital Library

[2]

Buckley, C., Mitra, M., Walz, J., and Cardie, C. Using Clustering and SuperConcepts within SMART: TREC 6. In Voorhees Ellen M. and Donna K. Harman (editors). The Sixth Text REtrieval Conference (TREC-6). NIST Special Publication 500-240, Gaithersburg, MD, 1998, 107--124.

[3]

Cohen, P.R. Empirical Methods for Artificial Intelligence. MIT Press, 1995.

Digital Library

[4]

Davis, M. On the Effective Use of Large Parallel Corpora in Cross-language Text Retrieval. In G. Grefenstette, ed., Cross-Language Information Retrieval, Kluwer Academic Publishers, 1998, 12--22.

[5]

Docherty, V. and Heid, U. Computational Metalexicography in Practice - Corpus-Based Support for the Revision of a Commercial Dictionary. In Proceedings of the VIIIth EURALEX International Congress, 1998, 333--346.

[6]

Evans, D.A., and R.G. Lefferts: CLARIT-TREC Experiments. Information Processing and Management, Vol.31, No.3, 1995, 385--395.

Digital Library

[7]

Fujii, A., and Ishikawa, T. Japanese/English Cross-Language Information Retrieval: Exploration of Query Translation and Transliteration. Computer and the Humanities, Vol 35, No. 4, 2001, 389--420.

[8]

Gao, J., Nie, J., He, H, Chen, W., Zhou, M. Resolving Query Translation Ambiguity using a Decaying Co-occurrence Model and Syntactic Dependence Relations. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 2002, 183--190.

Digital Library

[9]

Grefenstette, G. The Problem of Cross Language Information Retrieval. In G. Grefenstette, ed., Cross Language Information Retrieval, Kluwer Academic Publishers, 1998, 1--9.

Digital Library

[10]

Jang, M., Myaeng, S. H., and Park, S. Y. Using mutual information to resolve query translation ambiguities and query term weighting. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL'99), 1999, 223-229.

Digital Library

[11]

Kando, N., Nozue, T. (ed.) NTCIR Workshop 1: Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. Tokyo, Japan, 1999.

[12]

Kang, B. J. and Choi, K. S. Automatic English- Korean Back-transliteration. In Proceedings of 11th Conference on Hangul and Korean Information Processing, 1999.

[13]

Knight, K. and Graehl, J. Machine Transliteration. Computational Linguistics: 24(4), 1998.

Digital Library

[14]

Maeda, A., Sadat, F., Yoshikawa, M., and Uemura S. Query Term Disambiguation for Web Cross-Language Information Retrieval using a Search Engine. In Proceedings of the 5th International Workshop on Information Retrieval with Asian Languages, 2000.

Digital Library

[15]

Meng. H. M., Lo, W., Chen, B., and Tang, K. Generating Phonetic Cognates to Handel Named Entities in English-Chinese Cross-Language Spoken Document Retrieval. In The Proceedings of the Automatic Speech Recognition and Understanding Workshop (ASRU 2001), 2001.

[16]

Milic-Frayling, N., Tong, X., Zhai, C., Evans, D.A. CLARIT Compound Queries and Constraint-Controlled Feedback in TREC-5 Ad-Hoc Experiments. In E.M. Voorhees and D.K. Harman (Editors), The Fifth Text REtrieval Conference (TREC-5). NIST Special Publication 500-238. Washington, DC: U.S. Government Printing Office, 1997, 315--334.

[17]

Peters, C., Braschler, M., Gonzalo, J., Kluck, M. Evaluation of Cross-Language Information Retrieval Systems, Second Workshop of the Cross-Language Evaluation Forum, CLEF 2001, Revised Papers. Springer, 2002.

[18]

Peters, C., Braschler, M., Gonzalo, J., Kluck, M. Evaluation of Cross-Language Information Retrieval Systems, Third Workshop of the Cross-Language Evaluation Forum, CLEF 2002, Revised Papers. Springer, to appear.

[19]

Qu, Y., Gefenstette, G., and Evans, D. A. Resolving Translation Ambiguity using Monolingual Corpora. In the Working Notes for the CLEF 2002 Workshop, 2002, 115--126.

[20]

Stalls, B. G., and Knight, K. Translating Names and Technical Terms in Arabic Text. In Proceedings of the COLNG/ACL Workshop on Computational Approaches to Semitic Languages, 1998.

Digital Library

Cited By

Prabhakar DPal S(2018)Machine transliteration and transliterated text retrieval: a surveySādhanā10.1007/s12046-018-0828-843:6Online publication date: 7-Jun-2018
https://doi.org/10.1007/s12046-018-0828-8
Gupta PBali KBanchs RChoudhury MRosso PGeva STrotman ABruza PClarke CJärvelin K(2014)Query expansion for mixed-script information retrievalProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609622(677-686)Online publication date: 3-Jul-2014
https://dl.acm.org/doi/10.1145/2600428.2609622
El Kahki ADarwish KEl Din AEl-Wahab MChu-Carroll J(2012)Transliteration mining using large training and test setsProceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies10.5555/2382029.2382061(243-252)Online publication date: 3-Jun-2012
https://dl.acm.org/doi/10.5555/2382029.2382061
Show More Cited By

Index Terms

Automatic transliteration for Japanese-to-English text retrieval
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Information systems
  1. Information retrieval

Recommendations

Statistical transliteration for english-arabic cross language information retrieval
CIKM '03: Proceedings of the twelfth international conference on Information and knowledge management

Out of vocabulary (OOV) words are problematic for cross language information retrieval. One way to deal with OOV words when the two languages have different alphabets, is to transliterate the unknown words, that is, to render them in the orthography of ...
Exploiting a Chinese-English bilingual wordlist for English-Chinese cross language information retrieval
IRAL '00: Proceedings of the fifth international workshop on on Information retrieval with Asian languages

We investigated using the LDC English/Chinese bilingual wordlists for English-Chinese cross language retrieval. It is shown that the Chinese-to-English wordlist can be considered as both a phrase and word dictionary, and is preferable to the English-to-...
Building a Chinese-English wordnet for translingual applications

A WordNet-like linguistic resource is useful, but difficult to construct. This article proposes a method to integrate five linguistic resources, including English/Chinese sense-tagged corpora, English/Chinese thesauruses, and a bilingual dictionary. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval

July 2003

490 pages

ISBN:1581136463

DOI:10.1145/860435

General Chairs:
Charles Clarke
University of Waterloo, Canada
,
Gordon Cormack
University of Waterloo, Canada
,
Program Chairs:
Jamie Callan
Carnegie Mellon University, Pittsburgh, PA
,
David Hawking
Australian National University, Australia
,
Alan Smeaton
Dublin City University, Ireland

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 July 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR03

Sponsor:

SIGIR

SIGIR03: The 26th ACM/SIGIR International Symposium on Information Retrieval

July 28 - August 1, 2003

Toronto, Canada

Acceptance Rates

SIGIR '03 Paper Acceptance Rate 46 of 266 submissions, 17%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
1,316
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Prabhakar DPal S(2018)Machine transliteration and transliterated text retrieval: a surveySādhanā10.1007/s12046-018-0828-843:6Online publication date: 7-Jun-2018
https://doi.org/10.1007/s12046-018-0828-8
Gupta PBali KBanchs RChoudhury MRosso PGeva STrotman ABruza PClarke CJärvelin K(2014)Query expansion for mixed-script information retrievalProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609622(677-686)Online publication date: 3-Jul-2014
https://dl.acm.org/doi/10.1145/2600428.2609622
El Kahki ADarwish KEl Din AEl-Wahab MChu-Carroll J(2012)Transliteration mining using large training and test setsProceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies10.5555/2382029.2382061(243-252)Online publication date: 3-Jun-2012
https://dl.acm.org/doi/10.5555/2382029.2382061
Claveau V(2012)Translation of Biomedical Terms by Inferring Rewriting RulesMachine Learning10.4018/978-1-60960-818-7.ch514(1417-1433)Online publication date: 2012
https://doi.org/10.4018/978-1-60960-818-7.ch514
Zhou DTruran MBrailsford TWade VAshman H(2012)Translation techniques in cross-language information retrievalACM Computing Surveys10.1145/2379776.237977745:1(1-44)Online publication date: 7-Dec-2012
https://dl.acm.org/doi/10.1145/2379776.2379777
Hautasaari AIshida TVatrapu REvers VAkhilesh KNardi BMaznevski M(2012)Analysis of discussion contributions in translated Wikipedia articlesProceedings of the 4th international conference on Intercultural Collaboration10.1145/2160881.2160891(57-66)Online publication date: 21-Mar-2012
https://dl.acm.org/doi/10.1145/2160881.2160891
Nie JGao JCao G(2012)Translingual Mining from Text DataMining Text Data10.1007/978-1-4614-3223-4_10(323-359)Online publication date: 7-Jan-2012
https://doi.org/10.1007/978-1-4614-3223-4_10
El-Kahky ADarwish KAldein AEl-Wahab MHefny AAmmar WMerlo PBarzilay RJohnson M(2011)Improved transliteration mining using graph reinforcementProceedings of the Conference on Empirical Methods in Natural Language Processing10.5555/2145432.2145578(1384-1393)Online publication date: 27-Jul-2011
https://dl.acm.org/doi/10.5555/2145432.2145578
Malik MBoitet CBhattacharyya PJoshi AHuang CJurafsky D(2010)Finite-state scriptural translationProceedings of the 23rd International Conference on Computational Linguistics: Posters10.5555/1944566.1944657(791-800)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1944566.1944657
Malik ABesacier LBoitet CBhattacharyya PLi HKumaran A(2009)A hybrid model for Urdu Hindi transliterationProceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration10.5555/1699705.1699746(177-185)Online publication date: 7-Aug-2009
https://dl.acm.org/doi/10.5555/1699705.1699746
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents