Article

Free access

A geometric view on bilingual lexicon extraction from comparable corpora

Authors:

H. DéjeanAuthors Info & Claims

ACL '04: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics

Pages 526 - es

https://doi.org/10.3115/1218955.1219022

Published: 21 July 2004 Publication History

Abstract

We present a geometric view on bilingual lexicon extraction from comparable corpora, which allows to re-interpret the methods proposed so far and identify unresolved problems. This motivates three new methods that aim at solving these problems. Empirical evaluation shows the strengths and weaknesses of these methods, as well as a significant gain in the accuracy of extracted lexicons.

References

[1]

F. R. Bach and M. I. Jordan. 2001. Kernel independent component analysis. Journal of Machine Learning Research.

Digital Library

[2]

R. Besançon, M. Rajman, and J.-C. Chappelier. 1999. Textual similarities based on a distributional approach. In Proceedings of the Tenth International Workshop on Database and Expert Systems Applications (DEX'99), Florence, Italy.

Digital Library

[3]

S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391--407.

[4]

H. Dejean, E. Gaussier, and F. Sadat. 2002. An approach based on multilingual thesauri and model combination for bilingual lexicon extraction. In International Conference on Computational Linguistics, COLING'02.

Digital Library

[5]

A. P. Dempster, N. M. Laird, and D. B. Rubin. 1977. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39(1): 1--38.

[6]

Mona Diab and Steve Finch. 2000. A statistical word-level translation model for comparable corpora. In Proceeding of the Conference on Content-Based Multimedia Information Access (RIAO).

[7]

Pascale Fung. 2000. A statistical view on bilingual lexicon extraction - from parallel corpora to nonparallel corpora. In J. Véronis, editor, Parallel Text Processing. Kluwer Academic Publishers.

[8]

G. Grefenstette. 1994. Explorations in Automatic Thesaurus Construction. Kluwer Academic Publishers.

Digital Library

[9]

Thomas Hofmann. 1999. Probabilistic latent semantic analysis. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, pages 289--296. Morgan Kaufmann.

Digital Library

[10]

Thomas Hofmann. 2000. Learning the similarity of documents: An information-geometric approach to document retrieval and categorization. In Advances in Neural Information Processing Systems 12, page 914. MIT Press.

[11]

Tommi S. Jaakkola and David Haussler. 1999. Exploiting generative models in discriminative classifiers. In Advances in Neural Information Processing Systems 11, pages 487--493.

Digital Library

[12]

Philipp Koehn and Kevin Knight. 2002. Learning a translation lexicon from monolingual corpora. In ACL 2002 Workshop on Unsupervised Lexical Acquisition.

Digital Library

[13]

P. A. W. Lewis, P. B. Baxendale, and J. L. Bennet. 1967. Statistical discrimination of the synonym/antonym relationship between words. Journal of the ACM.

Digital Library

[14]

C. Peters and E. Picchi. 1995. Capturing the comparable: A system for querying comparable text corpora. In JADT'95--3rd International Conference on Statistical Analysis of Textual Data, pages 255--262.

[15]

R. Rapp. 1995. Identifying word translations in nonparallel texts. In Proceedings of the Annual Meeting of the Association for Computational Linguistics.

Digital Library

[16]

I. Shahzad, K. Ohtake, S. Masuyama, and K. Yamamoto. 1999. Identifying translations of compound nouns using non-aligned corpora. In Proceedings of the Workshop MAL'99, pages 108--113.

[17]

K. Tanaka and Hideya Iwasaki. 1996. Extraction of lexical translations from non-aligned corpora. In International Conference on Computational Linguistics, COLING'96.

Digital Library

[18]

Naonori Ueda and Ryohei Nakano. 1995. Deterministic annealing variant of the EM algorithm. In Advances in Neural Information Processing Systems 7, pages 545--552.

[19]

A. Vinokourov, J. Shawe-Taylor, and N. Cristianini. 2002. Finding language-independent semantic representation of text using kernel canonical correlation analysis. In Advances in Neural Information Processing Systems 12.

Cited By

Ruder SVulić ISøgaard A(2019)A survey of cross-lingual word embedding modelsJournal of Artificial Intelligence Research10.1613/jair.1.1164065:1(569-630)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1613/jair.1.11640
Zhang MPeng HLiu YLuan HSun MSingh SMarkovitch S(2017)Bilingual lexicon induction from non-parallel data with minimal supervisionProceedings of the Thirty-First AAAI Conference on Artificial Intelligence10.5555/3298023.3298059(3379-3385)Online publication date: 4-Feb-2017
https://dl.acm.org/doi/10.5555/3298023.3298059
Tholpadi GBhattacharyya CShevade S(2017)Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from WikipediaACM Transactions on Asian and Low-Resource Language Information Processing10.1145/303829516:3(1-25)Online publication date: 17-Mar-2017
https://dl.acm.org/doi/10.1145/3038295
Show More Cited By

Recommendations

Unsupervised Word-Sense Disambiguation Using Bilingual Comparable Corpora

An unsupervised method for word-sense disambiguation using bilingual comparable corpora was developed. First, it extracts word associations, i.e., statistically significant pairs of associated words, from the corpus of each language. Then, it aligns ...
Clustering comparable corpora for bilingual lexicon extraction
HLT '11: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2

We study in this paper the problem of enhancing the comparability of bilingual corpora in order to improve the quality of bilingual lexicons extracted from comparable corpora. We introduce a clustering-based approach for enhancing corpus comparability ...
A Statistical View on Bilingual Lexicon Extraction: From Parallel Corpora to Non-parallel Corpora
AMTA '98: Proceedings of the Third Conference of the Association for Machine Translation in the Americas on Machine Translation and the Information Soup

We present two problems for statistically extracting bilingual lexicon: (1) How can noisy parallel corpora be used? (2) How can non-parallel yet comparable corpora be used? We describe our own work and contribution in relaxing the constraint of using ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '04: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics

July 2004

729 pages

General Chair:
Donia Scott
ITRI, University of Brighton

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 21 July 2004

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
427
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)5

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ruder SVulić ISøgaard A(2019)A survey of cross-lingual word embedding modelsJournal of Artificial Intelligence Research10.1613/jair.1.1164065:1(569-630)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1613/jair.1.11640
Zhang MPeng HLiu YLuan HSun MSingh SMarkovitch S(2017)Bilingual lexicon induction from non-parallel data with minimal supervisionProceedings of the Thirty-First AAAI Conference on Artificial Intelligence10.5555/3298023.3298059(3379-3385)Online publication date: 4-Feb-2017
https://dl.acm.org/doi/10.5555/3298023.3298059
Tholpadi GBhattacharyya CShevade S(2017)Corpus-Based Translation Induction in Indian Languages Using Auxiliary Language Corpora from WikipediaACM Transactions on Asian and Low-Resource Language Information Processing10.1145/303829516:3(1-25)Online publication date: 17-Mar-2017
https://dl.acm.org/doi/10.1145/3038295
Liu XDuh KMatsumoto Y(2015)Multilingual Topic Models for Bilingual Dictionary ExtractionACM Transactions on Asian and Low-Resource Language Information Processing10.1145/269993914:3(1-22)Online publication date: 12-Jun-2015
https://dl.acm.org/doi/10.1145/2699939
Hazem AMorin E(2014)Improving Bilingual Lexicon Extraction from Comparable Corpora Using Window-Based and Syntax-Based ModelsProceedings of the 15th International Conference on Computational Linguistics and Intelligent Text Processing - Volume 840410.1007/978-3-642-54903-8_26(310-323)Online publication date: 6-Apr-2014
https://dl.acm.org/doi/10.1007/978-3-642-54903-8_26
Rahimi RShakery A(2013)A language modeling approach for extracting translation knowledge from comparable corporaProceedings of the 35th European conference on Advances in Information Retrieval10.1007/978-3-642-36973-5_51(606-617)Online publication date: 24-Mar-2013
https://dl.acm.org/doi/10.1007/978-3-642-36973-5_51
Tamura AWatanabe TSumita ETsujii JHenderson JPasca M(2012)Bilingual lexicon extraction from comparable corpora using label propagationProceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning10.5555/2390948.2390952(24-36)Online publication date: 12-Jul-2012
https://dl.acm.org/doi/10.5555/2390948.2390952
Vulić IMoens MDaelemans W(2012)Detecting highly confident word translations from comparable corpora without any prior knowledgeProceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics10.5555/2380816.2380872(449-459)Online publication date: 23-Apr-2012
https://dl.acm.org/doi/10.5555/2380816.2380872
Andrade DMatsuzaki TTsujii J(2012)Statistical Extraction and Comparison of Pivot Words for Bilingual Lexicon ExtensionACM Transactions on Asian Language Information Processing10.1145/2184436.218443911:2(1-31)Online publication date: 1-Jun-2012
https://dl.acm.org/doi/10.1145/2184436.2184439
Hazem AMorin E(2012)QAlignProceedings of the 13th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part II10.1007/978-3-642-28601-8_8(83-96)Online publication date: 11-Mar-2012
https://dl.acm.org/doi/10.1007/978-3-642-28601-8_8
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents