Article

Free access

Lexical substitution as a task for WSD evaluation

Author:

WSD '02: Proceedings of the ACL-02 workshop on Word sense disambiguation: recent successes and future directions - Volume 8

Pages 109 - 115

https://doi.org/10.3115/1118675.1118691

Published: 11 July 2002 Publication History

PDF eReader

Abstract

The paper is intended to promote discussion on potential application oriented methodologies for the next SENSEVAL, and to suggest one possibility for an application-oriented task. Whilst the traditional gold-standard sense-tagging methodology has proved useful in the last two SENSEVALS, the problem of coming up with a satisfactory sense inventory remains, as the choice of the inventory typically creates biases in favour of particular systems. Coupled with the problems that these biases impose is the issue that the inventory, and level of granularity, should reflect the purpose of the application for which the WSD component is intended. In the last SENSEVAL, the Japanese Translation task was a step in this direction. In this paper we will outline some possibilities for a lexical substitution task, and argue that such a task is relevant to several applications to which a WSD system might be applied and would permit participants to select their own inventory.

References

[1]

Eneko Agirre, German Rigau, and J. Atserias. 2000. Combining supervised and unsupervised lexical knowledge methods for word sense disambiguation. Computers and the Humanities. Senseval Special Issue, 34(1--2):103--108.

Google Scholar

[2]

Sue Atkins. 1993. Tools for computer-aided lexicography: the Hector project. In Papers in Computational Lexicography: COMPLEX 93, Budapest.

Google Scholar

[3]

Michele Banko, Vibhu Mittal, and Michael Witbrock. 2000. Headline generation based on statistical translation. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics, pages 318--325.

Digital Library

Google Scholar

[4]

P. Brown, S. A. D. Pietra, V. J. D. Pietra, and R. L. Mercer. 1991. Word-sense disambiguation using statistical methods. In Proceedings of the 29th Annual Meeting of the Association for Computational Linguistics, pages 264--270.

Digital Library

Google Scholar

[5]

John Carroll and Diana McCarthy. 2000. Word sense disambiguation using automatically acquired verbal preferences. Computers and the Humanities. Senseval Special Issue, 34(1--2):109--114.

Google Scholar

[6]

Siobhan Devlin and John Tait. 1998. The use of a psycholinguistic database in the simplification of text for aphasic readers. In John Nerbonne, editor, Linguistic Databases, volume CSLI Lecture Notes Number 77, pages 161--173. CSLI Publications, Stanford CA.

Google Scholar

[7]

Adam Kilgarriff and Joseph Rosenzweig. 2000. Framework and results for english SENSEVAL. Computers and the Humanities. Senseval Special Issue, 34(1--2):15--48.

Google Scholar

[8]

Adam Kilgarriff. 1997. What is word sense disambiguation good for? In Proceedings of Natural Language Processing in the Pacific Rim, pages 209--214.

Google Scholar

[9]

Adam Kilgarriff. 1998. Gold standard datasets for evaluating word sense disambiguation programs. Computer Speech and Language, 12(3):453--472.

Crossref

Google Scholar

[10]

Philip Resnik and David Yarowsky. 2000. Distinguishing systems and distinguishing senses: New evaluation methods for word sense disambiguation. Natural Language Engineering, 5(3):113--133.

Digital Library

Google Scholar

[11]

Hinrich Schütze. 1998. Automatic word sense discrimination. Computational Linguistics, 24(1):97--123.

Digital Library

Google Scholar

Cited By

View all

Yu LLee LYeh JShih HLai Y(2016)Near-synonym substitution using a discriminative vector space modelKnowledge-Based Systems10.1016/j.knosys.2016.05.025106:C(74-84)Online publication date: 15-Aug-2016
https://dl.acm.org/doi/10.1016/j.knosys.2016.05.025
Yu LChien W(2013)Independent component analysis for near-synonym choiceDecision Support Systems10.1016/j.dss.2012.12.03855:1(146-155)Online publication date: 1-Apr-2013
https://dl.acm.org/doi/10.1016/j.dss.2012.12.038
Paukkeri MVäyrynen JArppe A(2012)Exploring extensive linguistic feature sets in near-synonym lexical choiceProceedings of the 13th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part II10.1007/978-3-642-28601-8_1(1-12)Online publication date: 11-Mar-2012
https://dl.acm.org/doi/10.1007/978-3-642-28601-8_1
Show More Cited By

Recommendations

COLEUR and COLSLM: A WSD approach to multilingual lexical substitution, tasks 2 and 3 SemEval 2010
SemEval '10: Proceedings of the 5th International Workshop on Semantic Evaluation

In this paper, we present a word sense disambiguation (WSD) based system for multilingual lexical substitution. Our method depends on having a WSD system for English and an automatic word alignment method. Crucially the approach relies on having ...
SemEval-2010 task: Japanese WSD
SemEval '10: Proceedings of the 5th International Workshop on Semantic Evaluation

An overview of the SemEval-2 Japanese WSD task is presented. It is a lexical sample task, and word senses are defined according to a Japanese dictionary, the Iwanami Kokugo Jiten. This dictionary and a training corpus were distributed to participants. ...
SemEval-2010 task 2: Cross-lingual lexical substitution
SemEval '10: Proceedings of the 5th International Workshop on Semantic Evaluation

In this paper we describe the SemEval-2010 Cross-Lingual Lexical Substitution task, where given an English target word in context, participating systems had to find an alternative substitute word or phrase in Spanish. The task is based on the English ...

Comments

Information & Contributors

Information

Published In

WSD '02: Proceedings of the ACL-02 workshop on Word sense disambiguation: recent successes and future directions - Volume 8

July 2002

123 pages

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 11 July 2002

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
455
Total Downloads

Downloads (Last 12 months)79
Downloads (Last 6 weeks)12

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yu LLee LYeh JShih HLai Y(2016)Near-synonym substitution using a discriminative vector space modelKnowledge-Based Systems10.1016/j.knosys.2016.05.025106:C(74-84)Online publication date: 15-Aug-2016
https://dl.acm.org/doi/10.1016/j.knosys.2016.05.025
Yu LChien W(2013)Independent component analysis for near-synonym choiceDecision Support Systems10.1016/j.dss.2012.12.03855:1(146-155)Online publication date: 1-Apr-2013
https://dl.acm.org/doi/10.1016/j.dss.2012.12.038
Paukkeri MVäyrynen JArppe A(2012)Exploring extensive linguistic feature sets in near-synonym lexical choiceProceedings of the 13th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part II10.1007/978-3-642-28601-8_1(1-12)Online publication date: 11-Mar-2012
https://dl.acm.org/doi/10.1007/978-3-642-28601-8_1
Yu LShih HLai YYeh JWu CJoshi AHuang CJurafsky D(2010)Discriminative training for near-synonym substitutionProceedings of the 23rd International Conference on Computational Linguistics10.5555/1873781.1873922(1254-1262)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1873781.1873922
Preiss JCoonce ABaker B(2009)HMMs, GRs, and n-grams as lexical substitution techniquesProceedings of the Workshop on Natural Language Processing Methods and Corpora in Translation, Lexicography, and Language Learning10.5555/1859657.1859661(21-27)Online publication date: 17-Sep-2009
https://dl.acm.org/doi/10.5555/1859657.1859661
Sinha RMcCarthy DMihalcea RAgirre EMarquez LWicentowski R(2009)SemEval-2010 task 2Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions10.5555/1621969.1621983(76-81)Online publication date: 4-Jun-2009
https://dl.acm.org/doi/10.5555/1621969.1621983
Giuliano CGliozzo AScott DUszkoreit H(2008)Instance-based ontology population exploiting named-entity substitutionProceedings of the 22nd International Conference on Computational Linguistics - Volume 110.5555/1599081.1599115(265-272)Online publication date: 18-Aug-2008
https://dl.acm.org/doi/10.5555/1599081.1599115
Hassan SCsomai ABanea CSinha RMihalcea RAgirre EMarquez LWicentowski R(2007)UNTProceedings of the 4th International Workshop on Semantic Evaluations10.5555/1621474.1621565(410-413)Online publication date: 23-Jun-2007
https://dl.acm.org/doi/10.5555/1621474.1621565
Liu PZhao TYang MAgirre EMarquez LWicentowski R(2007)HIT-WSDProceedings of the 4th International Workshop on Semantic Evaluations10.5555/1621474.1621509(169-172)Online publication date: 23-Jun-2007
https://dl.acm.org/doi/10.5555/1621474.1621509
McCarthy DNavigli RAgirre EMarquez LWicentowski R(2007)SemEval-2007 task 10Proceedings of the 4th International Workshop on Semantic Evaluations10.5555/1621474.1621483(48-53)Online publication date: 23-Jun-2007
https://dl.acm.org/doi/10.5555/1621474.1621483
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Recommendations

COLEUR and COLSLM: A WSD approach to multilingual lexical substitution, tasks 2 and 3 SemEval 2010

SemEval-2010 task: Japanese WSD

SemEval-2010 task 2: Cross-lingual lexical substitution

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations