Article

Free access

Supersense tagging of unknown nouns using semantic similarity

Author:

James R. CurranAuthors Info & Claims

ACL '05: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics

Pages 26 - 33

https://doi.org/10.3115/1219840.1219844

Published: 25 June 2005 Publication History

Abstract

The limited coverage of lexical-semantic resources is a significant problem for NLP systems which can be alleviated by automatically classifying the unknown words. Supersense tagging assigns unknown nouns one of 26 broad semantic categories used by lexicographers to organise their manual insertion into WORDNET. Ciaramita and Johnson (2003) present a tagger which uses synonym set glosses as annotated training examples. We describe an unsupervised approach, based on vector-space similarity, which does not require annotated examples but significantly outperforms their tagger. We also demonstrate the use of an extremely large shallow-parsed corpus for calculating vector-space semantic similarity.

References

[1]

L. Douglas Baker and Andrew McCallum. 1998. Distributional clustering of words for text classification. In Proceedings of the 21st annual international ACM SIGIR conference on Research and Development in Information Retrieval, pages 96--103, Melbourne, Australia.]]

Digital Library

[2]

Doug Beeferman. 1998. Lexical discovery with an enriched semantic network. In Proceedings of the Workshop on Usage of WordNet in Natural Language Processing Systems, pages 358--364, Montréal, Québec, Canada.]]

[3]

Thorsten Brants. 2000. TnT - a statistical part-of-speech tagger. In Proceedings of the 6th Applied Natural Language Processing Conference, pages 224--231, Seattle, WA USA.]]

Digital Library

[4]

Anita Burgun and Olivier Bodenreider. 2001. Comparing terms, concepts and semantic classes in WordNet and the Unified Medical Language System. In Proceedings of the Workshop on WordNet and Other Lexical Resources: Applications, Extensions and Customizations, pages 77--82, Pittsburgh, PA USA.]]

[5]

Sharon A. Caraballo and Eugene Charniak. 1999. Determining the specificity of nouns from text. In Proceedings of the Joint ACL SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 63--70, College Park, MD USA.]]

[6]

Massimiliano Ciaramita and Mark Johnson. 2003. Supersense tagging of unknown nouns in WordNet. In Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pages 168--175, Sapporo, Japan.]]

Digital Library

[7]

Massimiliano Ciaramita, Thomas Hofmann, and Mark Johnson. 2003. Hierarchical semantic classification: Word sense disambiguation with world knowledge. In Proceedings of the 18th International Joint Conference on Artificial Intelligence, Acapulco, Mexico.]]

[8]

Massimiliano Ciaramita. 2002. Boosting automatic lexical acquisition with morphological information. In Proceedings of the Workshop on Unsupervised Lexical Acquisition, pages 17--25, Philadelphia, PA, USA.]]

Digital Library

[9]

Stephen Clark and David Weir. 2002. Class-based probability estimation using a semantic hierarchy. Computational Linguistics, 28(2):187--206, June.]]

Digital Library

[10]

Koby Crammer and Yoram Singer. 2001. Ultraconservative online algorithms for multiclass problems. In Proceedings of the 14th annual Conference on Computational Learning Theory and 5th European Conference on Computational Learning Theory, pages 99--115, Amsterdam, The Netherlands.]]

Digital Library

[11]

James R. Curran and Stephen Clark. 2003. Investigating GIS and smoothing for maximum entropy taggers. In Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics, pages 91--98, Budapest, Hungary.]]

Digital Library

[12]

James R. Curran and Marc Moens. 2002a. Improvements in automatic thesaurus extraction. In Proceedings of the Workshop on Unsupervised Lexical Acquisition, pages 59--66, Philadelphia, PA, USA.]]

Digital Library

[13]

James R. Curran and Marc Moens. 2002b. Scaling context space. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics, pages 231--238, Philadelphia, PA, USA.]]

Digital Library

[14]

Christiane Fellbaum, editor. 1998. WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA USA.]]

[15]

Gregory Grefenstette. 1994. Explorations in Automatic Thesaurus Discovery. Kluwer Academic Publishers, Boston, MA USA.]]

Digital Library

[16]

Marti A. Hearst and Hinrich Schütze. 1993. Customizing a lexicon to better suit a computational task. In Proceedings of the Workshop on Acquisition of Lexical Knowledge from Text, pages 55--69, Columbus, OH USA.]]

[17]

Rob Koeling. 2000. Chunking with maximum entropy models. In Proceedings of the 4th Conference on Computational Natural Language Learning and of the 2nd Learning Language in Logic Workshop, pages 139--141, Lisbon, Portugal.]]

Digital Library

[18]

Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1994. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313--330.]]

Digital Library

[19]

Guido Minnen, John Carroll, and Darren Pearce. 2001. Applied morphological processing of English. Natural Language Engineering, 7(3):207--223.]]

Digital Library

[20]

Tom Morton. 2002. Grok tokenizer. Grok OpenNLP toolkit.]]

[21]

Marius Pasca and Sanda M. Harabagiu. 2001. The informative role of WordNet in open-domain question answering. In Proceedings of the Workshop on WordNet and Other Lexical Resources: Applications, Extensions and Customizations, pages 138--143, Pittsburgh, PA USA.]]

[22]

Darren Pearce. 2001. Synonymy in collocation extraction. In Proceedings of the Workshop on WordNet and Other Lexical Resources: Applications, Extensions and Customizations, pages 41--46, Pittsburgh, PA USA.]]

[23]

Philip Resnik. 1995. Using information content to evaluate semantic similarity. In Proceedings of the 14th International Joint Conference on Artificial Intelligence, pages 448--453, Montreal, Canada.]]

Digital Library

[24]

Jeffrey C. Reynar and Adwait Ratnaparkhi. 1997. A maximum entropy approach to identifying sentence boundaries. In Proceedings of the Fifth Conference on Applied Natural Language Processing, pages 16--19, Washington, D.C. USA.]]

Digital Library

[25]

Hinrich Schütze. 1992. Context space. In Intelligent Probabilistic Approaches to Natural Language, number FS-92-04 in Fall Symposium Series, pages 113--120, Stanford University, CA USA.]]

[26]

Dominic Widdows. 2003. Unsupervised methods for developing taxonomies by combining syntactic and statistical information. In Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pages 276--283, Edmonton, Alberta Canada.]]

Digital Library

[27]

David Yarowsky. 1992. Word-sense disambiguation using statistical models of Roget's categories trained on large corpora. In Proceedings of the 14th international conference on Computational Linguistics, pages 454--460, Nantes, France.]]

Digital Library

Cited By

Chen WZhang MZhang Y(2015)Distributed feature representations for dependency parsingIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2014.236535923:3(451-460)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1109/TASLP.2014.2365359
Chan SChong M(2013)Predicting part-of-speech tags and morpho-syntactic relations using similarity-based techniqueProceedings of the First international conference on Statistical Language and Speech Processing10.1007/978-3-642-39593-2_6(71-82)Online publication date: 29-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39593-2_6
Basile PCaputo ASemeraro G(2013)Supervised Learning and Distributional Semantic Models for Super-Sense TaggingProceeding of the XIIIth International Conference on AI*IA 2013: Advances in Artificial Intelligence - Volume 824910.1007/978-3-319-03524-6_9(97-108)Online publication date: 4-Dec-2013
https://dl.acm.org/doi/10.1007/978-3-319-03524-6_9
Show More Cited By

Supersense tagging of unknown nouns using semantic similarity
1. Computing methodologies
  1. Artificial intelligence
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Supersense tagging of unknown nouns in WordNet
EMNLP '03: Proceedings of the 2003 conference on Empirical methods in natural language processing

We present a new framework for classifying common nouns that extends named-entity classification. We used a fixed set of 26 semantic labels, which we called supersenses. These are the labels used by lexicographers developing WordNet. This framework has ...
Semantic similarity measure of polish nouns based on linguistic features
BIS'07: Proceedings of the 10th international conference on Business information systems

A word-to-word similarity function automatically extracted from a corpus of texts can be a very helpful tool in automatic extraction of lexical semantic relations. There are many approaches for English, but only a few for inflective languages with ...
Bridging languages by SuperSense entity tagging
NEWS '09: Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration

This paper explores a very basic linguistic phenomenon in multilingualism: the lexicalizations of entities are very often identical within different languages while concepts are usually lexicalized differently. Since entities are commonly referred to by ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '05: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics

June 2005

657 pages

General Chair:
Kevin Knight
University of Southern California

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 25 June 2005

Qualifiers

Article

Acceptance Rates

ACL '05 Paper Acceptance Rate 77 of 423 submissions, 18%;

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
491
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)8

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen WZhang MZhang Y(2015)Distributed feature representations for dependency parsingIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2014.236535923:3(451-460)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1109/TASLP.2014.2365359
Chan SChong M(2013)Predicting part-of-speech tags and morpho-syntactic relations using similarity-based techniqueProceedings of the First international conference on Statistical Language and Speech Processing10.1007/978-3-642-39593-2_6(71-82)Online publication date: 29-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39593-2_6
Basile PCaputo ASemeraro G(2013)Supervised Learning and Distributional Semantic Models for Super-Sense TaggingProceeding of the XIIIth International Conference on AI*IA 2013: Advances in Artificial Intelligence - Volume 824910.1007/978-3-319-03524-6_9(97-108)Online publication date: 4-Dec-2013
https://dl.acm.org/doi/10.1007/978-3-319-03524-6_9
Schneider NMohit BOflazer KSmith NLi HLin COsborne M(2012)Coarse lexical semantic annotation with supersensesProceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 210.5555/2390665.2390726(253-258)Online publication date: 8-Jul-2012
https://dl.acm.org/doi/10.5555/2390665.2390726
Boleda GPadó SUtt JAgirre E(2012)Regular polysemyProceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation10.5555/2387636.2387663(151-160)Online publication date: 7-Jun-2012
https://dl.acm.org/doi/10.5555/2387636.2387663
Hermann KBlunsom PDyer CPulman SAgirre E(2012)Learning semantics and selectional preference of adjective-noun pairsProceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation10.5555/2387636.2387649(70-74)Online publication date: 7-Jun-2012
https://dl.acm.org/doi/10.5555/2387636.2387649
Qiu LWu YShao Y(2011)Combining contextual and structural information for supersense tagging of chinese unknown wordsProceedings of the 12th international conference on Computational linguistics and intelligent text processing - Volume Part I10.5555/1964799.1964802(15-28)Online publication date: 20-Feb-2011
https://dl.acm.org/doi/10.5555/1964799.1964802
Qiu LWu YShi JShao YLong Z(2011)Induction of Semantic Classes Based on Coordinate PatternsProceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 0310.1109/WI-IAT.2011.66(201-204)Online publication date: 22-Aug-2011
https://dl.acm.org/doi/10.1109/WI-IAT.2011.66
Murawaki YKurohashi SJoshi AHuang CJurafsky D(2010)Semantic classification of automatically acquired nouns using lexico-syntactic cluesProceedings of the 23rd International Conference on Computational Linguistics: Posters10.5555/1944566.1944667(876-884)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1944566.1944667
Izquierdo RSuárez ARigau GErk KStrapparava C(2010)GPLSI-IXA: Using semantic classes to acquire monosemous training examples from domain textsProceedings of the 5th International Workshop on Semantic Evaluation10.5555/1859664.1859754(402-406)Online publication date: 15-Jul-2010
https://dl.acm.org/doi/10.5555/1859664.1859754
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents