research-article

Free access

SemEval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals

Authors:

Diarmuid Ó. Séaghdha,

Sebastian Padó,

Marco Pennacchiotti,

Lorenza Romano,

Stan SzpakowiczAuthors Info & Claims

SemEval '10: Proceedings of the 5th International Workshop on Semantic Evaluation

Pages 33 - 38

Published: 15 July 2010 Publication History

PDF eReader

Abstract

SemEval-2 Task 8 focuses on Multi-way classification of semantic relations between pairs of nominals. The task was designed to compare different approaches to semantic relation classification and to provide a standard testbed for future research. This paper defines the task, describes the training and test data and the process of their creation, lists the participating systems (10 teams, 28 runs), and discusses their results.

References

[1]

}}X. Carreras and L. Màrquez. 2004. Introduction to the CoNLL-2004 shared task: Semantic role labeling. In Proc. CoNLL-04, Boston, MA.

Digital Library

Google Scholar

[2]

}}I. Dagan, B. Dolan, B. Magnini, and D. Roth. 2009. Recognizing textual entailment: Rational, evaluation and approaches. Natural Language Engineering, 15(4):i--xvii.

Google Scholar

[3]

}}R. Girju, P. Nakov, V. Nastase, S. Szpakowicz, P. Turney, and D. Yuret. 2009. Classification of semantic relations between nominals. Language Resources and Evaluation, 43(2):105--121.

Crossref

Google Scholar

[4]

}}I. Hendrickx, S. Kim, Z. Kozareva, P. Nakov, D. Ó Séaghdha, S. Padó, M. Pennacchiotti, L. Romano, and S. Szpakowicz. 2009. SemEval-2010 Task 8: Multi-way classification of semantic relations between pairs of nominals. In Proc. NAACL Workshop on Semantic Evaluations, Boulder, CO.

Digital Library

Google Scholar

[5]

}}J. Kim, T. Ohta, S. Pyysalo, Y. Kano, and J. Tsujii. 2009. Overview of BioNLP'09 shared task on event extraction. In Proc. BioNLP-09, Boulder, CO.

Digital Library

Google Scholar

Cited By

View all

Chen HGuo HChen BZhou XChua TNgo CKa-Wei Lee RKumar RLauw H(2024)OODREB: Benchmarking State-of-the-Art Methods for Out-Of-Distribution Generalization on Relation ExtractionProceedings of the ACM Web Conference 202410.1145/3589334.3645695(2294-2303)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645695
Cui SCao JCong XSheng JLi QLiu TShi J(2024)Enhancing Multimodal Entity and Relation Extraction With Variational Information BottleneckIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2023.334514632(1274-1285)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TASLP.2023.3345146
Nie AZhang YAmdekar APiech CHashimoto TGerstenberg TOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)MoCaProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3669548(78360-78393)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3669548
Show More Cited By

Index Terms

SemEval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals
1. Applied computing
  1. Document management and text processing
2. Computing methodologies
  1. Artificial intelligence
    1. Knowledge representation and reasoning
      1. Semantic networks
    2. Natural language processing
      1. Language resources

Recommendations

SemEval-2010 task 8: multi-way classification of semantic relations between pairs of nominals
SEW '09: Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions

We present a brief overview of the main challenges in the extraction of semantic relations from English text, and discuss the shortcomings of previous data sets and shared tasks. This leads us to introduce a new task, which will be part of SemEval-2010: ...
SemEval-2010 task 3: cross-lingual word sense disambiguation
SEW '09: Proceedings of the Workshop on Semantic Evaluations: Recent Achievements and Future Directions

We propose a multilingual unsupervised Word Sense Disambiguation (WSD) task for a sample of English nouns. Instead of providing manually sensetagged examples for each sense of a polysemous noun, our sense inventory is built up on the basis of the ...
SemEval-2010 task: Japanese WSD
SemEval '10: Proceedings of the 5th International Workshop on Semantic Evaluation

An overview of the SemEval-2 Japanese WSD task is presented. It is a lexical sample task, and word senses are defined according to a Japanese dictionary, the Iwanami Kokugo Jiten. This dictionary and a training corpus were distributed to participants. ...

Comments

Information & Contributors

Information

Published In

SemEval '10: Proceedings of the 5th International Workshop on Semantic Evaluation

July 2010

473 pages

Program Chairs:
Katrin Erk
University of Texas at Austin
,
Carlo Strapparava
ITC IRST

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 15 July 2010

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 8 of 31 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
307
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)10

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chen HGuo HChen BZhou XChua TNgo CKa-Wei Lee RKumar RLauw H(2024)OODREB: Benchmarking State-of-the-Art Methods for Out-Of-Distribution Generalization on Relation ExtractionProceedings of the ACM Web Conference 202410.1145/3589334.3645695(2294-2303)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645695
Cui SCao JCong XSheng JLi QLiu TShi J(2024)Enhancing Multimodal Entity and Relation Extraction With Variational Information BottleneckIEEE/ACM Transactions on Audio, Speech and Language Processing10.1109/TASLP.2023.334514632(1274-1285)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TASLP.2023.3345146
Nie AZhang YAmdekar APiech CHashimoto TGerstenberg TOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)MoCaProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3669548(78360-78393)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3669548
Jin ZChen YLeeb FGresele LKamal OLyu ZBlin KGonzalez FKleiman-Weiner MSachan MSchölkopf BOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)CLADDERProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667475(31038-31065)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3667475
Ghosh SUmrao SChen CNaskar S(2023)The Mask One At a Time Framework for Detecting the Relationship between Financial EntitiesProceedings of the 15th Annual Meeting of the Forum for Information Retrieval Evaluation10.1145/3632754.3632756(40-43)Online publication date: 15-Dec-2023
https://dl.acm.org/doi/10.1145/3632754.3632756
Zhang FZhang MLiu SSun YDuan N(2023)Enhancing RDF Verbalization with Descriptive and Relational KnowledgeACM Transactions on Asian and Low-Resource Language Information Processing10.1145/359529322:6(1-18)Online publication date: 16-Jun-2023
https://dl.acm.org/doi/10.1145/3595293
Zhang RYu YShen JCui XZhang CSingh ASun YAkoglu LGunopulos DYan XKumar ROzcan FYe J(2023)Local Boosting for Weakly-Supervised LearningProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599417(3364-3375)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3580305.3599417
Nag ASamanta BMukherjee AGanguly NChakrabarti S(2023)Transfer Learning for Low-Resource Multilingual Relation ClassificationACM Transactions on Asian and Low-Resource Language Information Processing10.1145/355473422:2(1-24)Online publication date: 23-Mar-2023
https://dl.acm.org/doi/10.1145/3554734
Zhang MQian TZhang TMiao X(2023)Towards Model Robustness: Generating Contextual Counterfactuals for Entities in Relation ExtractionProceedings of the ACM Web Conference 202310.1145/3543507.3583504(1832-1842)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583504
Yu TYang MLi CXu RChen HDuh WHuang HKato MMothe JPoblete B(2023)Reducing Spurious Correlations for Relation Extraction by Feature Decomposition and Semantic AugmentationProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3592050(2324-2328)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3592050
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations