Article

Free access

Overview of results of the MUC-6 evaluation

Author:

Beth M. SundheimAuthors Info & Claims

MUC6 '95: Proceedings of the 6th conference on Message understanding

Pages 13 - 31

https://doi.org/10.3115/1072399.1072402

Published: 06 November 1995 Publication History

PDF eReader

Abstract

The latest in a series of natural language processing system evaluations was concluded in October 1995 and was the topic of the Sixth Message Understanding Conference (MUC-6) in November. Participants were invited to enter their systems in as many as four different task-oriented evaluations. The Named Entity and Coreference tasks entailed Standard Generalized Markup Language (SGML) annotation of texts and were being conducted for the first time. The other two tasks, Template Element and Scenario Template, were information extraction tasks that followed on from the MUC evaluations conducted in previous years. The evolution and design of the MUC-6 evaluation are discussed in the paper by Grishman and Sundheim in this volume. All except the Scenario Template task are defined independently of any particular domain.

Reference

[1]

Proceedings of the Fourth Message Understanding Conference (MUC-4), June 1992, San Mateo: Morgan Kaufmann.

Google Scholar

Cited By

View all

Yohannes HAmagasa T(2022)A method of named entity recognition for TigrinyaACM SIGAPP Applied Computing Review10.1145/3570733.357073722:3(56-68)Online publication date: 3-Nov-2022
https://dl.acm.org/doi/10.1145/3570733.3570737
Eiselen RBukula A(2022)IsiXhosa Named Entity Recognition ResourcesACM Transactions on Asian and Low-Resource Language Information Processing10.1145/353147822:2(1-19)Online publication date: 27-Dec-2022
https://dl.acm.org/doi/10.1145/3531478
Gabbard RDeyoung JLignos CFreedman MWeischedel R(2018)Combining rule-based and statistical mechanisms for low-resource named entity recognitionMachine Translation10.1007/s10590-017-9208-032:1-2(31-43)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s10590-017-9208-0
Show More Cited By

Recommendations

Statistical significance of MUC-6 results
MUC6 '95: Proceedings of the 6th conference on Message understanding

The results of the MUC-6 evaluation must be analyzed to determine whether close scores significantly distinguish systems or whether the differences in those scores are a matter of chance. In order to do such an analysis, a method of computer intensive ...
Design of the MUC-6 evaluation
MUC6 '95: Proceedings of the 6th conference on Message understanding

The sixth in a series of "Message Understanding Conferences", which are designed to promote and evaluate research in information extraction, was held last fall. MUC-6 introduced several innovations over prior MUCs, most notably in the range of different ...
Overview of results of the MUC-6 evaluation
TIPSTER '96: Proceedings of a workshop on held at Vienna, Virginia: May 6-8, 1996

The latest in a series of natural language processing system evaluations was concluded in October 1995 and was the topic of the Sixth Message Understanding Conference (MUC-6) in November. Participants were invited to enter their systems in as many as ...

Comments

Information & Contributors

Information

Published In

MUC6 '95: Proceedings of the 6th conference on Message understanding

November 1995

353 pages

ISBN:1558604022

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 06 November 1995

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
725
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)10

Reflects downloads up to 12 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yohannes HAmagasa T(2022)A method of named entity recognition for TigrinyaACM SIGAPP Applied Computing Review10.1145/3570733.357073722:3(56-68)Online publication date: 3-Nov-2022
https://dl.acm.org/doi/10.1145/3570733.3570737
Eiselen RBukula A(2022)IsiXhosa Named Entity Recognition ResourcesACM Transactions on Asian and Low-Resource Language Information Processing10.1145/353147822:2(1-19)Online publication date: 27-Dec-2022
https://dl.acm.org/doi/10.1145/3531478
Gabbard RDeyoung JLignos CFreedman MWeischedel R(2018)Combining rule-based and statistical mechanisms for low-resource named entity recognitionMachine Translation10.1007/s10590-017-9208-032:1-2(31-43)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s10590-017-9208-0
Stubbs AKotfila CUzuner Ö(2015)Automated systems for the de-identification of longitudinal clinical narrativesJournal of Biomedical Informatics10.1016/j.jbi.2015.06.00758:S(S11-S19)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1016/j.jbi.2015.06.007
Ikawa YVukovic MRogstadius JMurakami ASchwabe DAlmeida VGlaser HBaeza-Yates RMoon S(2013)Location-based insights from the social webProceedings of the 22nd International Conference on World Wide Web10.1145/2487788.2488107(1013-1016)Online publication date: 13-May-2013
https://dl.acm.org/doi/10.1145/2487788.2488107
Shrestha NVulić IMoens M(2013)An IR-Inspired Approach to Recovering Named Entity Tags in Broadcast NewsProceedings of the 6th Information Retrieval Facility Conference on Multidisciplinary Information Retrieval - Volume 820110.1007/978-3-642-41057-4_6(45-57)Online publication date: 7-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41057-4_6
Xu RXu JLiu JLiu CZou CGui LZheng YQu P(2012)Incorporating rule-based and statistic-based techniques for coreference resolutionJoint Conference on EMNLP and CoNLL - Shared Task10.5555/2391181.2391195(107-112)Online publication date: 13-Jul-2012
https://dl.acm.org/doi/10.5555/2391181.2391195
Zhou HLi YHuang DZhang YWu CYang YPradhan S(2011)Combining syntactic and semantic features by SVM for unrestricted coreference resolutionProceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task10.5555/2132936.2132946(66-70)Online publication date: 23-Jun-2011
https://dl.acm.org/doi/10.5555/2132936.2132946
Fort KEhrmann MNazarenko AStede MHuang C(2009)Towards a methodology for named entities annotationProceedings of the Third Linguistic Annotation Workshop10.5555/1698381.1698406(142-145)Online publication date: 6-Aug-2009
https://dl.acm.org/doi/10.5555/1698381.1698406
Pyysalo SOhta TKim JTsujii JCohen KDemner-Fushman DAnaniadou SPestian JTsujii JWebber B(2009)Static relationsProceedings of the Workshop on Current Trends in Biomedical Natural Language Processing10.5555/1572364.1572366(1-9)Online publication date: 4-Jun-2009
https://dl.acm.org/doi/10.5555/1572364.1572366
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Reference

Cited By

Recommendations

Statistical significance of MUC-6 results

Design of the MUC-6 evaluation