Article

Free access

University of Massachusetts: MUC-3 test results and analysis

Authors:

Robert WilliamsAuthors Info & Claims

MUC3 '91: Proceedings of the 3rd conference on Message understanding

Pages 116 - 119

https://doi.org/10.3115/1071958.1071978

Published: 21 May 1991 Publication History

PDF eReader

Abstract

We believe that the score reports we obtained for TST2 provide an accurate assessment of our system's capabilities insofar as they are consistent with the results of our own internal tests conducted near the end of phase 2. The required TST2 score reports indicate that our system achieved the highest combined scores for recall (51%) and precision (62%) as well as the highest recall score of all the MUC-3 systems under the official MATCHED/MISSING scoring profile.

Reference

[1]

Cardie, C., and Lehnert, W., "A cognitively plausible approach to understanding complex syntax," Proceedings of the Ninth National Conference on Artificial Intelligence. Anaheim, CA. 1991.

Google Scholar

Cited By

View all

Yankova MSaggion HCunningham HDuke AHepp MBontcheva KVilain M(2008)Adopting ontologies for multisource identity resolutionProceedings of the first international workshop on Ontology-supported business intelligence10.1145/1452567.1452573(1-10)Online publication date: 27-Oct-2008
https://dl.acm.org/doi/10.1145/1452567.1452573
Yankova MBoytcheva SCopestake AHajic J(2003)Focusing on scenario recognition in information extractionProceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 210.3115/1067737.1067744(41-48)Online publication date: 12-Apr-2003
https://dl.acm.org/doi/10.3115/1067737.1067744
Fisher DSoderland SFeng FLehnert W(1995)Description of the UMass system as used for MUC-6Proceedings of the 6th conference on Message understanding10.3115/1072399.1072412(127-140)Online publication date: 6-Nov-1995
https://dl.acm.org/doi/10.3115/1072399.1072412
Show More Cited By

University of Massachusetts: MUC-3 test results and analysis
1. Computing methodologies
  1. Artificial intelligence
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

University of Massachusetts: MUC-4 test results and analysis
MUC4 '92: Proceedings of the 4th conference on Message understanding

The UMass/MUC-4 system is based on a form of sentence analysis known as selective concept extraction. This approach to language processing is distinguished by a minimal reliance on syntactic sentence analysis, along with a minimal dictionary customized ...
Gauging the Quality of Relevance Assessments using Inter-Rater Agreement
SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

In recent years, gathering relevance judgments through non-topic originators has become an increasingly important problem in Information Retrieval. Relevance judgments can be used to measure the effectiveness of a system, and are often needed to build ...
Are Secondary Assessors Uncertain When They Disagree About Relevance Judgements?
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval

The collection of relevance judgements by assessors is important for many information retrieval (IR) tasks. In addition to the construction of test collections, relevance judging is critical to e-discovery and other applications where many assessors are ...

Comments

Information & Contributors

Information

Published In

MUC3 '91: Proceedings of the 3rd conference on Message understanding

May 1991

357 pages

ISBN:1558602364

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 21 May 1991

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
180
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)6

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yankova MSaggion HCunningham HDuke AHepp MBontcheva KVilain M(2008)Adopting ontologies for multisource identity resolutionProceedings of the first international workshop on Ontology-supported business intelligence10.1145/1452567.1452573(1-10)Online publication date: 27-Oct-2008
https://dl.acm.org/doi/10.1145/1452567.1452573
Yankova MBoytcheva SCopestake AHajic J(2003)Focusing on scenario recognition in information extractionProceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 210.3115/1067737.1067744(41-48)Online publication date: 12-Apr-2003
https://dl.acm.org/doi/10.3115/1067737.1067744
Fisher DSoderland SFeng FLehnert W(1995)Description of the UMass system as used for MUC-6Proceedings of the 6th conference on Message understanding10.3115/1072399.1072412(127-140)Online publication date: 6-Nov-1995
https://dl.acm.org/doi/10.3115/1072399.1072412
Riloff ELehnert W(1992)Classifying texts using relevancy signaturesProceedings of the workshop on Speech and Natural Language10.3115/1075527.1075576(224-229)Online publication date: 23-Feb-1992
https://dl.acm.org/doi/10.3115/1075527.1075576
Lehnert WCardie CFisher DMcCarthy JRiloff ESoderland S(1992)University of MassachusettsProceedings of the 4th conference on Message understanding10.3115/1072064.1072105(282-288)Online publication date: 16-Jun-1992
https://dl.acm.org/doi/10.3115/1072064.1072105

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

Reference

Cited By

Recommendations

University of Massachusetts: MUC-4 test results and analysis

Gauging the Quality of Relevance Assessments using Inter-Rater Agreement

Are Secondary Assessors Uncertain When They Disagree About Relevance Judgements?

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations