Article

Free access

Summarizing text documents: sentence selection and evaluation metrics

Authors:

Jade Goldstein,

Mark Kantrowitz,

Vibhu Mittal,

Jaime CarbonellAuthors Info & Claims

SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval

Pages 121 - 128

https://doi.org/10.1145/312624.312665

Published: 01 August 1999 Publication History

PDF eReader

References

[1]

Proceedings of the A CL 'gV/EA CL '97 Workshop on Intelligent Scalable Text Summarization. Madrid, Spain, 1997.

Google Scholar

[2]

Aone, C., Okurowski, M. E., Gorlinsky, J., and Larsen, B. A scalable summarization system using robust NLP. {1}, pp. 66-73.

Google Scholar

[3]

Baldwin, B., and Morton, T. S. Dynamic coreferencebased summarization. In Proceedings of the Third Conference on Empirical Methods in Natural Language Processing (EMNLP-3) (Granada, Spain, June 1998).

Google Scholar

[4]

Banko, M., Mittal, V., Kantrowitz, M., and Goldstein, J. Generating extraction based summaries from handwritten summaries by aligning text spans. In Proceedings of PACLING-99 (to appear) (Waterloo, Ontario, July 1999).

Google Scholar

[5]

Barzilay, R., and Elhadad, M. Using lexical chains for text summarization. {1}, pp. 10-17.

Google Scholar

[6]

Boguraev, B., and Kennedy, C. Salience based content characterization of text documents. {1}, pp. 2-9.

Google Scholar

[7]

Buckley, C. Implementation of the SMART information retrieval system. Tech. Rep. TR 85-686, Cornell University, 1985.

Digital Library

Google Scholar

[8]

Carbonell, J. G., and Goldstein, J. The use of MMR, diversity-based reranking for reordering documents and producing summaries. In Proceedings of SIGIR-98 (Melbourne, Australia, Aug. 1998).

Digital Library

Google Scholar

[9]

Hovy, E., and Lin, C.-Y. Automated text summarization in SUMMARIST. {1}, pp. 18-24.

Digital Library

Google Scholar

[10]

Jing, H., Barzilay, R., McKeown, K., and Elhadad, M. Summarization evaluation methods experiments and analysis. In AAAI Intelligent Text Summarization Workshop (Stanford, CA, Mar. 1998), pp. 60-68.

Google Scholar

[11]

Jones, K. S., and Galliers, J. R. Evaluating Natural Language Processing Systems: an Analysis and Review. Springer, New York, 1996.

Digital Library

Google Scholar

[12]

Klavans, J. L., and Shaw, J. Lexical semantics in summarization. In Proceedings of the First Annual Workshop of the IFIP Working Group FOR NLP and KR (Nantes, France, Apr. 1995).

Google Scholar

[13]

Luhn, P. H. Automatic creation of literature abstracts. IBM Journal (1958), 159-165.

Digital Library

Google Scholar

[14]

Mani, I., House, D., Klain, G., Hirschman, L., Obrst, L., Firmin, T., Chrzanowski, M., and Sundheim, B. The tipster summac text summarization evaluation. Tech. Rep. MTR 98W0000138, Mitre, October 1998.

Google Scholar

[15]

Marcu, D. From discourse structures to text summaries. {1}, pp. 82-88.

Google Scholar

[16]

McKeown, K., Robin, J., and Kukich, K. Designing and evaluating a new revision-based model for summary generation. Info. Proc. and Management 31, 5 (1995).

Digital Library

Google Scholar

[17]

Mitra, M., Singhal, A., and Buckley, C. Automatic text summarization by paragraph extraction. {1}.

Google Scholar

[18]

Mittal, V. O., Kantrowitz, M., Goldstein, J., and Carbonell, J. Selecting Text Spans for Document Summaries: Heuristics and Metrics. In Proceedings of AAAI-99 (Orlando, FL, July 1999).

Digital Library

Google Scholar

[19]

Paice, C. D. Constructing literature abstracts by computer: Techniques and prospects. Info. Proc. and Management 26 (1990), 171-186.

Digital Library

Google Scholar

[20]

Radev, D., and McKeown, K. Generating natural language summaries from multiple online sources. Computational Linguistics 24, 3 (September 1998), 469-501.

Digital Library

Google Scholar

[21]

Salton, G., Allan, J., Buckley, C., and Singhal, A. Automatic analysis, theme generation, and summarization of machinereadable texts. Science 264 (1994), 1421-1426.

Crossref

Google Scholar

[22]

Salton, G., and Buckley, C. Improving retrieval performance by relevance feedback. Journal of American Society for Information Sciences 41 (1990), 288-297.

Crossref

Google Scholar

[23]

Salton, G., and McGill, M. J. Introduction to Modern Information Retrieval. McGraw-Hill Computer Science Series. McGraw-Hill, New York, 1983.

Digital Library

Google Scholar

[24]

Shaw, J. Conciseness through aggregation in text generation. In Proceedings of 33rd Association for Computational Linguistics (1995), pp. 329-331.

Digital Library

Google Scholar

[25]

Strzalkowski, T., Wang, J., and Wise, B. A robust practical text summarization system. In AAAI Intelligent Text Summarization Workshop (Stanford, CA, Mar. 1998), pp. 26-30.

Google Scholar

[26]

Tait, J. I. Automatic Summarizing of English Texts. PhD thesis, University of Cambridge, Cambridge, UK, 1983.

Google Scholar

[27]

Xu, J., and Croft, B. Query expansion using local and global document analysis. In Proceedings of the 19th A CM/SIGIR (SIGIR-96) (1996), ACM, pp. 4-11.

Digital Library

Google Scholar

Cited By

View all

Wang GWu W(2023)Surveying the landscape of text summarization with deep learning: A comprehensive reviewDiscrete Mathematics, Algorithms and Applications10.1142/S179383092330004716:03Online publication date: 20-Dec-2023
https://doi.org/10.1142/S1793830923300047
Sharma PSavarimuthu BStanger N(2023)How are decisions made in open source software communities? — Uncovering rationale from python email repositoriesJournal of Software: Evolution and Process10.1002/smr.2526Online publication date: 26-Jan-2023
https://doi.org/10.1002/smr.2526
Kanwal NRizzo GHong JBures MPark JCerny T(2022)Attention-based clinical note summarizationProceedings of the 37th ACM/SIGAPP Symposium on Applied Computing10.1145/3477314.3507256(813-820)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3477314.3507256
Show More Cited By

Index Terms

Summarizing text documents: sentence selection and evaluation metrics
1. Applied computing
  1. Document management and text processing
2. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Language resources

Recommendations

An Intelligent Information System for Organizing Online Text Documents

This paper describes an intelligent information system for effectively managing huge amounts of online text documents (such as Web documents) in a hierarchical manner. The organizational capabilities of this system are able to evolve semi-automatically ...
A classification-based summarisation model for summarising text documents

The work presents a CBS: classification-based summarisation model that performs automatic summarisation of the text through classification. Summarisation systems are the need of the hour, since information is overloaded in the web and extracting ...
Metric Learning for Text Documents

Many algorithms in machine learning rely on being given a good distance metric over the input space. Rather than using a default metric such as the Euclidean metric, it is desirable to obtain a metric based on the provided data. We consider the problem ...

Comments

Information & Contributors

Information

Published In

SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval

August 1999

339 pages

ISBN:1581130961

DOI:10.1145/312624

Chairmen:
Fredric Gey
Univ. of California
,
Marti Hearst
Univ. of California, Berkeley
,
Richard Tong
Tarragon Consulting Corp.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 1999

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGIR99

Sponsor:

SIGIR

SIGIR99: 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval

August 15 - 19, 1999

California, Berkeley, USA

Acceptance Rates

SIGIR '99 Paper Acceptance Rate 33 of 135 submissions, 24%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

273
Total Citations
View Citations
3,715
Total Downloads

Downloads (Last 12 months)507
Downloads (Last 6 weeks)35

Reflects downloads up to 18 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wang GWu W(2023)Surveying the landscape of text summarization with deep learning: A comprehensive reviewDiscrete Mathematics, Algorithms and Applications10.1142/S179383092330004716:03Online publication date: 20-Dec-2023
https://doi.org/10.1142/S1793830923300047
Sharma PSavarimuthu BStanger N(2023)How are decisions made in open source software communities? — Uncovering rationale from python email repositoriesJournal of Software: Evolution and Process10.1002/smr.2526Online publication date: 26-Jan-2023
https://doi.org/10.1002/smr.2526
Kanwal NRizzo GHong JBures MPark JCerny T(2022)Attention-based clinical note summarizationProceedings of the 37th ACM/SIGAPP Symposium on Applied Computing10.1145/3477314.3507256(813-820)Online publication date: 25-Apr-2022
https://dl.acm.org/doi/10.1145/3477314.3507256
Devrapalli DGuduri SMadhuri PReddy SPasupuleti P(2021)Effective Text Processing utilizing NLPIndian Journal of Artificial Intelligence and Neural Networking10.54105/ijainn.B3873.1221212:1(1-7)Online publication date: 30-Dec-2021
https://doi.org/10.54105/ijainn.B3873.122121
Xin YCao LWang XHe XFeng L(2021)Generating Instructive Questions from Multiple Articles to Guide Reading in E-BibliotherapySensors10.3390/s2109322321:9(3223)Online publication date: 6-May-2021
https://doi.org/10.3390/s21093223
Ribeiro VCavalin PMorais E(2021)A Dynamic Multi-criteria Multi-engine Approach for Text Simplification2021 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN52387.2021.9533365(1-8)Online publication date: 2021
https://doi.org/10.1109/IJCNN52387.2021.9533365
Sharma PSavarimuthu BStanger N(2021)Extracting Rationale for Open Source Software Development DecisionsProceedings of the 43rd International Conference on Software Engineering10.1109/ICSE43902.2021.00095(1008-1019)Online publication date: 22-May-2021
https://dl.acm.org/doi/10.1109/ICSE43902.2021.00095
Yin JZhu C(2021)Embedding Lexicon and direction information in Chinese NER2021 International Conference on Computer Information Science and Artificial Intelligence (CISAI)10.1109/CISAI54367.2021.00178(886-891)Online publication date: Sep-2021
https://doi.org/10.1109/CISAI54367.2021.00178
Novgorodov SGuy IElad GRadinsky K(2020)Descriptions from the CustomersACM Transactions on Internet Technology10.1145/341820220:4(1-31)Online publication date: 6-Oct-2020
https://dl.acm.org/doi/10.1145/3418202
Cui YZhu C(2020)Fine-Grained Chinese Named Entity Recognition with RoBERTa and Convolutional Attention Networks2020 IEEE 6th International Conference on Computer and Communications (ICCC)10.1109/ICCC51575.2020.9345307(2104-2109)Online publication date: 11-Dec-2020
https://doi.org/10.1109/ICCC51575.2020.9345307
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

An Intelligent Information System for Organizing Online Text Documents

A classification-based summarisation model for summarising text documents

Metric Learning for Text Documents