Article

Free access

Probabilistic text structuring: experiments with sentence ordering

Author:

Mirella LapataAuthors Info & Claims

ACL '03: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1

Pages 545 - 552

https://doi.org/10.3115/1075096.1075165

Published: 07 July 2003 Publication History

Abstract

Ordering information is a critical task for natural language generation applications. In this paper we propose an approach to information ordering that is particularly suited for text-to-text generation. We describe a model that learns constraints on sentence order from a corpus of domain-specific texts and an algorithm that yields the most likely order among several alternatives. We evaluate the automatically generated orderings against authored texts from our corpus and against human subjects that are asked to mimic the model's task. We also assess the appropriateness of such a model for multidocument summarization.

References

[1]

Asher, Nicholas and Alex Lascarides. 2003. Logics of Conversation. Cambridge University Press.

[2]

Barzilay, Regina. 2003. Information Fusion for Multi-Document Summarization: Praphrasing and Generation. Ph.D. thesis, Columbia University.

Digital Library

[3]

Barzilay, Regina, Noemie Elhadad, and Kathleen R. McKeown. 2002. Inferring strategies for sentence ordering in multidocument news summarization. Journal of Artificial Intelligence Research 17:35--55.

Digital Library

[4]

Charniak, Eugene. 2000. A maximum-entropy-inspired parser. In Proceedings of the 1st Conference of the North American Chapter of the Association for Computational Linguistics. Seattle, WA, pages 132--139.

Digital Library

[5]

Cohen, William W., Robert E. Schapire, and Yoram Singer. 1999. Learning to order things. Journal of Artificial Intelligence Research 10:243--270.

[6]

Grosz, Barbara, Aravind Joshi, and Scott Weinstein. 1995. Centering: A framework for modeling the local coherence of discourse. Computational Linguistics 21(2):203--225.

Digital Library

[7]

Katz, Slava M. 1987. Estimation of probabilities from sparse data for the language model component of a speech recognizer. IEEE Transactions on Acoustics Speech and Signal Processing 33(3):400--401.

[8]

Kibble, Rodger and Richard Power. 2000. An integrated frame-work for text planning and pronominalisation. In In Proceedings of the 1st International Conference on Natural Language Generation. Mitzpe Ramon, Israel, pages 77--84.

Digital Library

[9]

Lebanon, Guy and John Lafferty. 2002. Combining rankings using conditional probability models on permutations. In C. Sammut and A. Hoffmann, editors, In Proceedings of the 19th International Conference on Machine Learning. Morgan Kaufmann Publishers, San Francisco, CA.

Digital Library

[10]

Lin, Dekang. 1998. Dependency-based evaluation of MINIPAR. In In Proceedings on of the LREC Workshop on the Evaluation of Parsing Systems. Granada, pages 48--56.

[11]

Marcu, Daniel. 1997. From local to global coherence: A bottom-up approach to text planning. In In Proceedings of the 14th National Conference on Artificial Intelligence. Providence, Rhode Island, pages 629--635.

Digital Library

[12]

Marcus, Mitchell P., Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of english: The penn treebank. Computational Linguistics 19(2):313--330.

Digital Library

[13]

McKeown, Kathleen R., Judith L. Klavans, Vasileios Hatzivas-siloglou, Regina Barzilay, and Eleazar Eskin. 1999. Towards multidocument summarization by reformulation: Progress and prospects. In Proceedings of the 16th National Conference on Artificial Intelligence. Orlando, FL, pages 453--459.

Digital Library

[14]

Mellish, Chris, Alistair Knott, Jon Oberlander, and Mick O' Donnell. 1998. Experiments using stochastic search for text planning. In In Proceedings of the 9th International Workshop on Natural Language Generation. Ontario, Canada, pages 98--107.

[15]

Reiter, Ehud and Robert Dale. 2000. Building Natural Language Generation Systems. Cambridge University Press, Cambridge.

Digital Library

[16]

Sampson, Geoffrey. 1996. English for the Computer. Oxford University Press.

Cited By

Bai GHe SLiu KZhao J(2023)Bidirectional Sentence Ordering with Interactive DecodingACM Transactions on Asian and Low-Resource Language Information Processing10.1145/356151022:2(1-15)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1145/3561510
Putra JTeufel STokunaga T(2023)Improving logical flow in English-as-a-foreign-language learner essays by reordering sentencesArtificial Intelligence10.1016/j.artint.2023.103935320:COnline publication date: 5-Jun-2023
https://dl.acm.org/doi/10.1016/j.artint.2023.103935
Yin YLai SSong LZhou CHan XYao JSu J(2021)An External Knowledge Enhanced Graph-based Neural Network for Sentence OrderingJournal of Artificial Intelligence Research10.1613/jair.1.1207870(545-566)Online publication date: 1-May-2021
https://dl.acm.org/doi/10.1613/jair.1.12078
Show More Cited By

Probabilistic text structuring: experiments with sentence ordering
1. Computing methodologies
  1. Artificial intelligence
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Topic-based Amharic text summarization with probabilistic latent semantic analysis
MEDES '12: Proceedings of the International Conference on Management of Emergent Digital EcoSystems

This paper investigates the problem of building a concept-based single-document Amharic text summarization system. Because local languages like Amharic lack extensive linguistic resources, we propose to use statistical approaches called topic modeling ...
Probabilistic text modeling with orthogonalized topics
SIGIR '14: Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval

Topic models have been widely used for text analysis. Previous topic models have enjoyed great success in mining the latent topic structure of text documents. With many efforts made on endowing the resulting document-topic distributions with different ...
Probabilistic Topic Models for Text Data Retrieval and Analysis
SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

Text data include all kinds of natural language text such as web pages, news articles, scientific literature, emails, enterprise documents, and social media posts. As text data continues to grow quickly, it is increasingly important to develop ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '03: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1

July 2003

571 pages

Program Chairs:
Erhard W. Hinrichs,
Dan Roth

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 07 July 2003

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

73
Total Citations
View Citations
717
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)9

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bai GHe SLiu KZhao J(2023)Bidirectional Sentence Ordering with Interactive DecodingACM Transactions on Asian and Low-Resource Language Information Processing10.1145/356151022:2(1-15)Online publication date: 30-Mar-2023
https://dl.acm.org/doi/10.1145/3561510
Putra JTeufel STokunaga T(2023)Improving logical flow in English-as-a-foreign-language learner essays by reordering sentencesArtificial Intelligence10.1016/j.artint.2023.103935320:COnline publication date: 5-Jun-2023
https://dl.acm.org/doi/10.1016/j.artint.2023.103935
Yin YLai SSong LZhou CHan XYao JSu J(2021)An External Knowledge Enhanced Graph-based Neural Network for Sentence OrderingJournal of Artificial Intelligence Research10.1613/jair.1.1207870(545-566)Online publication date: 1-May-2021
https://dl.acm.org/doi/10.1613/jair.1.12078
Calizzano ROstendorff MRehm GHealy PBilauca MBonnici A(2021)Ordering sentences and paragraphs with pre-trained encoder-decoder transformers and pointer ensemblesProceedings of the 21st ACM Symposium on Document Engineering10.1145/3469096.3469874(1-9)Online publication date: 16-Aug-2021
https://dl.acm.org/doi/10.1145/3469096.3469874
Lin WHuang HChen HGurrin CÞór Jónsson BKando NSchoeffmann KChen PO'Connor N(2020)Visual Story Ordering with a Bidirectional WriterProceedings of the 2020 International Conference on Multimedia Retrieval10.1145/3372278.3390735(326-330)Online publication date: 8-Jun-2020
https://dl.acm.org/doi/10.1145/3372278.3390735
Wang TWan X(2019)Hierarchical attention networks for sentence orderingProceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v33i01.33017184(7184-8191)Online publication date: 27-Jan-2019
https://dl.acm.org/doi/10.1609/aaai.v33i01.33017184
Wang JZhang HZhang CYang WShao LWang JBorghoff USchimmler S(2019)An Effective Scheme for Generating An Overview Report over A Very Large Corpus of DocumentsProceedings of the ACM Symposium on Document Engineering 201910.1145/3342558.3345394(1-11)Online publication date: 23-Sep-2019
https://dl.acm.org/doi/10.1145/3342558.3345394
Logeswaran LLee HRadev DMcIlraith SWeinberger K(2018)Sentence ordering and coherence modeling using recurrent neural networksProceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence10.5555/3504035.3504683(5285-8592)Online publication date: 2-Feb-2018
https://dl.acm.org/doi/10.5555/3504035.3504683
Ren PChen ZRen ZWei FNie LMa Jde Rijke M(2018)Sentence Relations for Extractive Summarization with Deep Neural NetworksACM Transactions on Information Systems10.1145/320086436:4(1-32)Online publication date: 30-Apr-2018
https://dl.acm.org/doi/10.1145/3200864
Ermakova LMothe JFirsov AKando NSakai TJoho HLi Hde Vries AWhite R(2017)A Metric for Sentence Ordering Assessment Based on Topic-Comment StructureProceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3077136.3080720(1061-1064)Online publication date: 7-Aug-2017
https://dl.acm.org/doi/10.1145/3077136.3080720
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents