Article

Deriving time lines from texts

Authors:

Mathias Landhäußer,

Walter F. TichyAuthors Info & Claims

RAISE 2014: Proceedings of the 3rd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering

Pages 45 - 51

https://doi.org/10.1145/2593801.2593809

Published: 03 June 2014 Publication History

Abstract

We investigate natural language as an alternative to programming languages. Natural language would empower anyone to program with minimal training. In this paper, we solve an ordering problem that arises in natural-language programming. An emprical study showed that users do not always provide the strict sequential order of steps needed for execution on a computer. Instead, temporal expressions involving "before", "after", "while", "at the end", and others are used to indicate an order other than the textual one. We present an analysis that extracts the intended time line by exploiting temporal clues. The technique is analyzed in the context of Alice, a 3D programming environment, and AliceNLP, a system for programming Alice in ordinary English. Extracting temporal order could also be useful for analyzing reports, question answering, help desk requests, and big data applications.

References

[1]

B. W. Ballard and A. W. Biermann. Programming in natural language: NLC as a prototype. In Proceedings of the 1979 annual conference, ACM ’79, pages 228–237, New York, NY, USA, 1979. ACM.

Digital Library

[2]

M. J. Conway. Alice: Easy-to-Learn 3D Scripting for Novices. PhD thesis, Faculty of the School of Engineering and Applied Science, University of Virginia, Dec. 1997.

[3]

R. Knöll and M. Mezini. Pegasus: first steps toward a naturalistic programming language. In Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications, OOPSLA ’06, pages 542–559, New York, NY, USA, 2006. ACM.

Digital Library

[4]

H. Lieberman and H. Liu. Feasibility studies for programming in natural language. In H. Lieberman, F. Paternò, and V. Wulf, editors, End User Development, volume 9 of Human-Computer Interaction Series, pages 459–473. Springer Netherlands, 2006.

[5]

H. Liu and H. Lieberman. Metafor: visualizing stories as code. In Proceedings of the 10th international conference on Intelligent user interfaces, IUI ’05, pages 305–307, New York, NY, USA, 2005. ACM.

Digital Library

[6]

R. Mihalcea, H. Liu, and H. Lieberman. Nlp (natural language processing) for nlp (natural language programming). In A. Gelbukh, editor, Computational Linguistics and Intelligent Text Processing, volume 3878 of Lecture Notes in Computer Science, pages 319–330. Springer Berlin Heidelberg, 2006.

Digital Library

[7]

G. A. Miller. Wordnet: a lexical database for english. Commun. ACM, 38(11):39–41, Nov. 1995.

Digital Library

[8]

B. A. Myers. Natural programming: Project overview and proposal. Technical Report CMU-HCIL-98-100, Human-computer Interaction Institute, Carnegie Mellon University, Pittsburg, PA, USA, Jan. 1998.

[9]

H. J. Ohlbach. Computational treatment of temporal notions: The cttn-system. In F. Schilder, G. Katz, and J. Pustejovsky, editors, Annotating, Extracting and Reasoning about Time and Events, volume 4795 of Lecture Notes in Computer Science, pages 72–87. Springer Berlin Heidelberg, 2007.

Digital Library

[10]

J. F. Pane, B. A. Myers, and C. A. Ratanamahatana. Studying the language and structure in non-programmers’ solutions to programming problems. Int. J. Hum.-Comput. Stud., 54(2):237–264, Feb. 2001.

Digital Library

[11]

D. Price, E. Rilofff, J. Zachary, and B. Harvey. NaturalJava: a natural language interface for programming in Java. In Proceedings of the 5th international conference on Intelligent user interfaces, IUI ’00, pages 207–211, New York, NY, USA, 2000. ACM.

Digital Library

[12]

J. Pustejovsky, P. Hanks, R. Sauri, A. See, R. Gaizauskas, A. Setzer, D. Radev, B. Sundheim, D. Day, L. Ferro, and M. Lazo. The timebank corpus. In Proc. of Corpus Linguistics, pages 647–656, 2003.

[13]

J. Pustejovsky, B. Ingria, R. Sauri, J. Castano, J. Littman, R. Gaizauskas, A. Setzer, G. Katz, and I. Mani. The specification language timeml. The language of time: A reader, pages 545–557, 2005.

[14]

J. Pustejovsky, R. Knippen, J. Littman, and R. Sauri. Temporal and event information in natural language text. Language Resources and Evaluation, 39(2-3):123–164, 2005.

[15]

S. Russell and P. Norvig. The Artificial Intelligence. Prentice Hall Press, Upper Saddle River, NJ, USA, 3rd edition, 2010.

Digital Library

[16]

S. K. Sanampudi and G. V. Kumari. Temporal reasoning in natural language processing: A survey. International Journal of Computer Applications, 1(4):53–57, 2010.

[17]

F. Schilder. Event extraction and temporal reasoning in legal documents. In F. Schilder, G. Katz, and J. Pustejovsky, editors, Annotating, Extracting and Reasoning about Time and Events, volume 4795 of Lecture Notes in Computer Science, pages 59–71. Springer Berlin Heidelberg, 2007.

Digital Library

[18]

R. Socher, J. Bauer, C. D. Manning, and A. Y. Ng. Parsing with compositional vector grammars. In Proceedings of the ACL 2013, 2013.

Cited By

Pulido-Prieto OJuárez-Martínez U(2019)A Model for Naturalistic Programming with ImplementationApplied Sciences10.3390/app91839369:18(3936)Online publication date: 19-Sep-2019
https://doi.org/10.3390/app9183936
Pulido-Prieto OJuárez-Martínez U(2017)A Survey of Naturalistic Programming TechnologiesACM Computing Surveys10.1145/310948150:5(1-35)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3109481
Landhäuβer MWeigelt STichy W(2017)NLCIAutomated Software Engineering10.1007/s10515-016-0202-124:4(839-861)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s10515-016-0202-1
Show More Cited By

Index Terms

Deriving time lines from texts
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments

Recommendations

Text Understanding for Programming in Natural Language: Control Structures
RAISE '15: Proceedings of the 2015 IEEE/ACM 4th International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering

We investigate how natural languages such as English can be used as programming languages. Often, in natural language (as well as in programming) different actions happen at the same time or are repeated. In natural language we just say what is going to ...
Automatic transformation from TIDES to TimeML annotation

Until recently, most systems performing temporal extraction and reasoning from text have focused on recognizing and normalizing temporal expressions alone, for which the TIDES annotation scheme has been adopted. Temporal awareness of a text, however, ...
Combining automatic acquisition of knowledge with machine learning approaches for multilingual temporal recognition and normalization

This paper presents an improvement in the temporal expression (TE) recognition phase of a knowledge based system at a multilingual level. For this purpose, the combination of different approaches applied to the recognition of temporal expressions are ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

RAISE 2014: Proceedings of the 3rd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering

June 2014

58 pages

ISBN:9781450328463

DOI:10.1145/2593801

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICSE '14

Sponsor:

SIGSOFT

ICSE '14: 36th International Conference on Software Engineering

June 3, 2014

Hyderabad, India

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
163
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pulido-Prieto OJuárez-Martínez U(2019)A Model for Naturalistic Programming with ImplementationApplied Sciences10.3390/app91839369:18(3936)Online publication date: 19-Sep-2019
https://doi.org/10.3390/app9183936
Pulido-Prieto OJuárez-Martínez U(2017)A Survey of Naturalistic Programming TechnologiesACM Computing Surveys10.1145/310948150:5(1-35)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3109481
Landhäuβer MWeigelt STichy W(2017)NLCIAutomated Software Engineering10.1007/s10515-016-0202-124:4(839-861)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s10515-016-0202-1
Landhäußer MHug RHarrison RBener ATurhan B(2015)Text understanding for programming in natural languageProceedings of the Fourth International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering10.5555/2820668.2820671(7-12)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2820668.2820671
Weigelt STichy WBertolino ACanfora GElbaum S(2015)ProNatProceedings of the 37th International Conference on Software Engineering - Volume 210.5555/2819009.2819183(819-820)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2819009.2819183

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents