Article

Free access

Towards automatic classification of discourse elements in essays

Authors:

Slava Andreyev,

Martin ChodorowAuthors Info & Claims

ACL '01: Proceedings of the 39th Annual Meeting on Association for Computational Linguistics

Pages 98 - 105

https://doi.org/10.3115/1073012.1073026

Published: 06 July 2001 Publication History

Abstract

Educators are interested in essay evaluation systems that include feedback about writing features that can facilitate the essay revision process. For instance, if the thesis statement of a student's essay could be automatically identified, the student could then use this information to reflect on the thesis statement with regard to its quality, and its relationship to other discourse elements in the essay. Using a relatively small corpus of manually annotated data, we use Bayesian classification to identify thesis statements. This method yields results that are much closer to human performance than the results produced by two baseline systems.

References

[1]

Burstein, J., Kukich, K. Wolff, S. Lu, C. Chodorow, M, Braden-Harder, L. and Harris M. D. (1998). Automated Scoring Using A Hybrid Feature Identification Technique. Proceedings of ACL, 206--210.

Digital Library

[2]

Foltz, P. W., Kintsch, W., and Landauer, T. (1998). The Measurement of Textual Coherence with Latent Semantic Analysis. Discourse Processes, 25(2&3), 285--307.

[3]

Grosz B. and Sidner, C. (1986). Attention, Intention, and the Structure of Discourse. Computational Linguistics, 12 (3), 175--204.

Digital Library

[4]

Krippendorff K. (1980). Content Analysis: An Introduction to Its Methodology. Sage Publ.

[5]

Larkey, L. and Croft, W. B. (1996). Combining Classifiers in Text Categorization. Proceedings of SIGIR, 289--298.

Digital Library

[6]

Larkey, L. (1998). Automatic Essay Grading Using Text Categorization Techniques. Proceedings of SIGIR, pages 90--95.

Digital Library

[7]

Mani, I. and Maybury, M. (1999). Advances in Automatic Text Summarization. The MIT Press.

Digital Library

[8]

Mann, W. C. and Thompson, S. A.(1988). Rhetorical Structure Theory: Toward a Functional Theory of Text Organization. Text 8(3), 243--281.

[9]

Martin, J. (1992). English Text. System and Structure. John Benjamin Publishers.

[10]

Marcu, D. (2000). The Theory and Practice of Discourse Parsing and Summarization. The MIT Press.

Digital Library

[11]

McCallum, A. and Nigam, K. (1998). A Comparison of Event Models for Naive Bayes Text Classification. The AAAI-98 Workshop on "Learning for Text Categorization".

[12]

Page, E. B. and Peterson, N. (1995). The computer moves into essay grading: updating the ancient test. Phi Delta Kappa, March, 561--565.

[13]

Scardamalia, M. and Bereiter, C. (1985). Development of Dialectical Processes in Composition. In Olson, D. R., Torrance, N. and Hildyard, A. (eds), Literacy, Language, and Learning: The nature of consequences of reading and writing. Cambridge University Press.

[14]

Siegel S. and Castellan, N. J. (1988). Nonparametric Statistics for the Behavioral Sciences. McGraw-Hill.

[15]

Teufel, S. and Moens, M. (1999). Discourse-level argumentation in scientific articles. Proceedings of the ACL99 Workshop on Standards and Tools for Discourse Tagging.

Digital Library

[16]

White E. M. (1994). Teaching and Assessing Writing. Jossey-Bass Publishers, 103--108.

Cited By

Chaparro OLu JZampetti FMoreno LDi Penta MMarcus ABavota GNg VBodden ESchäfer WDeursen AZisman A(2017)Detecting missing information in bug descriptionsProceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering10.1145/3106237.3106285(396-407)Online publication date: 21-Aug-2017
https://dl.acm.org/doi/10.1145/3106237.3106285
Kwon NZhou LHovy EShulman SCushing JPardo T(2007)Identifying and classifying subjective claimsProceedings of the 8th annual international conference on Digital government research: bridging disciplines & domains10.5555/1248460.1248473(76-81)Online publication date: 20-May-2007
https://dl.acm.org/doi/10.5555/1248460.1248473
Whitelock D(2006)Electronic assessment: marking, monitoring and mediating learningInternational Journal of Learning Technology10.1504/IJLT.2006.0106202:2/3(264-276)Online publication date: 1-Aug-2006
https://dl.acm.org/doi/10.1504/IJLT.2006.010620
Show More Cited By

Towards automatic classification of discourse elements in essays
1. Computing methodologies
  1. Artificial intelligence
  2. Machine learning
    1. Learning paradigms
      1. Supervised learning
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Towards Discourse Meaning
Innovations for Requirement Analysis. From Stakeholders' Needs to Formal Designs

The overall goal is to discuss some issues concerning the dependencies at the discourse level and at the sentence level. However, first I will briefly describe the Penn Discourse Treebank (PDTB)*, a corpus in which we annotate the discourse connectives (...
Discourse ethics for computer ethics: a heuristic for engaged dialogical reflection

Attempts to employ discourse ethics for assessing communication and information technologies have tended to focus on managerial and policy-oriented contexts. These initiatives presuppose institutional resources for organizing sophisticated consultation ...
Towards automatic classification of wikipedia content
IDEAL'10: Proceedings of the 11th international conference on Intelligent data engineering and automated learning

Wikipedia - the Free Encyclopedia encounters the problem of proper classification of new articles everyday. The process of assignment of articles to categories is performed manually and it is a time consuming task. It requires knowledge about Wikipedia ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

ACL '01: Proceedings of the 39th Annual Meeting on Association for Computational Linguistics

July 2001

562 pages

General Chair:
Bonnie Lynn Webber

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 06 July 2001

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 85 of 443 submissions, 19%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
617
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)8

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chaparro OLu JZampetti FMoreno LDi Penta MMarcus ABavota GNg VBodden ESchäfer WDeursen AZisman A(2017)Detecting missing information in bug descriptionsProceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering10.1145/3106237.3106285(396-407)Online publication date: 21-Aug-2017
https://dl.acm.org/doi/10.1145/3106237.3106285
Kwon NZhou LHovy EShulman SCushing JPardo T(2007)Identifying and classifying subjective claimsProceedings of the 8th annual international conference on Digital government research: bridging disciplines & domains10.5555/1248460.1248473(76-81)Online publication date: 20-May-2007
https://dl.acm.org/doi/10.5555/1248460.1248473
Whitelock D(2006)Electronic assessment: marking, monitoring and mediating learningInternational Journal of Learning Technology10.1504/IJLT.2006.0106202:2/3(264-276)Online publication date: 1-Aug-2006
https://dl.acm.org/doi/10.1504/IJLT.2006.010620
Kwon NShulman SHovy EFortes JMacintosh A(2006)Multidimensional text analysis for eRulemakingProceedings of the 2006 international conference on Digital government research10.1145/1146598.1146649(157-166)Online publication date: 21-May-2006
https://dl.acm.org/doi/10.1145/1146598.1146649
Rosé CRoque ABhembe DVanlehn K(2003)A hybrid text classification approach for analysis of student essaysProceedings of the HLT-NAACL 03 workshop on Building educational applications using natural language processing - Volume 210.3115/1118894.1118904(68-75)Online publication date: 31-May-2003
https://dl.acm.org/doi/10.3115/1118894.1118904
Burstein JWolska MCopestake AHajic J(2003)Toward evaluation of writing styleProceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 110.3115/1067807.1067814(35-42)Online publication date: 12-Apr-2003
https://dl.acm.org/doi/10.3115/1067807.1067814
Burstein JMarcu DKnight K(2003)Finding the WRITE StuffIEEE Intelligent Systems10.1109/MIS.2003.117919118:1(32-39)Online publication date: 1-Jan-2003
https://dl.acm.org/doi/10.1109/MIS.2003.1179191
Carlson LMarcu DOkurowski M(2001)Building a discourse-tagged corpus in the framework of Rhetorical Structure TheoryProceedings of the Second SIGdial Workshop on Discourse and Dialogue - Volume 1610.3115/1118078.1118083(1-10)Online publication date: 1-Sep-2001
https://dl.acm.org/doi/10.3115/1118078.1118083

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents