Article

An intelligent discussion-bot for answering student queries in threaded discussions

Authors:

Eduard HovyAuthors Info & Claims

IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces

Pages 171 - 177

https://doi.org/10.1145/1111449.1111488

Published: 29 January 2006 Publication History

Abstract

This paper describes a discussion-bot that provides answers to students' discussion board questions in an unobtrusive and human-like way. Using information retrieval and natural language processing techniques, the discussion-bot identifies the questioner's interest, mines suitable answers from an annotated corpus of 1236 archived threaded discussions and 279 course documents and chooses an appropriate response. A novel modeling approach was designed for the analysis of archived threaded discussions to facilitate answer extraction. We compare a self-out and an all-in evaluation of the mined answers. The results show that the discussion-bot can begin to meet students' learning requests. We discuss directions that might be taken to increase the effectiveness of the question matching and answer extraction algorithms. The research takes place in the context of an undergraduate computer science course.

References

[1]

ALICE. Http://www.alicebot.org/.

[2]

Buckingham Shum, S., MacLean, A., Bellotti, V. M. E., and Hammond, N. V. 1997. Graphical argumentation and design cognition. Human-Computer Interaction, 12(3), 1997, 267--300.

Digital Library

[3]

Buckingham Shum, S. 2000. Workshop report: computer-supported collaborative argumentation for learning communities, SIGWEB Newsl. 2000. ACM Press, New York, NY, 27--30.

Digital Library

[4]

Cakir, M., Xhafa, F., Zhou, N., and Stahl, G. Thread-based analysis of patterns of collaborative interaction in chat, AIED 2005.

Digital Library

[5]

Carr, C. S. 2001. Computer-Supported Collaborative Argumentation: Supporting Problem-based Learning in Legal Education. Proceedings of Euro-CSCL 2001.

[6]

Hearst, M. A. Multi-paragraph segmentation of expository text. Proceedings of the 32th Annual Meeting of the Association for Computational Linguistics(ACL-94), 9--16, Las Cruces, New Mexico, 1994.

Digital Library

[7]

Hermjakob, U., Hovy, E. H., and Lin, C. 2000. Knowledge-based question answering. TREC-2000.

[8]

Hovy, E.H., Gerber, L., Hermjakob, U., Junk, M., and Lin, C. 2000. Question answering in Webclopedia. Proceedings of TREC-2000.

[9]

Isbister, K. Nakanishi, H., Ishida, T., Nass, C. (2000) Helper agent: Designing an assistant for human-human interaction in a virtual meeting space. Proceeding of CHI'2000, pp. 57--64.

Digital Library

[10]

Marom, Y. and Zukerman, I. 2005. Corpus-based Generation of Easy Help-desk Responses. Technical Report, School of Computer Science and Software Engineering, Monash University. Available at: http://www.csse.monash. edu.au/publications/2005/tr-2005-166-full.pdf.

[11]

Moldovan, D., Harabagiu, S., Pasca, M., Mihalcea, R., Girju, R., Goodrum, R., and Rus, V. 2000. The structure and performance of an open-domain question answering system. Proceedings of ACL-2000.

Digital Library

[12]

Nakanishi, H., Isbister, K., Ishida, T. and Nass, C. Designing a Social Agent for Virtual Meeting Space. Robert Trappl and Sabine Payr Ed., Agent Culture: Designing Virtual Characters for a Multi-cultural World, Lawrence Erlbaum Associates, pp. 245--266, 2004.

[13]

Nguyen, A. and Wobcke, W. 2005. An Agent-Based Approach to Dialogue Management in Personal Assistants. Proceedings of the 2005 International Conference on Intelligent User Interfaces, 137--144.

Digital Library

[14]

Pasca, M. and Harabagiu, S. High Performance Question/Answering, in Proceedings of SIGIR-2001. pp. 366--374.

Digital Library

[15]

phpBB. Http://www.phpbb.com/.

[16]

Prager, J. M., Chu-Carroll, J., and Czuba, K.W. 2004. Question answering using constraint satisfaction. Proceedings of the 42nd Meeting of the Association for Computational Linguistics (ACL'04), 2004.

Digital Library

[17]

Salton, G. Automatic Text Processing, The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley, Reading, MA, 1989.

Digital Library

[18]

Shaw, E. Assessing and Scaffolding Collaborative Learning in Online Discussions. In Proceedings of the 12th International Conference on AI in Education (AIED '05).

Digital Library

[19]

Soller, A., and Lesgold, A. 2003. A computational approach to analyzing online knowledge sharing interaction, Proceedings of AI in Education 2003, 253--260.

[20]

USC Distance Education Network. Http://den.usc.edu/.

[21]

Winograd, T. 1987. A Language/Action Perspective on the Design of Cooperative Work. Human-Computer Interactions, 3:1, pp. 3--30.

Digital Library

[22]

Xu, J., Licuanan, A., Weischedel, R. 2003. TREC 2003 QA at BBN: Answering Definitional Questions. Proceedings of TREC 2003.

Cited By

Allen MNaeem UGill S(2024)Q-Module-Bot: A Generative AI-Based Question and Answer Bot for Module Teaching SupportIEEE Transactions on Education10.1109/TE.2024.343542767:5(793-802)Online publication date: Oct-2024
https://doi.org/10.1109/TE.2024.3435427
Ashktorab ZDesmond MJohnson JPan QDugan CBrachman MSpina C(2023)SME-in-the-loop: Interaction Preferences when Supervising Bots in Human-AI CommunitiesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596100(2281-2303)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596100
Liu CZhou SLiu DLi JHuang ZMa X(2023)CoArgue : Fostering Lurkers’ Contribution to Collective Arguments in Community-based QA PlatformsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580932(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580932
Show More Cited By

Index Terms

An intelligent discussion-bot for answering student queries in threaded discussions
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
    2. Interaction paradigms
      1. Natural language interfaces
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Answering Queries Using Views
Answering Queries Using Views
Answering top-k queries using views
VLDB '06: Proceedings of the 32nd international conference on Very large data bases

The problem of obtaining efficient answers to top-k queries has attracted a lot of research attention. Several algorithms and numerous variants of the top-k retrieval problem have been introduced in recent years. The general form of this problem ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces

January 2006

392 pages

ISBN:1595932879

DOI:10.1145/1111449

General Chairs:
Ernest Edmonds
University of Technology Sydney, Australia
,
Doug Riecken
IBM Watson Research, USA
,
Program Chairs:
Cécile L. Paris
CSIRO ICT Centre, Australia
,
Candace L. Sidner
MERL, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

IUI06

Sponsor:

IUI06: 11th International Conference on Intelligent User Interfaces

January 29 - February 1, 2006

Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

72
Total Citations
View Citations
1,051
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Allen MNaeem UGill S(2024)Q-Module-Bot: A Generative AI-Based Question and Answer Bot for Module Teaching SupportIEEE Transactions on Education10.1109/TE.2024.343542767:5(793-802)Online publication date: Oct-2024
https://doi.org/10.1109/TE.2024.3435427
Ashktorab ZDesmond MJohnson JPan QDugan CBrachman MSpina C(2023)SME-in-the-loop: Interaction Preferences when Supervising Bots in Human-AI CommunitiesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596100(2281-2303)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596100
Liu CZhou SLiu DLi JHuang ZMa X(2023)CoArgue : Fostering Lurkers’ Contribution to Collective Arguments in Community-based QA PlatformsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580932(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580932
Jasin JNg HAtmosukarto IIyer POsman FWong PPua CCheow W(2023)The implementation of chatbot-mediated immediacy for synchronous communication in an online chemistry courseEducation and Information Technologies10.1007/s10639-023-11602-128:8(10665-10690)Online publication date: 3-Feb-2023
https://doi.org/10.1007/s10639-023-11602-1
Jaipersaud BZhang PBa JPetersen AZhang LZhang M(2023)Decomposed Prompting to Answer Questions on a Course Discussion BoardArtificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky10.1007/978-3-031-36336-8_33(218-223)Online publication date: 30-Jun-2023
https://doi.org/10.1007/978-3-031-36336-8_33
Nishihara YSunayama WImashiro S(2022)Automatic Evaluation of Discussion Quality Using Topic Relevance and Participants' Performance2022 International Conference on Technologies and Applications of Artificial Intelligence (TAAI)10.1109/TAAI57707.2022.00023(78-82)Online publication date: Dec-2022
https://doi.org/10.1109/TAAI57707.2022.00023
Das Bhattacharjee SSai Abhishek Varma Gokaraju JYuan JKalwa A(2022)Multi-view Knowledge Graph for Explainable Course Content Recommendation in Course Discussion Posts2022 26th International Conference on Pattern Recognition (ICPR)10.1109/ICPR56361.2022.9956098(2785-2791)Online publication date: 21-Aug-2022
https://doi.org/10.1109/ICPR56361.2022.9956098
Kuhail MAlturki NAlramlawi SAlhejori K(2022)Interacting with educational chatbots: A systematic reviewEducation and Information Technologies10.1007/s10639-022-11177-328:1(973-1018)Online publication date: 9-Jul-2022
https://doi.org/10.1007/s10639-022-11177-3
Lazarus MTruong MDouglas PSelwyn N(2022)Artificial intelligence and clinical anatomical education: Promises and perilsAnatomical Sciences Education10.1002/ase.222117:2(249-262)Online publication date: 8-Oct-2022
https://doi.org/10.1002/ase.2221
Demetriadis SCaballé SPapadopoulos PGómez-Sánchez EKolling ATegos STsiatsos TPsathas GMichos KWeinberger ABech CKarakostas ATsibanis CPalaigeorgiou GHodges M(2021)Conversational agents in MOOCs: reflections on first outcomes of the colMOOC projectIntelligent Systems and Learning Data Analytics in Online Education10.1016/B978-0-12-823410-5.00001-2(xxxvii-lxxiv)Online publication date: 2021
https://doi.org/10.1016/B978-0-12-823410-5.00001-2
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten