research-article

Comparison of child-human and child-computer interactions based on manual annotations

Authors:

Jeannette Chang,

Jonathan Chang,

Shrikanth NarayananAuthors Info & Claims

WOCCI '09: Proceedings of the 2nd Workshop on Child, Computer and Interaction

Article No.: 2, Pages 1 - 6

https://doi.org/10.1145/1640377.1640379

Published: 05 November 2009 Publication History

Abstract

Technological advancements in recent years have been accompanied by a notable increase in research related to conversational child-machine interfaces. The technology has many applications from entertainment to education. In order to integrate this technology successfully we, however, need to understand the key differences (if any exist) in how children interact with machines versus how they interact with humans. Such knowledge could inform the design of more child-appropriate interfaces as well as highlight any distinct characteristics of child-computer interactions that may be crucial for specific applications. In this paper, we analyze a subset of the Little CHIMP corpus, in which preschool aged children have a series of conversations with a human moderator and a Wizard-of-Oz controlled computer character. We first manually transcribed and annotated the data using an objective audio-visual behavior coding scheme. We next extracted features exemplifying language and social communication from these transcriptions and annotations and performed statistical hypothesis tests comparing the child-human and child-computer interactions. Finally, we discuss the differences between these two dyadic conversations.

References

[1]

Black, M., Chang, J., and Narayanan, S. 2008. An empirical analysis of user uncertainty in problem-solving child-machine interactions. In Proc. of the Workshop on Child, Computer and Interaction (Chania, Greece, Oct. 2008).

[2]

Cassell, J., and Tartaro, A. 2007. Intersubjectivity in human-agent interaction. Interaction Studies 8--3:391--410.

[3]

Cassell, J. 2001. Embodied conversational agents: representation and intelligence in user interfaces. AI Magazine, vol. 22--4:67--83 (Winter 2001).

Digital Library

[4]

Cassell, J. and Ryokai, K. 2001. Making space for voice: technologies to support children's fantasy and storytelling. Personal Technologies 5(3): 203--224.

Digital Library

[5]

Cosi, P., Delmonte, R., Biscetti, S., Cole, R. A., Pellom, B., Vuren, S. van. 2004. Italian literacy tutor - tools and technologies for individuals with cognitive disabilities. In Proc. of ICALL (Venice, Italy, June 2004).

[6]

Coulston, R., Oviatt, S. L., and Darves, C. 2002. Amplitude convergence in children's conversational speech with animated personas. In Proc. of ICSLP (Denver, CO, USA, Sept. 2002).

[7]

Darves, C. and Oviatt, S. L. 2002. Adaptation of users' spoken dialogue patterns in a conversational interface. In Proc. of ICSLP (Denver, CO, USA, Sept. 2002).

[8]

Darves, C. and Oviatt, S. L. 2004. Talking to digital fish: Designing effective conversational interfaces for educational software. From Brows to Trust: Evaluating Embodied Conversational Agents, Kluwer: Dordrecht, 2004, 271--292.

Digital Library

[9]

Kipp, M. 2004. Gesture generation by imitation - from human behavior to computer character animation. dissertation.com (Boca Raton, Florida, Dec. 2004).

[10]

Lord, C., Rutter, M., DiLavore, P., and Risi, S. 1999. Autism diagnostic observation schedule: manual. Los Angeles: Western Psychological Services.

[11]

Montanari, S., Yildirim, S., Andersen, E., and Narayanan, S. 2004. Reference marking in children's computer-directed speech: An integrated analysis of discourse and gesture. In Proc. of ICSLP (Jeju, Korea, Oct. 2004).

[12]

Montanari, S., Yildirim, S., Khurana, S., Landes, M., Lawyer, L., Andersen, E., and Narayanan, S. 2004. Analyzing the interplay between spoken language and gestural cues in conversational child-machine interactions in pre/early literate age group. In Proc. of InStil (Venice, Italy, July 2004).

[13]

Narayanan, S. and Potamianos, A. 2002. Creating conversational interfaces for children. IEEE Transactions on Speech and Audio Processing, vol. 10--2:65--78 (Feb. 2002).

[14]

Oviatt, S. L. 2000. Talking to thimble jellies: children's conversational speech with animated characters. In Proc. of ICSLP (Beijing, China, Oct. 2000).

[15]

Reeves B. and Nass C. 1996. The media equation: how people treat computers, television, and new media like real people and places, Cambridge University Press, 1996.

Digital Library

[16]

Shechtman, N., Horowitz, L. M. 2003. Media inequality in conversation: how people behave differently when interacting with computers and people. In Proc. of SIGCHI (Ft. Lauderdale, Florida, April 2003).

Digital Library

[17]

Yildirim, S., Lee, C. M., Lee, S., Potamianos, A., and Narayanan, S. 2005. Detecting politeness and frustration state of a child in a conversational computer game. In Proc. of Eurospeech (Lisbon, Portugal, 2005).

[18]

Yildirim, S. and Narayanan, S. 2009. Automatic detection of disfluency boundaries in spontaneous speech of children using audiovisual information. IEEE Transactions on Speech Audio and Language Processing 17:2--12 (Jan. 2009).

Digital Library

Cited By

Gong JHan TGuo SLi JZha SZhang LTian FWang QRui Y(2021)HoloBoard: a Large-format Immersive Teaching Board based on pseudo HoloGraphicsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474761(441-456)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474761
Chen YYip JRosner DHiniker AKuznetsov SSaakes DWakkary RGeurts LHayes LLau M(2019)Lights, Music, Stamps! Evaluating Mealtime Tangibles for PreschoolersProceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3294109.3295645(127-134)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3294109.3295645
Ahmad Fuadi NOthman MSenan N(2018)Comparison of Approaches Made to Enhance Pupils’ Numeracy SkillRecent Advances on Soft Computing and Data Mining10.1007/978-3-319-72550-5_38(396-405)Online publication date: 12-Jan-2018
https://doi.org/10.1007/978-3-319-72550-5_38
Show More Cited By

Index Terms

Comparison of child-human and child-computer interactions based on manual annotations
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Natural language interfaces

Recommendations

Parent and child problematic media use: The role of maternal postpartum depression and dysfunctional parent-child interactions in young children
Abstract
Problematic media use, or media use that interferes with daily functioning, is most often studied in adolescent or young adult age groups. Less research has examined problematic media use within the family system, among parents and ...
Highlights
- Problematic media use is seen in children as young as 3–4 years old and in their parents.
When One Childhood Meets Another : Maternal Child Maltreatment and Offspring Child Psychopathology
Whole body interaction for child-centered multimodal language learning
WOCCI '09: Proceedings of the 2nd Workshop on Child, Computer and Interaction

Children engage with the world with their whole bodies, and we suggest here that during dialect learning, as during other learning activities, technology be capable of responding in whole body ways. As the child becomes more engaged in a shared-reality ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WOCCI '09: Proceedings of the 2nd Workshop on Child, Computer and Interaction

November 2009

111 pages

ISBN:9781605586908

DOI:10.1145/1640377

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMI-MLMI '09

Sponsor:

SIGCHI

ICMI-MLMI '09: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES/WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERFACES

November 5, 2009

Massachusetts, Cambridge

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
423
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gong JHan TGuo SLi JZha SZhang LTian FWang QRui Y(2021)HoloBoard: a Large-format Immersive Teaching Board based on pseudo HoloGraphicsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474761(441-456)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474761
Chen YYip JRosner DHiniker AKuznetsov SSaakes DWakkary RGeurts LHayes LLau M(2019)Lights, Music, Stamps! Evaluating Mealtime Tangibles for PreschoolersProceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3294109.3295645(127-134)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3294109.3295645
Ahmad Fuadi NOthman MSenan N(2018)Comparison of Approaches Made to Enhance Pupils’ Numeracy SkillRecent Advances on Soft Computing and Data Mining10.1007/978-3-319-72550-5_38(396-405)Online publication date: 12-Jan-2018
https://doi.org/10.1007/978-3-319-72550-5_38
Șerban OBarange MZojaji SPauchet ARichard AChanoni ELank EVinciarelli AHoggan ESubramanian SBrewster S(2017)Interactive narration with a child: impact of prosody and facial expressionsProceedings of the 19th ACM International Conference on Multimodal Interaction10.1145/3136755.3136797(23-31)Online publication date: 3-Nov-2017
https://dl.acm.org/doi/10.1145/3136755.3136797
Akkil DDey PSalian DRajput N(2017)Gaze Awareness in Agent-Based Early-Childhood Learning ApplicationHuman-Computer Interaction - INTERACT 201710.1007/978-3-319-67684-5_28(447-466)Online publication date: 20-Sep-2017
https://doi.org/10.1007/978-3-319-67684-5_28
Cook SFriedman HDuggan KCui JPopescu V(2016)Hand Gesture and Mathematics Learning: Lessons From an AvatarCognitive Science10.1111/cogs.1234441:2(518-535)Online publication date: 29-Apr-2016
https://doi.org/10.1111/cogs.12344
Hyde JKiesler SHodgins JCarter EJones MPalanque PSchmidt AGrossman T(2014)Conversing with childrenProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557280(1787-1796)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557280
Andrist SLeite ILehman JHourcade JSawhney NReardon E(2013)Fun and fairProceedings of the 12th International Conference on Interaction Design and Children10.1145/2485760.2485800(352-355)Online publication date: 24-Jun-2013
https://dl.acm.org/doi/10.1145/2485760.2485800
Hajishirzi HLehman JHodgins JLee GGinzburg J(2012)Using group history to identify character-directed utterances in multi-child interactionsProceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue10.5555/2392800.2392838(207-216)Online publication date: 5-Jul-2012
https://dl.acm.org/doi/10.5555/2392800.2392838
Mower EBlack MFlores EWilliams MNarayanan S(2011)RachelProceedings of the 2011 IEEE International Conference on Multimedia and Expo10.1109/ICME.2011.6011990(1-6)Online publication date: 11-Jul-2011
https://dl.acm.org/doi/10.1109/ICME.2011.6011990

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents