Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1647314.1647338acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
poster

Modeling culturally authentic style shifting with virtual peers

Published: 02 November 2009 Publication History

Abstract

We report on a new kind of culturally-authentic embodied conversational agent more in line with the ways that culture and ethnicity function in the real world. On the basis of the careful analysis of a corpus of verbal and nonverbal behavior, we found that children shift dialects and ways of using their body depending on social context and task. Based on these results, we implemented a culturally authentic African American virtual peer capable of "code-switching" between African American English and Mainstream American English, and of using nonverbal behavior differently, depending on context. An evaluation of the agent revealed that the virtual peer elicited the same style changes in real children as real children did in one another.

References

[1]
Allen, B. A. and Boykin, A. W., (1991) "The Influence of Contextual Factors on Afro-American and Euro-American Children's Performance: Effects of Movement Opportunity and Music.," International Journal of Psychology, vol. 26(3), 373--388.
[2]
Arnason, B. T. and Thorsteinsson, A. (2008) BML Realizer: An Open Source BML Animation Toolkit. Unpublished Bachelor of Science dissertation, School of Computer Science, Reykjavik University.
[3]
Bakeman, R. and Gottman, J. M., (1997) Observing Interaction: An Introduction to Sequential Analysis, Second ed.: Cambridge University Press.
[4]
Cassell, J., (2004) "Towards a Model of Technology and Literacy Development: Story Listening Systems," Journal of Applied Developmental Psychology, vol. 25(1), 75--105.
[5]
Cassell, J., et al., (2000) "Shared Reality: Physical Collaboration with a Virtual Peer," in Proceedings of CHI 2000, The Hague, The Netherlands, 259--260.
[6]
Core, M. and Allen, J., (1997) "Coding Dialogue with the DAMSL Annotation Scheme," in Proceedings of AAAI Fall Symposium on Communicative Action in Humans and Machines, Boston, MA.
[7]
Craig, H. K., et al., (2003) "Phonological features of child African American English," Journal of Speech, Language, and Hearing Research, vol. 46(623--635.
[8]
Craig, H. K. and Washington, J. A., (2005) Malik goes to school: Examining the language skills of African American students from preschool-5th grade. New York: Lawrence Erlbaum.
[9]
Crowder, E. M., (1993) "Telling What They Know: The Role of Gesture and Language in Children's Science Explanations," Pragmatics and Cognition, vol. 1(2), 341--376.
[10]
Cutler, C., (2003) ""Keepin' It Real": White Hip-Hoppers' Discourses of Language, Race, and Authenticity," Journal of Linguistic Anthropology, vol. 13(2), 211--233.
[11]
Goslin, M. and Mine, M. R., (2004) "The Panda3D Graphics Engine," Computer, vol. 37(10), 112--114.
[12]
Green, L. J., (2002) African American English: a linguistic introduction. Cambridge, UK: University of Cambridge Press.
[13]
Guthrie, D., et al., (2006) "A Closer Look at Skip-gram Modelling," in Proceedings of Fifth international Conference on Language Resources and Evaluation (LREC), Genoa, Italy, 1222--1225.
[14]
Gutiérrez, K. D., et al., (1999) "Rethinking Diversity: Hybridity and Hybrid Language Practices in the Third Space," Mind, Culture, and Activity, vol. 6(4), 286--303.
[15]
Iacobelli, F. and Cassell, J., (2007) "Ethnic Identity and Engagement in Embodied Conversational Agents," in Proceedings of 7th International Conference on Intelligent Virtual Agents, Paris, France, 57--63.
[16]
Irvine, J. T., (1985) "Status and Style in Language," Annual Review of Anthropology, vol. 14(577--581.
[17]
Johnson, K. R., (1976) "Black kinesics: Some non-verbal communication patterns in the Black culture," in Intercultural communication: A reader, L. A. Samovar and R. E. Porter, Eds. Belmont, CA: Wadsworth, 259--268.
[18]
Jurafsky, D. and Martin, J. H., (2006) Speech and Language Processing: An introduction to speech recognition, computational linguistics and natural language processing, 2nd ed.
[19]
Kurth, L. A., et al., (2002) "Student use of narrative and paradigmatic forms of talk in elementary science conversations," Journal of research in science teaching, vol. 39(9), 26.
[20]
Lee, J. C., (2008) "Wiimote Tracking," Pittsburgh, PA
[21]
Lee, O., (1999) "Equity Implications Based on the Conceptions of Science Achievement in Major Reform Documents," Review of educational research, vol. 69(1), 83.
[22]
Lubienski, S. T., (2001) "Are the NCTM "Standards" Reaching All Students? An Examination of Race, Class, and Instructional Practices," in Proceedings of Annual Meeting of the American Educational Research Association, Seattle WA, 22.
[23]
Luke, A., (1992) "The body literate: Discourse and inscription in early literacy training," Linguistics and Education, vol. 4(1), 107--109.
[24]
Mashburn, A. J., et al., (2009) "Peer Effects on Children's Language Achievement During Pre--Kindergarten," Child Development, vol. 80(3), 686--702.
[25]
Nass, C., et al., (2000) "Truth is Beauty: Researching Embodied Conversational Agents," in Embodied Conversational Agents, J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, Eds. Cambridge, MA: MIT Press, 374--402.
[26]
Ogbu, J. U., (2003) Black American students in an affluent suburb: a study of academic disengagement. Mahwah N J: L. Erlbaum.
[27]
Perie, M., et al., (2005) "The Nation's Report Card: Reading 2005," National Center for Education Statistics (NCES), Ed.: US Department of Education.
[28]
Thiebaux, M., et al., (2008) "SmartBody: behavior realization for embodied conversational agents," in Proceedings of 7th international conference on Autonomous agents and Multiagent Systems, Estoril, Portugal, 151--158.
[29]
Wang, A. and Cassell, J., (2003) "Co-authoring, Corroborating, Criticizing: Collaborative Storytelling for Literacy Learning," in Proceedings of Vienna Workshop: Educational Agents -- More than Virtual Tutors, Vienna, Austria.
[30]
Wertsch, J. V., et al., (1995) Sociocultural studies of mind. Cambridge ; New York: Cambridge University Press.

Cited By

View all
  • (2023)FaceMeInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103032175:COnline publication date: 1-Jul-2023
  • (2022)Informing and Evaluating Educational Applications With the Kirkpatrick Model in Virtual Environments: Using a Virtual Human Scenario to Measure Communication Skills Behavior ChangeFrontiers in Virtual Reality10.3389/frvir.2022.8107973Online publication date: 14-Apr-2022
  • (2022)Long-Term Interaction with Relational SIAsThe Handbook on Socially Interactive Agents10.1145/3563659.3563667(195-260)Online publication date: 27-Oct-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICMI-MLMI '09: Proceedings of the 2009 international conference on Multimodal interfaces
November 2009
374 pages
ISBN:9781605587721
DOI:10.1145/1647314
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2009

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. analysis and modeling of verbal and nonverbal interaction
  2. culture
  3. embodied conversational agents

Qualifiers

  • Poster

Conference

ICMI-MLMI '09
Sponsor:

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)6
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2023)FaceMeInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103032175:COnline publication date: 1-Jul-2023
  • (2022)Informing and Evaluating Educational Applications With the Kirkpatrick Model in Virtual Environments: Using a Virtual Human Scenario to Measure Communication Skills Behavior ChangeFrontiers in Virtual Reality10.3389/frvir.2022.8107973Online publication date: 14-Apr-2022
  • (2022)Long-Term Interaction with Relational SIAsThe Handbook on Socially Interactive Agents10.1145/3563659.3563667(195-260)Online publication date: 27-Oct-2022
  • (2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
  • (2021)Task Assignment Strategies for Crowd Worker Ability ImprovementProceedings of the ACM on Human-Computer Interaction10.1145/34795195:CSCW2(1-20)Online publication date: 18-Oct-2021
  • (2021)Meeting with Media: Comparing Synchronous Media Sharing and Icebreaker Questions in Initial Interactions via Video ChatProceedings of the ACM on Human-Computer Interaction10.1145/34795185:CSCW2(1-26)Online publication date: 18-Oct-2021
  • (2021)Family Communication: Examining the Differing Perceptions of Parents and Teens Regarding Online Safety CommunicationProceedings of the ACM on Human-Computer Interaction10.1145/34795175:CSCW2(1-23)Online publication date: 18-Oct-2021
  • (2021)Reflexivity of Account, Professional Vision, and Computer-Supported Cooperative Work: Working in the Maritime DomainProceedings of the ACM on Human-Computer Interaction10.1145/34795145:CSCW2(1-32)Online publication date: 18-Oct-2021
  • (2021)Resisting Racism in Tech DesignProceedings of the ACM on Human-Computer Interaction10.1145/34492915:CSCW1(1-32)Online publication date: 22-Apr-2021
  • (2021)CASSProceedings of the ACM on Human-Computer Interaction10.1145/34490835:CSCW1(1-31)Online publication date: 22-Apr-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media