research-article

Eliza meets the wizard-of-oz: blending machine and human control of embodied characters

Authors:

Blair MacIntyre,

Michael MateasAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 547 - 556

https://doi.org/10.1145/1753326.1753408

Published: 10 April 2010 Publication History

Abstract

What authoring possibilities arise by blending machine and human control of live embodied character experiences? This paper explores two different "behind-the-scenes" roles for human operators during a three-month gallery installation of an embodied character experience. In the Transcription role, human operators type players' spoken utterances; then, algorithms interpret the player's intention, choose from pre-authored dialogue based on local and global narrative contexts, and procedurally animate two embodied characters. In the Discourse role, human operators select from semantic categories to interpret player intention; algorithms use this "discourse act" to automate character dialogue and animation. We compare these two methods of blending control using game logs and interviews, and document how the amateur operators initially resisted having to learn the Discourse version, but eventually preferred having the authorial control it afforded. This paper also outlines a design space for blending machine and human control in live character experiences.

References

[1]

Remy and Disney's Living Character Initiative, Jan, 2010. http://www.stitchkingdom.com/2009/04/07/all-about-remy-and-disneys-living-character-initiative/.

[2]

Turtle Talk with Crush, Jan, 2010. http://disneyworld.disney.go.com/parks/epcot/entertainment/turtle-talk-with-crush/.

[3]

Mobile Muppet Lab in Epcot, Jan, 2010. http://allears.net/tp/ep/mobilemuppets.htm.

[4]

Quasi the Robot, Jan, 2010. http://www.interbots.com/characters.html.

[5]

Pet Society, Jan, 2010. http://www.facebook.com/applications/Pet_Society/11609831134.

[6]

Badler, N., Allbeck, J., Zhao, L., and Byun, M. Representing and Parameterizing Agent Behaviors. Proceedings of the Computer Animation, IEEE Computer Society (2002), 133.

Digital Library

[7]

Cassell, J., Bickmore, T., Billinghurst, M., et al. An Architecture for Embodied Conversational Characters. Proceedings of Computer Animation And Simulation, (1998), 109--120.

[8]

Cassell, J., Sullivan, J., Prevost, S., and Churchill, E.F. Embodied Conversational Agents. MIT Press, 2000.

Digital Library

[9]

Corradini, A., Mehta, M., Bernsen, N., and Charfuelan, M. Animating an interactive conversational character for an educational game system. Proceedings of the 10th international conference on Intelligent user interfaces, ACM (2005), 183--190.

Digital Library

[10]

Dahlbäck, N., Jönsson, A., and Ahrenberg, L. Wizard of Oz studies: why and how. In Proc. of the Intl. Conf on Intelligent User Interfaces (IUI), 1993.

Digital Library

[11]

Dow, S., Mehta, M., Harmon, E., MacIntyre, B., and Mateas, M. Presence and engagement in an interactive drama. Proceedings of the SIGCHI conference on Human factors in computing systems, ACM (2007), 1475--1484.

Digital Library

[12]

Dow, S., Mehta, M., Lausier, A., MacIntyre, B., and Mateas, M. Initial lessons from AR Façade, an interactive augmented reality drama. Proc of ACM SIGCHI international conference on Advances in computer entertainment technology, 2006.

Digital Library

[13]

Dybkjær, H., Bernsen, N.O., and Dybkjær, L. Wizard-of-Oz and the Trade-Off between Naturalness and Recognizer Constraints. In EUROSPEECH, 1993.

[14]

Engler, L. and Fijan, C. Making Puppets Come Alive: How to Learn and Teach Hand Puppetry. Dover Publications, 1997.

[15]

Essa, I. and pentland, A.P. Facial Expression Recognition using a Dynamic Model and Motion Energy. IN ICCV, (1995), 360--367.

Digital Library

[16]

Höysniemi, J., Hämäläinen, P., and Turkki, L. Wizard of Oz prototyping of computer vision based action games for children. Proc of the Interaction design and children: building a community, (2004), 27--34.

Digital Library

[17]

Johnson, W.L., Rickel, J.W., and Lester, J.C. Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal on Artificial Intelligence in Education 11, (2000), 47--78.

[18]

Jönsson, S. and Waern, A. The art of game-mastering pervasive games. In Proc. of Advances in Computer Entertainment Technology, 2008, 224--231.

Digital Library

[19]

Jurafsky, D. and Martin, J.H. Speech and Language Processing. Prentice Hall, 2008.

Digital Library

[20]

Kelso, M., Weyhrauch, K.P., and Bates, J. Dramatic Presence. In PRESENCE: Teleoperators & Virtual Environments, 2(1), MIT Press (1992).

[21]

Klemmer, S.R., Sinha, A.K., Chen, J., Landay, J.A., Aboobaker, N., and Wang, A. Suede: a Wizard of Oz prototyping tool for speech user interfaces. Proc of User interface software and technology, (2000), 1--10.

Digital Library

[22]

Mateas, M. A Preliminary Poetics for Interactive Drama and Games. Digital Creativity 12, 3 (2001).

[23]

Mateas, M. and Stern, A. Façade: An Experiment in Building a Fully-Realized Interactive Drama. In Game Developer's Conference: Game Design Track, (2003).

[24]

Mateas, M. and Stern, A. Natural Language Understanding in Façade: Surface-Text Processing. In Technologies for Interactive Digital Storytelling and Entertainment. 2004, 3--13.

[25]

McGonigal, J. The Puppet Master Problem: Design for Real-World, Mission-Based Gaming. In Second Person (eds. Harrigan and Fruin). MIT Press, 2007.

[26]

Mehta, M., Dow, S., Mateas, M., and MacIntyre, B. Evaluating a conversation-centered interactive drama. Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems, ACM (2007), 1--8.

Digital Library

[27]

Nelson, M.J., Mateas, M., Roberts, D.L., and Jr, C.L.I. Declarative Optimization-Based Drama Management in Interactive Fiction. IEEE Comput. Graph. Appl. 26, 3 (2006), 32--41.

Digital Library

[28]

Perlin, K. Creating Emotive Responsive Characters Within Virtual Worlds. Proceedings of the Second International Conference on Virtual Worlds, Springer-Verlag (2000), 99--106.

Digital Library

[29]

Prendinger, H. and Ishizuka, M. Let's Talk! Socially Intelligent Agents for Language Conversation Training. In IEEE Trans. on Systems, Man and Cybernetics, Sept. 2001.

Digital Library

[30]

Schechner, R. Performance Studies: An Introduction. Routledge, 2002.

[31]

Thue, D., Bulitko, V., and Spectch, M. A Demonstration of Player Modeling in Interactive Storytelling. (2008).

[32]

Tychsen, A., Hitchens, M., Aylett, R. and Louchart, S., Modeling game master-based story facilitation in multi-player Role-Playing Games. In Proceedings of the 2009 AAAI Symposium on Intelligent Narrative Technologies II, pp. 24--32.

[33]

Wardrip-Fruin, N., Mateas, M., Dow, S., and Sali, S. Agency Reconsidered. Breaking New Ground: Innovation in Games, Play, Practice and Theory. Proceedings of DiGRA 2009, (2009).

[34]

Weizenbaum, J. ELIZA: a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 1 (1966), 36--45.

Digital Library

[35]

Young, R.M. and Riedl, M.O. Integrating plan-based behavior generation with game environments. Proc of ACM SIGCHI Intl Conference on Advances in computer entertainment technology, (2005), 370--370.

Digital Library

Cited By

Rayan JKanetkar DGong YYang YPalani SXia HDow S(2024)Exploring the Potential for Generative AI-based Conversational Cues for Real-Time Collaborative IdeationProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656184(117-131)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656184
Aghajari ZBaumer EHohenstein JJung MDiFranzo D(2023)Methodological Middle Spaces: Addressing the Need for Methodological Innovation to Achieve Simultaneous Realism, Control, and Scalability in Experimental Studies of AI-Mediated CommunicationProceedings of the ACM on Human-Computer Interaction10.1145/35795067:CSCW1(1-28)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579506
Mitchell EMamykina L(2021)From the Curtain to Kansas: Conducting Wizard-of-Oz Studies in the WildExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3443446(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3443446
Show More Cited By

Index Terms

Eliza meets the wizard-of-oz: blending machine and human control of embodied characters
1. Human-centered computing

Recommendations

Wizard of Oz studies in HRI: a systematic review and new reporting guidelines
Inaugural Special Issue: Intersection of Systems Sciences and Human Sciences

Many researchers use Wizard of Oz (WoZ) as an experimental technique, but there are methodological concerns over its use, and no comprehensive criteria on how to best employ it. We systematically review 54 WoZ experiments published in the primary HRI ...
Wizard of Oz experiments and companion dialogues
BCS '10: Proceedings of the 24th BCS Interaction Specialist Group Conference

Novel speech systems such as the conversational agents being developed by the Companions Project (www.companions-project.org) can be simulated using the Wizard of Oz methodology. In this approach technologies that are not yet ready for testing by people ...
Wizard of Oz experiments for companions
BCS-HCI '09: Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology

Wizard of Oz experiments allow designers and developers to see the reactions of people as they interact with to-be-developed technologies. At the Centre for Interaction Design at Edinburgh Napier University we are developing a Wizard of Oz system to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
766
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)7

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rayan JKanetkar DGong YYang YPalani SXia HDow S(2024)Exploring the Potential for Generative AI-based Conversational Cues for Real-Time Collaborative IdeationProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656184(117-131)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656184
Aghajari ZBaumer EHohenstein JJung MDiFranzo D(2023)Methodological Middle Spaces: Addressing the Need for Methodological Innovation to Achieve Simultaneous Realism, Control, and Scalability in Experimental Studies of AI-Mediated CommunicationProceedings of the ACM on Human-Computer Interaction10.1145/35795067:CSCW1(1-28)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579506
Mitchell EMamykina L(2021)From the Curtain to Kansas: Conducting Wizard-of-Oz Studies in the WildExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3443446(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3443446
Yuan YThompson SWatson KChase ASenthilkumar ABernheim Brush AYarosh S(2019)Speech interface reformulations and voice assistant personification preferences of children and parentsInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2019.04.00521:C(77-88)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1016/j.ijcci.2019.04.005
Yarosh SThompson SWatson KChase ASenthilkumar AYuan YBrush AGiannakos MJaccheri LDivitini M(2018)Children asking questionsProceedings of the 17th ACM Conference on Interaction Design and Children10.1145/3202185.3202207(300-312)Online publication date: 19-Jun-2018
https://dl.acm.org/doi/10.1145/3202185.3202207
Candello HPinhanez C(2018)The Role of Dialogue User Data in the Information Interaction Design of Conversational SystemsDesign, User Experience, and Usability: Designing Interactions10.1007/978-3-319-91803-7_31(414-426)Online publication date: 2-Jun-2018
https://doi.org/10.1007/978-3-319-91803-7_31
An SKim YLee JBae SBoll SPfleging BDonmez BPolitis ILarge D(2017)Collaborative Experience Prototyping of Automotive Interior in VR with 3D Sketching and Haptic HelpersProceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3122986.3123002(183-192)Online publication date: 24-Sep-2017
https://dl.acm.org/doi/10.1145/3122986.3123002
Appel ACandello HGandour F(2017)Cognitive Computing: Where Big Data Is Driving UsHandbook of Big Data Technologies10.1007/978-3-319-49340-4_24(807-850)Online publication date: 26-Feb-2017
https://doi.org/10.1007/978-3-319-49340-4_24
Samuel BRyan JSummerville AMateas MWardrip-Fruin N(2016)Bad News: An Experiment in Computationally Assisted PerformanceInteractive Storytelling10.1007/978-3-319-48279-8_10(108-120)Online publication date: 22-Oct-2016
https://doi.org/10.1007/978-3-319-48279-8_10
Cavalin PFigueiredo Fde Bayser MMoyano LCandello HAppel ASouza R(2016)Building a Question-Answering Corpus Using Social Media and News ArticlesComputational Processing of the Portuguese Language10.1007/978-3-319-41552-9_36(353-358)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-41552-9_36
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents