Article

Initial lessons from AR Façade, an interactive augmented reality drama

Authors:

Blair MacIntyre,

Micheal MateasAuthors Info & Claims

ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

Pages 28 - es

https://doi.org/10.1145/1178823.1178858

Published: 14 June 2006 Publication History

Abstract

In this paper, we describe an augmented reality version of the acclaimed desktop-based interactive drama, Façade [18]. Few entertainment experiences combine interactive virtual characters, non-linear narrative, and unconstrained embodied interaction. In AR Façade players move through a physical apartment and use gestures and speech to interact with two autonomous characters, Trip and Grace. Our experience converting a desktop based game to augmented reality sheds light on the design challenges of developing mixed physical/virtual AI-based drama. We share our initial observations of players from a live demonstration and talk about our work moving forward.

References

[1]

Bobick, A. F., Intille, S. S., Davis, J. W., Baird, F., Campbell, L. W., Ivanov, Y., Pinhanez, C. S., Schütte, A., and Wilson, A. The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment. PRESENCE: Teleoperators and Virtual Environments 8, 4 (Aug. 1999), 367--391.

Digital Library

[2]

Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., and Yan, H. Embodiment in conversational interfaces: Rea. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'99) (Pittsburgh, PA, USA). ACM Press, New York, NY, 1999.

Digital Library

[3]

Cavazza, M., Charles, F. and Mead, S. J. Interacting with Virtual Characters in Interactive Storytelling. In ACM Joint Conference on Autonomous Agents and Multi-Agent Systems, (Bologna, Italy). 2002, 318--325.

Digital Library

[4]

Charles, F., Cavazza, M., Mead, S. J., Martin, O., Nandi, A., and Marichal, X. Compelling Experiences in Mixed Reality Interactive Storytelling. In Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE'04), (Singapore). ACM Press, New York, NY, 2004.

Digital Library

[5]

Cheok, A. D., Goh, K. H., Liu, W., Farbiz, V, Fong, S. W., Teo, S. L., Li, Y., and Yang, X. Human Pacman: A Mobile, Wide-area Entertainment System Based on Physical, Social, and Ubiquitous Computing. Personal Ubiquitous Computing, vol. 8, (2004), 71--81.

Digital Library

[6]

Corradini, A., Mehta, M., Bernsen, N. O. and Charfuelán, M. Animating an Interactive Conversational Character for an Educational Game System. In Proceedings of the International Conference on Intelligent User Interfaces (IUI'05), (San Diego, CA, USA). ACM Press, New York, NY, 2005, 183--190.

Digital Library

[7]

Flintham, M., Benford, S., Anastasi, R., Hemmings, V., Crabtree, A., Greenhalgh, C., Tandavanitj, N., Adams, M., and Row-Farr, J. Where On-line Meets on the Streets: Experiences with Mobile Mixed Reality Games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'03), (Ft. Lauderdale, FL, USA). ACM Press, New York, NY, 2003.

Digital Library

[8]

Hughes, C. E, Stapleton, C. B., Hughes, D. E., Smith, E. Mixed Reality in Education, Entertainment and Training: An Interdisciplinary Approach. IEEE Computer Graphics and Applications, 26(6) (2005), 24--30.

Digital Library

[9]

Johnson, W. L., Rickel, J. W. Animated Pedagogical Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal of Artificial Intelligence in Education, 11, (2000), 47--78.

[10]

Knickmeyer, R. L. and Mateas, M. Preliminary Evaluation of the Interactive Drama Façade. In Extended Abstracts of the SIGGCHI Conference on Human Factors in Computing Systems (CHI'05), (Portland, OR, USA). ACM Press, New York, NY, 2005.

Digital Library

[11]

Koleva, B., Taylor, I., Benford, S., Fraser, M., Greenhalgh, C., Schndelbach, H., Lehn, D. v., Heath, V, Row-Farr, J., and Adams, M. Orchestrating a mixed reality performance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'01), (Seattle, WA, USA). ACM Press, New York, NY, 2001.

Digital Library

[12]

Laurel, B., Computers as Theatre. Addison-Wesley, 1991.

Digital Library

[13]

MacIntyre, B., and Bolter, J. D. Single-Narrative, Multiple Point-of-View Dramatic Experiences in Augmented Reality. In the Journal of Virtual Reality, 7(1) (December 2003), 10--16.

Digital Library

[14]

Magerko, B. and Laird, J. E. Building an Interactive Drama Architecture. In Proceedings of First International Conference on Technologies for Interactive Digital Storytelling and Entertainment, (Darmstadt, Germany). 2003, 226--237.

[15]

Mateas, M., and Stern, A. Procedural Authorship: A Case-Study Of the Interactive Drama Façade. In Digital Arts and Culture (DAC), (Copenhagen, Denmark), November 2005.

[16]

Mateas, M. and Stern, A. Natural Language Processing in Façade: Surface-text processing. In Technologies for Interactive Digital Storytelling and Entertainment (TIDSE), (Darmstadt, Germany). June 2004.

[17]

Mateas, M. and Stern, A. A Behavior Language: Joint action and Behavioral Idioms. In H. Prendinger and M. Ishizuka (Eds), Life-like Characters. Tools, Affective Functions and Applications, Springer, 2004.

[18]

Mateas, M. and Stern, A. Façade: An Experiment in Building a Fully-Realized Interactive Drama. In Game Developer's Conference: Game Design Track, (San Jose, CA). 2003.

[19]

Maulsby, D., Greenberg, S., and Mander, R. Prototyping an intelligent agent through Wizard of Oz. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'93), (Amsterdam, Netherlands). ACM Press, New York, NY, 1993.

Digital Library

[20]

Mori, M. On the Uncanny Valley. In Proceedings of the Humanoids-2005 workshop: Views of the Uncanny Valley, (Tsukuba, Japan). 5 December 2005.

[21]

Murray, J., Hamlet on the Holodeck: The Future of Narrative in Cyberspace. New York, NY: The Free Press, 1997.

Digital Library

[22]

Riedl, M., Saretto, C. J., and Young, R. M. Managing interaction between users and agents in a multiagent storytelling environment. In Proceedings of the Second International Conference on Autonomous Agents and Multi-Agent Systems, June 2003.

Digital Library

[23]

Swartout, W., Hill, R., Gratch, J., Johnson, W., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiebaux, M., Tuch, L., Whitney, R., and Douglas, J. Toward the holodeck: Integrating graphics, sound, character and story. In Proceedings of Autonomous Agents, 2001.

Digital Library

[24]

Thomas, B., Close, B., Donoghue, J., Squires, J., Bondi, P. D., and Piekarski, W. First Person Indoor/Outdoor Augmented Reality Application: ARQuake. Personal Ubiquitous Computing, 6, (2002), 75--86.

Digital Library

Cited By

Wales MWheeler MCimolino GLevin LMees JGraham T(2024)Process, Roles, Tools, and Team: Understanding the Emerging Medium of Virtual Reality TheatreProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642741(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642741
Fisher J(2023)Centering the Human: Digital Humanism and the Practice of Using Generative AI in the Authoring of Interactive Digital NarrativesInteractive Storytelling10.1007/978-3-031-47655-6_5(73-88)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-47655-6_5
Spierling U(2023)Authoring Interactive Narrative Meets Narrative Interaction DesignThe Authoring Problem10.1007/978-3-031-05214-9_8(113-130)Online publication date: 2-Jan-2023
https://doi.org/10.1007/978-3-031-05214-9_8
Show More Cited By

Index Terms

Initial lessons from AR Façade, an interactive augmented reality drama
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

Presence and engagement in an interactive drama
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper we present the results of a qualitative, empirical study exploring the impact of immersive technologies on presence and engagement, using the interactive drama Façade as the object of study. In this drama, players are situated in a married ...
AR façade: an augmented reality interactve drama
VRST '07: Proceedings of the 2007 ACM symposium on Virtual reality software and technology

Our demonstration presents AR Façade, a phyiscally embodied version of the interactive drama Façade, at the Beall Center in Irvine, CA. In this drama, players are situated in a married couple's apartment, and interact primarily through conversation with ...
Single-narrative, multiple point-of-view dramatic experiences in augmented reality

Researchers and practitioners working on story-based experiences in virtual environments often make two assumptions. One assumption is that, to be compelling, such experiences must enable the user to make significant choices that alter the outcome of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

June 2006

572 pages

ISBN:1595933808

DOI:10.1145/1178823

General Chairs:
Hiroshi Ishii
Tangible Media Group, MIT Media Laboratory
,
Newton Lee
Association for Computing Machinery (ACM), Disney Online, Woodbury University, and Bell Labs
,
Stephane Natkin
CNAM Paris, CEDRIC
,
Katsuhide Tsushima
Osaka Electro-Communication University, Japan

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 June 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ACE2006

Sponsor:

SIGCHI

ACE2006: International Conference in Advances in Computer Entertainment Technology

June 14 - 16, 2006

California, Hollywood, USA

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
843
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)6

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wales MWheeler MCimolino GLevin LMees JGraham T(2024)Process, Roles, Tools, and Team: Understanding the Emerging Medium of Virtual Reality TheatreProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642741(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642741
Fisher J(2023)Centering the Human: Digital Humanism and the Practice of Using Generative AI in the Authoring of Interactive Digital NarrativesInteractive Storytelling10.1007/978-3-031-47655-6_5(73-88)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-47655-6_5
Spierling U(2023)Authoring Interactive Narrative Meets Narrative Interaction DesignThe Authoring Problem10.1007/978-3-031-05214-9_8(113-130)Online publication date: 2-Jan-2023
https://doi.org/10.1007/978-3-031-05214-9_8
Park HShakeri MJeon IKim JSadeghi-Niaraki AWoo W(2022)Spatial transition management for improving outdoor cinematic augmented reality experience of the TV showVirtual Reality10.1007/s10055-021-00617-z26:3(1059-1077)Online publication date: 6-Jan-2022
https://doi.org/10.1007/s10055-021-00617-z
Szilas N(2022)Narrative Mode of the Third KindInteractive Storytelling10.1007/978-3-031-22298-6_30(471-479)Online publication date: 4-Dec-2022
https://dl.acm.org/doi/10.1007/978-3-031-22298-6_30
Jin YMa MZhu Y(2021)A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented realityMultimedia Tools and Applications10.1007/s11042-021-11723-0Online publication date: 30-Dec-2021
https://doi.org/10.1007/s11042-021-11723-0
Mouna KMohamed A(2019)3D Natural Interaction for an Augmented Reality System2019 International Conference on Advanced Electrical Engineering (ICAEE)10.1109/ICAEE47123.2019.9015075(1-6)Online publication date: Nov-2019
https://doi.org/10.1109/ICAEE47123.2019.9015075
Rowberry S(2018)Continuous, not discrete: The mutual influence of digital and physical literatureConvergence: The International Journal of Research into New Media Technologies10.1177/135485651875504926:2(319-332)Online publication date: 7-Feb-2018
https://doi.org/10.1177/1354856518755049
Nagata KMasuko SHoshino J(2018)Construction of Mixed Reality Story Environment Based on Real Space ShapeEntertainment Computing – ICEC 201810.1007/978-3-319-99426-0_27(260-265)Online publication date: 25-Aug-2018
https://doi.org/10.1007/978-3-319-99426-0_27
Gandy MLevy LRobertson SJohnson JWilson JLemieux TTamasi SMashman DSumler MHill L(2016)Designing AR Systems to Explore Point-of-View, Bias, and Trans-cultural Conflict2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2016.0069(166-171)Online publication date: Sep-2016
https://doi.org/10.1109/ISMAR-Adjunct.2016.0069
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents