"Hold My Hand, Baby": Understanding Engagement through the Illusion of Touch between Human and Agent
Pages 1438 - 1444
Abstract
This paper explores the quality of engagement between human and agent in large displays. We designed a musical application and introduced the illusion of touch as a novel interaction concept where the user and the agent interact through mediated virtual touch. We conducted a lab study to better understand the users' behaviors and engagement with our system. Our main findings from the design exploration are: 1) users are engaged in the interaction with an interactive agent even though the agent is not perceived as engaged by the user; 2) users are more involved in the experience when the agent is interactive; and 3) the agent's gaze is effective in grabbing the user's attention. These findings provide initial insights on designing for engagement in displays that make use of embodied agents and should be validated with a field study.
References
[1]
Beyer, G., Alt, F., Müller, J., Schmidt, A., Isakovic, K., Klose, S., Schiewe, M., and Haulsen, I. Audience behavior around large interactive cylindrical screens. In Proc. of CHI'11, ACM (New York, USA, 2011), 10211030.
[2]
Brignull, H. and Rogers, Y. 2003. Enticing people to interact with large public displays in public spaces. In INTERACT'03.
[3]
Cassell, J., Sullivan, H., Prevost, S., and Churchill, E. 2000. Embodied Conversational Agents. Masschusetts, USA : MIT Press.
[4]
Christian, A. D. and Avery, B. L. 2000. Speak out and annoy someone: Experiences with intelligent kiosks. In Proceedings of the CHI 2000, 313--320, 2000.
[5]
Glas, N. and Pelachaud, C. "Definitions of Engagement in Human-Agent Interaction". Workshop on Engagement in Human Computer Interaction (ENHANCE - ACII). 2015.
[6]
Lombard, M., Weinstein, L., and Ditton, T. Measuring telepresence: The validity of the temple presence inventory (TPI) in a gaming context. In ISPR, 2011.
[7]
Marsella, S. and Gratch, J. "EMA A process model of appraisal dynamics", Journal of Cognitive Systems Research, vol. 10, no. 1, 2009, pp. 70--90.
[8]
Müller, J., Walter, R., Bailly, G., Nischt, M. and Alt, F. 2012. Looking glass: A field study on noticing interactivity of a shop window. In Proc. of CHI'12, ACM Press, 2012.
[9]
Peters C., Pelachaud, C., Bevacqua, E., and Mancini, M. 2005. Engagement capabilities for ECAs. 2005. In Fourth International Joint Conference on Autonomous Agents & Multi-Agent Systems, AAMAS '05, Workshop: Creating bonds with humanoids, 2005.
[10]
Poggi, I. Mind, hands, face and body: a goal and belief view of multimodal communication. Weidler, 2007.
[11]
Reeves, B. and Nass, C. The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press, New York, USA, 1996.
[12]
Reitberger, W., Meschtscherjakov, A., Mirlacher, T., Scherndl, T., Huber, H., and Tscheligi, M. 2009. A Persuasive Interactive Mannequin for Shop Windows. In Proceedings of the 4th International Conference on Persuasive Technology, pp. 1--8.
[13]
Sidner, C.L., Kidd, C.D., Lee, C.H., Lesh, N.B. Where to Look: A Study of Human-Robot Engagement. ACM International Conference on Intelligent User Interfaces (IUI), ISBN: 1--58113--815--6, pp. 78--84, January 2004.
[14]
Tomitsch, M., Ackad, C., Dawson, O., Hespanhol, L. and Kay, J. 2014. Who cares about the content? An analysis of playful behaviour at a public display. In Proc. PerDis '14. ACM, New York, NY, USA, 160--165.
[15]
Van Erp, J. and Toet, A. 2013. How to touch humans: Guidelines for social agents and robots that can touch. In Humaine Association Conference on Affective Computing and Intelligent Interaction.
[16]
Walter, R., Bailly, G., and Müller, J. 2013. StrikeAPose: Revealing mid-air gestures on public displays. In ACM CHI'13 (2013), 841--850.
Index Terms
- "Hold My Hand, Baby": Understanding Engagement through the Illusion of Touch between Human and Agent
Recommendations
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-MachineMulti-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Tangible NURBS-curve manipulation techniques using graspable handles on a large display
UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technologyThis paper presents tangible interaction techniques for fine-tuning one-to-one scale NURBS curves on a large display for automotive design. We developed a new graspable handle with a transparent groove that allows designers to manipulate virtual curves ...
Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction
Human-Computer Interaction – INTERACT 2015AbstractUsers can interact with large displays in many ways, including touch and mid-air gestures. However, it remains unclear how these ways compare and when users choose one over the other. In a first experiment, we compare touch and mid-air gestures to ...
Comments
Information & Contributors
Information
Published In
May 2016
3954 pages
ISBN:9781450340823
DOI:10.1145/2851581
- General Chairs:
- Jofish Kaye,
- Allison Druin,
- Program Chairs:
- Cliff Lampe,
- Dan Morris,
- Juan Pablo Hourcade
Copyright © 2016 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 May 2016
Check for updates
Author Tags
Qualifiers
- Abstract
Conference
CHI'16
Sponsor:
CHI'16: CHI Conference on Human Factors in Computing Systems
May 7 - 12, 2016
California, San Jose, USA
Acceptance Rates
CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 159Total Downloads
- Downloads (Last 12 months)5
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in