Article

Free access

More than just a pretty face: affordances of embodiment

Authors:

H. Vilhjálmsson,

H. YanAuthors Info & Claims

IUI '00: Proceedings of the 5th international conference on Intelligent user interfaces

Pages 52 - 59

https://doi.org/10.1145/325737.325781

Published: 09 January 2000 Publication History

Abstract

Prior research into embodied interface agents has found that users like them and find them engaging. In this paper, we argue that embodiment can serve an even stronger function if system designers use actual human conversational protocols in the design of the interface. Communicative behaviors such as salutations and farewells, conversational turn-taking with interruptions, and referring to objects using pointing gestures are examples of protocols that all native speakers of a language already know how to perform and that can thus be leveraged in an intelligent interface. We discuss how these protocols are integrated into Rea, an embodied, multi-modal conversational interface agent who acts as a real-estate salesperson, and we show why embodiment is required for their successful implementation.

References

[1]

Andre, E., Rist, T., Mueller, J. Integrating Reactive and Scripted Behaviors in a Life-Like Presentation Agent. In Proceedings of Agents '98 (Minneapolis/St. Paul, May 1998), ACM Press.

Digital Library

[2]

Azarbayejani, A., Wren, C. and Pentland A. Real-time 3-D tracking of the human body. In Proceedings of IMAGE'COM 96, (Bordeaux, France, May 1996).

[3]

Ball, G., Ling, D., Kurlander, D., Miller, D., Pugh, D., Skelly, T., Stankosky, A., Thiel, D., Van Dantzich, M. and T. Wax. Lifelike computer characters: the persona project at Microsoft Research. In Software Agents, J. M. Bradshaw (ed.), MIT Press, Cambridge, MA, 1997.

Digital Library

[4]

Boyle, E., Anderson, A., and Newlands, A. The Effects of Visibility in a Cooperative Problem Solving Task. Language and Speech 37(l), 1994. l-20.

[5]

Cassell, J. "Embodied Conversation: Integrating Face and Gesture into Automatic Spoken Dialogue Systems." In Luperfoy (ed.), Spoken Dialogue Systems. (to appear) Cambridge, MA: MIT Press.

[6]

Cassell, J., Bickmore, J., Billinghurst, M., Campbell, L., Chang, K., Vilhjalmsson, H., Yan, H. "Embodiment in Conversational Interfaces: Real', ACM CHI 99 Conference Proceedings, Pittsburgh, PA, 1999.

Digital Library

[7]

Cassell, J., Bickmore, J., Campbell, L., Vilhjblmsson, H., Yan, H. Human Conversation as a System Framework: Designing Embodied Conversational Agents, in Cassell, J. editor, Embodied Conversational Agents, MIT Press, Cambridge, MA, 1999

Digital Library

[8]

Cassell, J., Pelachaud, C., Badler, N.I., Steedman, M., Achorn, B., Beckett, T., Douville, B., Prevost, S. and Stone, M. Animated conversation: rule-based generation of facial display, gesture and spoken intonation for multiple conversational agents. Computer Graphics (SIGGRAPH '94 Proceedings), 28(4): 413-420.

Digital Library

[9]

Cassell, J. and Thbrisson, K. The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. Journal of Applied Art@ial Intelligence, in press.

[10]

Cassell, J., Torres, 0. and Prevost, S. Turn taking vs. Discourse Structure: how best to model multimodal conversation. In Wilks (ed.) Machine Conversations. Kluwer, The Hague, 1998.

[11]

Chovil, N. Discourse-Oriented Facial Displays in Conversation. Research on Language and Social Interaction, 25, 163-I 94, 1992.

[12]

CLIPS Reference Manual Version 6.0. Technical Report, Number JSC-25012, Software Technology Branch, Lyndon B. Johnson Space Center, Houston, TX, 1994.

[13]

Finin, T., Fritzson, R. KQML as an Agent Communication Language. In Proceedings of the Third International Conference on Information and Knowledge Management (CIKM'94, November 1994), ACM Press.

Digital Library

[14]

Keisler, S., and Sproull, L. "Social" Human-Computer Interaction. In B. Friedman (Ed) Human Values and the Design of Computer Technology. CSLI Publications, New York, 1997. 191-200.

Digital Library

[15]

Kendon, A. Conducting Interaction: Patterns of behavior in focused encounters. Cambridge University Press. New York. 1990.

[16]

Koda, T., and Maes, P. Agents with faces: The effect of personification. Proceedings of the F$h IEEE International Workshop on Robot and Human Communication (RO-MAN '96). 189-l 94.

[17]

Lester, J., Converse, S., Kahler, S., Barlow, S., Stone, B., and Bhogal, R. The Persona Effect: Affective Impact of Animated Pedagogical Agents. In S. Pemberton (Ed.), Human Factors in Computing Systems: CHI'97 Conference Proceedings. 359-366. New York: ACM Press.

Digital Library

[18]

McNeil1, D. Hand and Mind: What Gestures Reveal About Thought. University of Chicago Press. 1992.

[19]

Prevost, S., Hodgson, P., Cook, L., and Churchill, E. Face-to-Face Interfaces. In M. Altom and M. Williams (Eds.), Human Factors in Computing Systems: CHI'99 Extended Abstracts. 244-245. New York: ACM Press.

Digital Library

[20]

Ricke1, J., and Johnson, L. Task-Oriented Dialogs with Animated Agents in Virtual Reality. In Proceedings of the Worlcshop on Embodied Conversational Characters (Tahoe City, California, October 1998). 39-46.

[21]

Stone, M. Modality in Dialogue: Planning, Pragmatics, and Computation. PhD Thesis, University of Pennsylvania, 1998.

Digital Library

[22]

Thbrisson, K. R. Communicative Humanoids: A Computational Model of Psychosocial Dialogue Skills. PhD Thesis, MIT Media Laboratory, 1996.

Digital Library

[23]

Takeuchi, A., and Naito, T. Situated facial displays: Towards social interaction. In I. Katz, R. Mack, L. Marks, M. Rosson, and J. Nielsen (Eds.), Human Factors in Computing Systems: CHI'95 Conference Proceedings. 450-455. New York: ACM Press.

Digital Library

Cited By

Dermouche SPelachaud C(2022)Leveraging the Dynamics of Non-Verbal Behaviors For Social Attitude ModelingIEEE Transactions on Affective Computing10.1109/TAFFC.2020.298926213:2(1072-1085)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TAFFC.2020.2989262
Stefanidi EFoukarakis MArampatzis DKorozi MLeonidis AAntona M(2019)ParlAmI: A Multimodal Approach for Programming Intelligent EnvironmentsTechnologies10.3390/technologies70100117:1(11)Online publication date: 11-Jan-2019
https://doi.org/10.3390/technologies7010011
Stefanidi ELeonidis APartarakis NAntona M(2019)CasandRA: A Screenplay Approach to Dictate the Behavior of Virtual Humans in AmI EnvironmentsHCI International 2019 – Late Breaking Posters10.1007/978-3-030-30712-7_8(57-66)Online publication date: 20-Sep-2019
https://doi.org/10.1007/978-3-030-30712-7_8
Show More Cited By

Index Terms

More than just a pretty face: affordances of embodiment
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

More than just a pretty face: conversational protocols and the affordances of embodiment

Prior research into embodied interface agents has found that users like them and find them engaging. However, results on the effectiveness of these interfaces for task completion have been mixed. In this paper, we argue that embodiment can serve an even ...
Speech and face-to-face communication - An introduction

This issue focuses on face-to-face speech communication. Research works have demonstrated that this communicative situation is essential to language acquisition and development (e.g. naming). Face-to-face communication is in fact much more than speaking ...
Face-to-face interfaces
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing Systems

Recent work on the social nature of human-computer interactions [3] has prompted research on animated, anthropomorphic characters in user interfaces. Such interfaces may simplify user interactions by allowing them to use and interpret natural face-to-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '00: Proceedings of the 5th international conference on Intelligent user interfaces

January 2000

288 pages

ISBN:1581131348

DOI:10.1145/325737

Chairmen:
Doug Riecken
IBM T.J. Watson Research Center Yorktown Heights, NY; and Rutgers Univ., New Brunswick, NJ
,
David Benyon
Napier Univ., UK
,
Henry Lieberman
Massachusetts Institute of Technology, Cambridge

Copyright © 2000 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 January 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

IUI00

Sponsor:

IUI00: International Conference on Intelligent User Interfaces

January 9 - 12, 2000

Louisiana, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
1,063
Total Downloads

Downloads (Last 12 months)137
Downloads (Last 6 weeks)15

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dermouche SPelachaud C(2022)Leveraging the Dynamics of Non-Verbal Behaviors For Social Attitude ModelingIEEE Transactions on Affective Computing10.1109/TAFFC.2020.298926213:2(1072-1085)Online publication date: 1-Apr-2022
Stefanidi EFoukarakis MArampatzis DKorozi MLeonidis AAntona M(2019)ParlAmI: A Multimodal Approach for Programming Intelligent EnvironmentsTechnologies10.3390/technologies70100117:1(11)Online publication date: 11-Jan-2019
Stefanidi ELeonidis APartarakis NAntona M(2019)CasandRA: A Screenplay Approach to Dictate the Behavior of Virtual Humans in AmI EnvironmentsHCI International 2019 – Late Breaking Posters10.1007/978-3-030-30712-7_8(57-66)Online publication date: 20-Sep-2019
Boelhouwer Avan Dijk JMartens M(2019)Turmoil Behind the Automated WheelHCI in Mobility, Transport, and Automotive Systems10.1007/978-3-030-22666-4_1(3-25)Online publication date: 26-Jul-2019
Dermouche SPelachaud C(2018)Attitude Modeling for Virtual Character Based on Temporal Sequence MiningProceedings of the 5th International Conference on Movement and Computing10.1145/3212721.3212806(1-8)Online publication date: 28-Jun-2018
Illi MKaryda MLucero AMandryk RHancock MPerry MCox A(2018)On Visual GranularityProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173721(1-13)Online publication date: 21-Apr-2018
Krmer NLucas GSchmitt LGratch J(2018)Social snacking with a virtual agent On the interrelation of need to belong and effects of social responsiveness when interacting with artificial entitiesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2017.09.001109:C(112-121)Online publication date: 1-Jan-2018
Bilac MChamoux MLim A(2017)Gaze and filled pause detection for smooth human-robot conversations2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids)10.1109/HUMANOIDS.2017.8246889(297-304)Online publication date: Nov-2017
(2017)The Handbook of Multimodal-Multisensor InterfacesundefinedOnline publication date: 24-Apr-2017
Dermouche SPelachaud CNakano YAndré ENishida TMorency LBusso CPelachaud C(2016)Sequence-based multimodal behavior modeling for social agentsProceedings of the 18th ACM International Conference on Multimodal Interaction10.1145/2993148.2993180(29-36)Online publication date: 31-Oct-2016
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents