research-article

Perception of Culture-specific Gaze Behaviors of Agents and Gender Effects

Authors:

Yuuki TakedaAuthors Info & Claims

HAI '18: Proceedings of the 6th International Conference on Human-Agent Interaction

Pages 138 - 143

https://doi.org/10.1145/3284432.3284472

Published: 04 December 2018 Publication History

Abstract

Gaze plays an important role in human-human communication. Adequate gaze control of a virtual agent is also essential for successful and believable human-agent interaction. Researchers on HAI have developed gaze control models by taking account of gaze duration, frequency, and timing of gaze aversion. However, cultural differences in gaze behaviors have not been focused enough. We aimed to investigate cultural differences in gaze behaviors and their perception by developing virtual agents with Japanese gaze behaviors, American gaze behaviors, and fixed gaze behaviors. We then compared their effects on the impressions of the agents and interactions. Our first experimental results with Japanese participants suggested that the impression of the agent is affected by participants' shyness and familiarity of the gaze patterns performed by the agent. This paper reports the results of our second experiment that investigated the effects of the gender of agents and the gender of participants on perception of culture-specific gaze behaviors. The preliminary results suggests there are differences between the gender of participants and agents on the perception of favorable gaze behaviors. The female participants had a better impression on the agent of the same gender that performed the American gaze behavior, while the male participants preferred the agents with the Japanese gaze behavior. These results indicate favorable gaze behaviors vary according to users' gender and agents' gender.

References

[1]

Argyle, M. and Cook, M. Gaze and mutual gaze. Cambridge University Press Cambridge, 1976.

[2]

Bayliss, A., Paul. M., Cannon, P, and Tipper, S. Gaze cuing and affective judgments of objects: I like what you look at. Psychonomic bulletin & review 13, 6, pp. l06l-1066, 2006.

[3]

Pelachaud, C. and Bilvi, M. Modelling gaze behavior for conversational agents. Ln IVA2003, Springer, pp. 93--100, 2003.

[4]

Lee, J., Marsella, S., Traum, D., Gratch, J., and Lance, B. The rickel gaze model: A window on the mind of a virtual human. In IVA2007, Springer, pp. 296--303, 2007.

Digital Library

[5]

Cafaro, A., Gaito, R., and Vilhjrilmsson, H. Animating idle gaze in public places. In IVA2009, Springer, pp. 250--256, 2009.

Digital Library

[6]

Bee, N., Pollock, C., André, E., and Walker, M. Bossy or Wimpy: Expressing Social Dominance by Combining Gaze and Linguistic Behaviors. In IVA2010, Springer, pp 265--271, 2010.

Digital Library

[7]

Ishii, R, Miyajima, T., and Fujita, K. Avatar's Gaze Control to Facilitate Conversation in Virtual-Space Multi-User Voice Chat System, in J. of Human Interface, 10 (1), pp. 87--94, 2008. (in Japanese)

[8]

K. Ruhland1et al. 2015. A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception. COMPUTER GRAPHICS forum, Volume 00, number 0 (2015), 1--28.

Digital Library

[9]

Rehm, M., Nakano, Y., André, E., Nishida, T., Bee, N., Endrass, B., Wissner, M., Lipi, A., and Huang, H. From Observation to Simulation - Generating Culture Specific Behavior for Interactive Systems. AI&Society 24, Springer, pp. 267--280, 2009.

Digital Library

[10]

Koda, T., Ishida, T., Rehm, M., and Andre, A. Avatar Culture: Cross-Cultural Evaluations of Avatar Facial Expressions. AI & Society, Springer, pp. 237--250, 2009.

Digital Library

[11]

Johnson, L. and Valente, A. Tactical language and culture training systems: Using artificial intelligence to teach foreign languages and cultures. In: Proc of IAAI, pp,73--83, 2008.

Digital Library

[12]

Mascarenhas, S., Degens, N., Paiva, A., Prada, R., Hofstede, J., Beulens, A. and Aylett, R. Modeling culture in intelligent virtual agents, Journal of Autonomous Agents and Multi-Agent Systems, 30(5) pp.931--962, Springer,2016

Digital Library

[13]

Mayo, C., et al. Direction in Interracial Dyadic Communication. In Harper, R.G. et al.(ed.) Meeting of Eastan Psychological Association. 1978.

[14]

Elzinga, R.H. Temporal Organization of Conversation, Sociolinguistics Newsletter, 9, 2 (summer), pp.29--31, 1978.

[15]

Jan, D., Herrera, D., Martinovski, B., Novick, D., & Traum, D. A computational model of culture-specific conversational behavior. In International Workshop on Intelligent Virtual Agents, Springer, Berlin, Heidelberg, pp. 45--56, 2007.

Digital Library

[16]

Obaid, M., Damian, I., Kistler, F., Endrass, B., Wagner, J., & André, E. Cultural behaviors of virtual agents in an augmented reality environment. In International Conference on Intelligent Virtual Agents, Springer, Berlin, Heidelberg, pp. 412--418, 2012.

Digital Library

[17]

Koda, T., Hirano, T. and Ishioh, T. Development and Perception Evaluation of Culture-specific Gaze Behaviors of Virtual Agents. In: J. Beskow et al. (Eds.): IVA 2017, LNAI 10498, Springer, pp. 213--222, 2017.

[18]

Bayliss, A, Pellegrino, G., and Tipper, S. Sex differences in eye gaze and symbolic cueing of attention. The Quarterly Journal of Experimental Psychology, 2005, 58A (4), pp.631--650

[19]

Fukuhara, S. An Experimental Study of Visual Behavior in Social Interaction Distance and the Affiliation Need, The Japanese Group Dynamics Association, 17(1), 30--38, 1977

[20]

Cassell, J., Obed E. T., and Prevost, S. Turn taking versus discourse structure. Machine conversations. Springer US, pp.143--153, 1999.

[21]

Hall, E.T. The hidden dimension, Doubleday and Company, 1966.

[22]

Elfenbein H.A. 2015. In-Group Advantage and Other-Group Bias in Facial Emotion Recognition. In: Mandal M., Awasthi A. (eds) Understanding Facial Expressions in Communication. Springer, New Delhi, pp 57--71.

[23]

Beaupré, MG., and Hess U. 2006. An ingroup advantage for confidence in emotion recognition judgments: the moderating effect of familiarity with the expressions of outgroup members. Pers Soc Psychol Bull. 32(1), pp.16--26.

Cited By

Feijóo-García PWrenn CStuart JDe Siqueira ALok B(2023)Participatory Design of Virtual Humans for Mental Health Support Among North American Computer Science Students: Voice, Appearance, and the Similarity-attraction EffectACM Transactions on Applied Perception10.1145/361396120:3(1-27)Online publication date: 20-Sep-2023
https://dl.acm.org/doi/10.1145/3613961
Miyamoto TKatagami DTanaka TKanamori HYoshihara YFujikake K(2021)Should a Driving Support Agent Provide Explicit Instructions to the User? Video-based Study Focused on Politeness StrategiesProceedings of the 9th International Conference on Human-Agent Interaction10.1145/3472307.3484160(157-164)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3472307.3484160
Nag PYalçın Ö(2020)Gender Stereotypes in Virtual AgentsProceedings of the 20th ACM International Conference on Intelligent Virtual Agents10.1145/3383652.3423876(1-8)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3383652.3423876

Index Terms

Perception of Culture-specific Gaze Behaviors of Agents and Gender Effects
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Intelligent agents
2. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design

Recommendations

Gender Stereotypes in Virtual Agents
IVA '20: Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents

Visual, behavioral and verbal cues for gender are often used in designing virtual agents to take advantage of their stereotypical effects on the users. However, recent studies point towards a more gender-balanced view of stereotypical traits and roles ...
Development and Evaluation of Agent's Adaptive Gaze Behaviors
HAI '20: Proceedings of the 8th International Conference on Human-Agent Interaction

The purpose of this study is to develop gaze behaviors of a virtual agent that adapt to the gaze behavior of a human conversant so that both introverts and extroverts feel comfortable with. The proposed adaptive gaze model changes the agent's gaze ...
Cross-cultural Study of Perception and Acceptance of Japanese Self-adaptors
HAI '16: Proceedings of the Fourth International Conference on Human Agent Interaction

This paper reports our preliminary results of a cross-cultural study of perception and acceptance of cultural specific self-adaptors performed by a virtual agent. There are culturally-defined preferences in self-adaptors and other bodily expressions, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HAI '18: Proceedings of the 6th International Conference on Human-Agent Interaction

December 2018

402 pages

ISBN:9781450359535

DOI:10.1145/3284432

General Chairs:
Michita Imai
Keio University, Japan
,
Tim Norman
University of Southampton, UK
,
Program Chairs:
Elizabeth Sklar
King's College London, UK
,
Takanori Komatsu
Meiji University, Japan

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 December 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

JSPS KAKENHI

Conference

HAI '18

Sponsor:

SIGCHI

HAI '18: 6th International Conference on Human-Agent Interaction

December 15 - 18, 2018

Southampton, United Kingdom

Acceptance Rates

HAI '18 Paper Acceptance Rate 40 of 92 submissions, 43%;

Overall Acceptance Rate 121 of 404 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
164
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Feijóo-García PWrenn CStuart JDe Siqueira ALok B(2023)Participatory Design of Virtual Humans for Mental Health Support Among North American Computer Science Students: Voice, Appearance, and the Similarity-attraction EffectACM Transactions on Applied Perception10.1145/361396120:3(1-27)Online publication date: 20-Sep-2023
https://dl.acm.org/doi/10.1145/3613961
Miyamoto TKatagami DTanaka TKanamori HYoshihara YFujikake K(2021)Should a Driving Support Agent Provide Explicit Instructions to the User? Video-based Study Focused on Politeness StrategiesProceedings of the 9th International Conference on Human-Agent Interaction10.1145/3472307.3484160(157-164)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3472307.3484160
Nag PYalçın Ö(2020)Gender Stereotypes in Virtual AgentsProceedings of the 20th ACM International Conference on Intelligent Virtual Agents10.1145/3383652.3423876(1-8)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3383652.3423876

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents