research-article

Public Access

PedVR: simulating gaze-based interactions between a real user and virtual crowds

Authors:

Tanmay Randhavane,

Dinesh ManochaAuthors Info & Claims

VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

Pages 91 - 100

https://doi.org/10.1145/2993369.2993378

Published: 02 November 2016 Publication History

Abstract

We present a novel interactive approach, PedVR, to generate plausible behaviors for a large number of virtual humans, and to enable natural interaction between the real user and virtual agents. Our formulation is based on a coupled approach that combines a 2D multi-agent navigation algorithm with 3D human motion synthesis. The coupling can result in plausible movement of virtual agents and can generate gazing behaviors, which can considerably increase the believability. We have integrated our formulation with the DK-2 HMD and demonstrate the benefits of our crowd simulation algorithm over prior decoupled approaches. Our user evaluation suggests that the combination of coupled methods and gazing behavior can considerably increase the behavioral plausibility.

References

[1]

Adams, R. B., and Kleck, R. E. 2003. Perceived gaze direction and the processing of facial displays of emotion. Psychological Science 14, 6, 644--647.

[2]

Bailenson, J. N., Beall, A. C., Loomis, J., Blascovich, J., and Turk, M. 2005. Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Human communication research 31, 4, 511--537.

[3]

Best, A., Narang, S., and Manocha, D. 2016. Real-time reciprocal collision avoidance with elliptical agents. In 2016 IEEE International Conference on Robotics and Automation (ICRA), 298--305.

[4]

Bönsch, A., Weyers, B., Wendt, J., Freitag, S., and Kuhlen, T. W. 2016. Collision avoidance in the presence of a virtual agent in small-scale virtual environments. In IEEE Symposium on 3D User Interfaces, 145--148.

[5]

Bruderlin, A., and Calvert, T. 1993. Interactive animation of personalized human locomotion. In the Graphics Interface, 17--23.

[6]

Cassell, J. 2001. Embodied conversational agents: representation and intelligence in user interfaces. AI magazine 22, 4, 67.

Digital Library

[7]

Cirio, G., Olivier, A., Marchal, M., and Pettré, J. 2013. Kinematic evaluation of virtual walking trajectories. Visualization and Computer Graphics, IEEE Transactions on 19, 4, 671--680.

Digital Library

[8]

Cronbach, L. J. 1951. Coefficient alpha and the internal structure of tests. psychometrika 16, 3, 297--334.

[9]

Feng, A. W., Xu, Y., and Shapiro, A. 2012. An example-based motion synthesis technique for locomotion and object manipulation. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, ACM, 95--102.

Digital Library

[10]

Gallup, A. C., Chong, A., Kacelnik, A., Krebs, J. R., and Couzin, I. D. 2014. The influence of emotional facial expressions on gaze-following in grouped and solitary pedestrians. Scientific reports 4.

[11]

Garau, M., Slater, M., Pertaub, D.-P., and Razzaque, S. 2005. The responses of people to virtual humans in an immersive virtual environment. Presence: Teleoperators and Virtual Environments 14, 1, 104--116.

Digital Library

[12]

Helbing, D., Farkas, I., and Vicsek, T. 2000. Simulating dynamical features of escape panic. Nature 407, 487--490.

[13]

Jain, S., Ye, Y., and Liu, C. K. 2009. Optimization-based interactive motion synthesis. ACM Trans. Graph. 28, 1 (Feb.), 10:1--10:12.

Digital Library

[14]

Kapadia, M., Marshak, N., Shoulson, A., and Badler, N. I. 2014. ADAPT: The agent development and prototyping testbed. IEEE Transactions on Visualization and Computer Graphics 20, 7 (July), 1035--1047.

Digital Library

[15]

Karamouzas, I., Skinner, B., and Guy, S. J. 2014. Universal power law governing pedestrian interactions. Physical review letters 113, 23, 238701.

[16]

Kennedy, R. S., Lane, N. E., Berbaum, K. S., and Lilienthal, M. G. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3, 203--220.

[17]

Kiefer, A. W., Rhea, C. K., and Warren, W. H. 2013. Vr-based assessment and rehabilitation of functional mobility. In Human Walking in Virtual Environments. Springer, 333--350.

[18]

Kim, S., Bera, A., Best, A., Chabra, R., and Manocha, D. 2016. Interactive and adaptive data-driven crowd simulation. Proc. of IEEE VR.

[19]

Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In ACM transactions on graphics (TOG), vol. 21, ACM, 473--482.

Digital Library

[20]

Llobera, J., Spanlang, B., Ruffini, G., and Slater, M. 2010. Proxemics with multiple dynamic characters in an immersive virtual environment. ACM Transactions on Applied Perception (TAP) 8, 1, 3.

Digital Library

[21]

Narang, S., Randhavane, T., Best, A., Shapiro, A., and Manocha, D., 2016. Fbcrowd: Interactive multi-agent simulation with coupled collision avoidance and human motion synthesis. Available at http://gamma.cs.unc.edu/pedvr.

[22]

Park, C., Best, A., Narang, S., and Manocha, D. 2015. Simulating high-dof human-like agents using hierarchical feedback planner. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, ACM, 153--162.

Digital Library

[23]

Pelechano, N., Stocker, C., Allbeck, J., and Badler, N. 2008. Being a part of the crowd: towards validating vr crowds using presence. In Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, 136--142.

Digital Library

[24]

Pertaub, D.-P., Slater, M., and Barker, C. 2002. An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoperators and virtual environments 11, 1, 68--78.

Digital Library

[25]

Peters, C., Pelachaud, C., Bevacqua, E., Mancini, M., and Poggi, I. 2005. A model of attention and interest using gaze behavior. In International Workshop on Intelligent Virtual Agents, Springer, 229--240.

Digital Library

[26]

Ren, Z., Gai, W., Zhong, F., Pettré, J., and Peng, Q. 2013. Inserting virtual pedestrians into pedestrian groups video with behavior consistency. The Visual Computer 29, 9, 927--936.

Digital Library

[27]

Rivalcoba, J., Gyves, O., Rudomin, I., and Pelechano, N. 2014. Coupling pedestrians with a simulated virtual crowd. In International Conference on Computer Graphics and Applications (GRAPP).

[28]

Romano, D. M., and Brna, P. 2001. Presence and reflection in training: Support for learning to improve quality decision-making skills under time limitations. CyberPsychology & Behavior 4, 2, 265--277.

[29]

Rothbaum, B. O., Hodges, L. F., Ready, D., and Alarcon, R. D. 2001. Virtual reality exposure therapy for vietnam veterans with posttraumatic stress disorder. The Journal of clinical psychiatry 62, 8, 1--478.

[30]

Schadschneider, A. 2002. Cellular automaton approach to pedestrian dynamics - theory. Pedestrian and Evacuation Dynamics, 75--86.

[31]

Shapiro, A. 2011. Building a character animation system. In Motion in Games, Springer Berlin / Heidelberg, J. Allbeck and P. Faloutsos, Eds., vol. 7060 of Lecture Notes in Computer Science, 98--109.

Digital Library

[32]

Slater, M., and Steed, A. 2000. A virtual presence counter. Presence 9, 5, 413--434.

Digital Library

[33]

Slater, M., Usoh, M., and Steed, A. 1995. Taking steps: the influence of a walking technique on presence in virtual reality. ACM Transactions on Computer-Human Interaction (TOCHI) 2, 3, 201--219.

Digital Library

[34]

Slater, M., Guger, C., Edlinger, G., Leeb, R., Pfurtscheller, G., Antley, A., Garau, M., Brogni, A., and Friedman, D. 2006. Analysis of physiological responses to a social situation in an immersive virtual environment. Presence: Teleoperators and Virtual Environments 15, 5, 553--569.

Digital Library

[35]

Snook, G. 2000. Simplified 3D movement and pathfinding using navigation meshes. In Game Programming Gems. Charles River, Hingham, Mass., ch. 3, 288--304.

[36]

Thiebaux, M., Lance, B., and Marsella, S. C. 2009. Real-Time Expressive Gaze Animation for Virtual Humans. In International Conference on Autonomous Agents and Multiagent Systems (AAMAS).

Digital Library

[37]

Treuille, A., Cooper, S., and Popović, Z. 2006. Continuum crowds. In Proc. of ACM SIGGRAPH, 1160--1168.

Digital Library

[38]

Ulicny, B., and Thalmann, D. 2001. Crowd simulation for interactive virtual environments and VR training systems. Springer.

[39]

Van den Berg, J., Patil, S., Sewall, J., Manocha, D., and Lin, M. 2008. Interactive navigation of multiple agents in crowded environments. In Proc. Symp. Interact. 3D Graph. Game., 139--147.

Digital Library

[40]

van den Berg, J., Guy, S. J., Lin, M., and Manocha, D. 2011. Reciprocal n-body collision avoidance. In Inter. Symp. on Robotics Research, 3--19.

[41]

Von Der Pütten, A. M., Krämer, N. C., and Gratch, J. 2009. 1 who's there? can a virtual agent really elicit social presence?

[42]

Welbergen, v. H., Basten, v. B., Egges, A., Ruttkay, Z., and Overmars, M. 2010. Real time character animation: A trade-off between naturalness and control. Computer Graphics Forum 29, 8.

Cited By

Gomez-Nogales GPrieto-Martin MRomero CComino-Trinidad MRamon-Prieto POlivier AHoyet LOtaduy MPettre JCasas D(2024)Resolving Collisions in Dense 3D Crowd AnimationsACM Transactions on Graphics10.1145/3687266Online publication date: 10-Aug-2024
https://dl.acm.org/doi/10.1145/3687266
Bendiksen BLin NKim JDurupinar F(2024)Assessing Human Reactions in a Virtual Crowd Based on Crowd Disposition, Perceived Agency, and User TraitsACM Transactions on Applied Perception10.1145/365867021:3(1-21)Online publication date: 13-Apr-2024
https://dl.acm.org/doi/10.1145/3658670
Huang WWong SVolonte MBabu S(2024)Impact of Socio-Demographic Attributes and Mutual Gaze of Virtual Humans on Users’ Visual Attention and Collision Avoidance in VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332951530:9(6146-6163)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3329515
Show More Cited By

Index Terms

PedVR: simulating gaze-based interactions between a real user and virtual crowds
1. Computing methodologies
  1. Computer graphics
    1. Animation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Simulating high-DOF human-like agents using hierarchical feedback planner
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

We present a multi-agent simulation algorithm to compute the trajectories and full-body motion of human-like agents. Our formulation uses a coupled approach that combines 2D collision-free navigation with high-DOF human motion simulation using a ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

We present SoEs (Sword of Elements), an attachable augmented haptic device for enhancing gaming controller in the immersive first-person game. Generally, Player can easily receive visual and auditory feedback through head-mounted displays (HMD) and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

November 2016

363 pages

ISBN:9781450344913

DOI:10.1145/2993369

Conference Chairs:
Dieter Kranzlmüller
Leibniz Supercomputing Centre (LRZ) and Ludwig-Maximilians-Universität (LMU)
,
Gudrun Klinker
Technical University of Munich (TUM)

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

VRST '16

Sponsor:

VRST '16: 22th ACM Symposium on Virtual Reality Software and Technology

November 2 - 4, 2016

Munich, Germany

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Upcoming Conference

VRST '24

Sponsor:
sigchi
sigchi

30th ACM Symposium on Virtual Reality Software and Technology

October 9 - 11, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
824
Total Downloads

Downloads (Last 12 months)141
Downloads (Last 6 weeks)26

Reflects downloads up to 09 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gomez-Nogales GPrieto-Martin MRomero CComino-Trinidad MRamon-Prieto POlivier AHoyet LOtaduy MPettre JCasas D(2024)Resolving Collisions in Dense 3D Crowd AnimationsACM Transactions on Graphics10.1145/3687266Online publication date: 10-Aug-2024
https://dl.acm.org/doi/10.1145/3687266
Bendiksen BLin NKim JDurupinar F(2024)Assessing Human Reactions in a Virtual Crowd Based on Crowd Disposition, Perceived Agency, and User TraitsACM Transactions on Applied Perception10.1145/365867021:3(1-21)Online publication date: 13-Apr-2024
https://dl.acm.org/doi/10.1145/3658670
Huang WWong SVolonte MBabu S(2024)Impact of Socio-Demographic Attributes and Mutual Gaze of Virtual Humans on Users’ Visual Attention and Collision Avoidance in VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332951530:9(6146-6163)Online publication date: Sep-2024
https://doi.org/10.1109/TVCG.2023.3329515
Bin Ahmad MMohd Suaib NAhmad Rahman A(2024)Position-Aware 3D Facial Expression Mapping Using Ray Casting and BlendshapeEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_376(1442-1446)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_376
Johnson CHaworth B(2023)Cognitive Model of Agent Exploration with Vision and Signage UnderstandingComputer Graphics Forum10.1111/cgf.1463141:8(143-154)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14631
Vilhjálmsson H(2022)Interaction in Social SpaceThe Handbook on Socially Interactive Agents10.1145/3563659.3563662(3-44)Online publication date: 27-Oct-2022
https://dl.acm.org/doi/10.1145/3563659.3563662
Wang CVolonte MEbrahimi ELiu KWong SBabu S(2022)An Evaluation of Native versus Foreign Communicative Interactions on Users’ Behavioral Reactions towards Affective Virtual Crowds2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00053(340-349)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00053
Raimbaud PJovane AZibrek KPacchierotti CChristie MHoyet LPettre JOlivier A(2022)The Stare-in-the-Crowd Effect in Virtual Reality2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00047(281-290)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00047
Zempo KYamazaki AWakatsuki NMizutani KOkada Y(2022)Mouth-in-the-Door: The Effect of a Sound Image of an Avatar Intruding on Personal Space That Deviates in Position From the Visual ImageIEEE Access10.1109/ACCESS.2022.322280410(125772-125791)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3222804
(2022)The Handbook on Socially Interactive AgentsundefinedOnline publication date: 27-Oct-2022
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents