Article

Free access

The virtual human as a multimodal interface

Author:

Daniel ThalmannAuthors Info & Claims

AVI '00: Proceedings of the working conference on Advanced visual interfaces

Pages 14 - 20

https://doi.org/10.1145/345513.345232

Published: 01 May 2000 Publication History

Abstract

This paper discusses the main issues for creating Interactive Virtual Environments with Virtual Humans emphasizing the following aspects: creation of Virtual Humans, gestures, interaction with objects, multimodal communication.

References

[1]

W.S. Lee, N. Magnenat Thalmann, Head Modeling from Pictures and Morphing in 3D with Image Metamorphosis based on triangulation, Proc. Captech98 (Modelling and Motion Capture Techniques for Virtual Environments), (Springer LNAI LNCS Press), Geneva, 1998, pp.254-267.]]

Digital Library

[2]

P. Fua, R. Plaenkers, and D. Thalmann, From Synthesis to Analysis: Fitting Human Animation Models to Image Data, Proc. Computer Graphics International, Canmore, Alberta, Canada, June 1999.]]

Digital Library

[3]

P.Fua, Face Models from Uncalibrated Video Sequences, in: N.Magnenat-Thalmann, D.Thalmann (eds), "Modeling and Motion Capture Techniques for Virtual Environments", Lecture Notes in Artificial Intelligence, No 1537, Springer, 1998, pp.214~228.]]

[4]

R. Boulic et. al. Goal Oriented Design and Correction of Articulated Figure Motionwith the TRACK system, Computer and Graphics, Pergamon Press, Vol. 18, No. 4., pp. 443-452, 1994.]]

[5]

T. Molet, R. Boulic, D. Thalmann, A Real Time Anatomical Converter for Human Motion Capture, Eurographics Workshop on Computer Animation and Simulation, R. Boulic and G. Herdon (Eds), ISBN 3-211- 828-850, Springer-Verlag Wien, pp. 79-94,1996.]]

Digital Library

[6]

P. Kalra, A. Mangili, N. Magnenat Thalmann, D. Thalmann (1992) Simulation of Facial Muscle Actions Based on Rational Free Form Deformation, Proc. Eurographics '92, pp. 59-69.]]

[7]

N. Badler, "Virtual Humans for Animation, Ergonomics, and Simulation", IEEE Workshop on Non-Rigid and Articulated Motion, Puerto Rico, June 97.]]

Digital Library

[8]

W. L. Johnson, and J. Rickel, "Steve: An Animated Pedagogical Agent for Procedural Training in Virtual Environments", Sigart Bulletin, ACM Press, vol. 8, number 1-4, 16-21, 1997.]]

Digital Library

[9]

L. Levison, Connecting Planning and Acting via Object- Specific reasoning, PhD thesis, Dept. of Computer & Information Science, University of Pennsylvania, 1996.]]

Digital Library

[10]

M. Kallmann, D. Thalmann, Modeling Objects for Interaction Tasks, Proc. Eurographics Workshop on Animation and Simulation, Springer, 1998]]

[11]

M. Kallmann, D.Thalmann, A Behavioral Interface to Simulate Agent-Object Interactions in Real-Time, Proc. Computer Animation 99, IEEE Computer Society Press.]]

Digital Library

[12]

J.J. Shah, and M. M~ntyl~i, "Parametric and Feature-Based CAD/CAM", John Wiley & Sons, inc. 1995, ISBN 0-471- 00214-3.]]

Digital Library

[13]

R. Boulic, S. Rezzonico, D. Thalmann, 1996. Multi- Finger Manipulation of Virtual Objects, Proc. ACM Symposium on Virtual Reality Software and Technology VRST'96, Hong-Kong, 1996, pp 67-74.]]

Digital Library

[14]

S. Rezzonico, R. Boulic, Z. Huang, N. Magnenat- Thalmann, D. Thalmann, 1995. Consistent Grasping in Virtual Environment based on the Interactive Grasping Automata, in Virtual Environment. Martin Goebel Editor, pp 107-118, Springer-Verlag Wien, October 1995.]]

[15]

L. Emering, R. Boulic, D. Thalmann, Interacting with Virtual Humans through Body Actions, IEEE Computer Graphics and Applications, 1998, Vol.18, Nol, pp.8-11.]]

Digital Library

[16]

C. Ciressan, D.Thalmann, 3D Model-Based Upper-Body Tracking Using Monocular Camera, internal report, Computer Graphics Lab, EPFL.]]

[17]

E.D. Dickmann and V. Graefe, "Applications of dynamic monocular machine vision", Machine vision and Applications, 1:241-261,1988.]]

Digital Library

[18]

M. Argyle, Bodily Communication, New York: Methuen & Co., I988.]]

[19]

A. Black, P. Taylor (1997) Festival Speech Synthesis System: System Documentation (1.1.1), Technical Report HCRC/TR-83, Human Communication Research Center, University of Edinburgh.]]

[20]

H. Noser, D.Thalmann, A Rule-based Interactive Behavioral Animation System for Humanoids, IEEE Transactions on Visualization and Computer Graphics, Vol.5, No4, pp.281-307.]]

Digital Library

[21]

Hennebert J. and Delacr6taz D.P., (1996) POST: Parallel Object-Oriented Speech Toolkit, Proc. ICSLP 96, Philadelphia]]

[22]

G. Sannier, S. Balcisoy, N. Magnenat-Thalmann, D. Thalmann, VHD: A System for Directing Real-Time Virtual Actors, The Visual Computer, Springer, Vol.15, No 7/8, i999, pp.320-329.]]

[23]

R. Boulic, P. Becheiraz, L. Emering, D. Thalmann (1997) Integration of Motion Control Techniques for Virtual Human and Avatar Real-Time Animation, Proc. VRST'97, pp. 111-118.]]

Digital Library

Cited By

Chaudhary SBalaji AGanesh S(2021)Liquid Interactions: A Conceptual Interaction Framework for the Future NowDesign for Tomorrow—Volume 110.1007/978-981-16-0041-8_33(387-397)Online publication date: 27-Apr-2021
https://doi.org/10.1007/978-981-16-0041-8_33
Schaffer SReithinger NCowan BClark L(2019)Conversation is multimodalProceedings of the 1st International Conference on Conversational User Interfaces10.1145/3342775.3342801(1-3)Online publication date: 22-Aug-2019
https://dl.acm.org/doi/10.1145/3342775.3342801
Metze FWechsung ISchaffer SSeebode JMöller S(2009)Reliable Evaluation of Multimodal Dialogue SystemsProceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques10.1007/978-3-642-02577-8_9(75-83)Online publication date: 14-Jul-2009
https://dl.acm.org/doi/10.1007/978-3-642-02577-8_9
Show More Cited By

Recommendations

Exploring the effects of observed physicality conflicts on real-virtual human interaction in augmented reality
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology

Augmented reality (AR) enables the illusion of computer-generated virtual objects and humans co-existing with us in the real world. Virtual humans (VHs) in AR can further induce an illusion of physicality in the real world due to their form of ...
Virtual human personality masks: a human computation approach to modeling verbal personalities in virtual humans
IVA'12: Proceedings of the 12th international conference on Intelligent Virtual Agents

Modeling virtual humans that can exhibit realistic personalities is becoming increasingly important as virtual humans are being widely used for inter-personal skills education. We present Virtual Human Personality Masks, a system that combines human ...
User experience evaluation of human representation in collaborative virtual environments

Human embodiment/representation in virtual environments (VEs) similarly to the human body in real life is endowed with multimodal input/output capabilities that convey multiform messages enabling communication, interaction and collaboration in VEs. This ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

AVI '00: Proceedings of the working conference on Advanced visual interfaces

May 2000

317 pages

ISBN:1581132522

DOI:10.1145/345513

Chairmen:
Stefano Levialdi
Univ. di Roma “La Sapienza”, Roma, Italy
,
Vita Di Gesù
Univ. di Patermo, Patermo, Italy
,
Laura Tarantino
Univ. degli Studi dell'Aquila, L'Aquila, Italy

Copyright © 2000 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
University of L'Aquila: University of L'Aquila

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 May 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

AVI00

Sponsor:

SIGMM
SIGCHI
University of L'Aquila

AVI00: Advanced Visual Interfaces

Palermo, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
1,167
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)7

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chaudhary SBalaji AGanesh S(2021)Liquid Interactions: A Conceptual Interaction Framework for the Future NowDesign for Tomorrow—Volume 110.1007/978-981-16-0041-8_33(387-397)Online publication date: 27-Apr-2021
https://doi.org/10.1007/978-981-16-0041-8_33
Schaffer SReithinger NCowan BClark L(2019)Conversation is multimodalProceedings of the 1st International Conference on Conversational User Interfaces10.1145/3342775.3342801(1-3)Online publication date: 22-Aug-2019
https://dl.acm.org/doi/10.1145/3342775.3342801
Metze FWechsung ISchaffer SSeebode JMöller S(2009)Reliable Evaluation of Multimodal Dialogue SystemsProceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques10.1007/978-3-642-02577-8_9(75-83)Online publication date: 14-Jul-2009
https://dl.acm.org/doi/10.1007/978-3-642-02577-8_9
Herbelin BLasserre SCiger J(2008) Flying Cities : building a 3D world from vocal input Digital Creativity10.1080/1462626070184757119:1(62-72)Online publication date: Mar-2008
https://doi.org/10.1080/14626260701847571
Gutiérrez A. MGarcía-Rojas AThalmann DVexo FMoccozet LMagnenat-Thalmann NMortara MSpagnuolo M(2007)An ontology of virtual humansThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-006-0093-423:3(207-218)Online publication date: 7-Feb-2007
https://dl.acm.org/doi/10.1007/s00371-006-0093-4
Yang JMarler RBeck SAbdel-Malek KKim J(2006)Real-Time Optimal Reach-Posture Prediction in a New Interactive Virtual EnvironmentJournal of Computer Science and Technology10.1007/s11390-006-0189-321:2(189-198)Online publication date: Mar-2006
https://doi.org/10.1007/s11390-006-0189-3
Latoschik MLazzari GPianesi FCrowley JMase KOviatt S(2005)A user interface framework for multimodal VR interactionsProceedings of the 7th international conference on Multimodal interfaces10.1145/1088463.1088479(76-83)Online publication date: 4-Oct-2005
https://dl.acm.org/doi/10.1145/1088463.1088479
Babu SSchmugge SInugala RRao SBarnes THodges L(2005)MarveLecture Notes in Computer Science10.1007/11550617_11(120-133)Online publication date: 12-Sep-2005
https://dl.acm.org/doi/10.1007/11550617_11
Kim JOh CChung CHwang JLee W(2003)On natural motion editing by a geometric mean filterProceedings of the 2003 international conference on Computational science and its applications: PartII10.5555/1762008.1762059(411-418)Online publication date: 18-May-2003
https://dl.acm.org/doi/10.5555/1762008.1762059
Benes BEspinosa E(2003)Modeling virtual ecosystems with the proactive guidance of agentsProceedings 11th IEEE International Workshop on Program Comprehension10.1109/CASA.2003.1199313(126-131)Online publication date: 2003
https://doi.org/10.1109/CASA.2003.1199313
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents