research-article

Semantic framework for interactive animation generation

Authors:

Jian Jun ZhangAuthors Info & Claims

VRCAI '16: Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1

Pages 137 - 145

https://doi.org/10.1145/3013971.3013998

Published: 03 December 2016 Publication History

Abstract

As a key technology, interactive animation has been widely used in Virtual Reality nowadays which is important for the success of various VR applications. However, despite many years history and the ability to produce stunning illusory and immersive effects for many VR applications, interactive animation generation remains one of the most labour-intensive ones. As a tedious task, its generation requires a complicated systematic procedure. Its inherent functional features involve a lot of complex technical problems: various aspects of requirements have to be handled, from the HCI technologies to the efficient management of animation data assets. With the continual evolvement of the complexity of current interactive VR technologies and animation practices, systematic and standardised description is imperative to provide a clear understanding of this production process.

In this paper, a semantic framework is constructed at an abstract and semantic level using ontological methods for modelling the construction of interactive animation generation. To facilitate the process of interactive animation generation and improve its reusability and modularity, domain-specific ontologies based on the semantic framework are defined by formalising the multimodal interaction method and the construction of the animation data assets repository at the ontological implementation level. Finally, hand-gesture-based interactive animation is generated in the context of traditional Chinese shadow play, which involves novel functional features like hand-gesture-based interactive control and ontology-based intelligent animation assets management.

References

[1]

Arndt, R., Troncy, R., Staab, S. and Hardman, L., 2009. Comm: A core ontology for multimediaannotation. In Handbook on Ontologies (pp. 403--421). Springer Berlin Heidelberg.

[2]

Borst, W.N., 1997. Construction of engineering ontologies for knowledge sharing and reuse. Universiteit Twente.

[3]

De Boeck, J., Raymaekers, C. and Coninx, K., 2006, October. Comparing NiMMiT and data-driven notations for describing multimodal interaction. InInternational Workshop on Task Models and Diagrams for User Interface Design (pp. 217--229). Springer Berlin Heidelberg.

Digital Library

[4]

Falcidieno, B., Spagnuolo, M., Alliez, P., Quak, E., Vavalis, E. and Houstis, C., 2004, November. Towards the Semantics of Digital Shapes: The AIM@SHAPE Approach. In EWIMT.

[5]

Flotyński, J. and Walczak, K., 2013, June. Conceptual semantic representation of 3d content. In International Conference on Business Information Systems (pp. 244--257). Springer Berlin Heidelberg.

[6]

Flotyński, J. and Walczak, K., 2013, December. Semantic modelling of interactive 3d content. In Proceedings of the 5th Joint Virtual Reality Conference (pp. 41--48). Eurographics Association.

Digital Library

[7]

Flotyński, J. and Walczak, K., 2014, April. Multi-platform semantic representation of interactive 3d content. In Doctoral Conference on Computing, Electrical and Industrial Systems (pp. 63--72). Springer Berlin Heidelberg.

[8]

Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D. and Jacobs, D., 2003. A search engine for 3D models. ACM Transactions on Graphics (TOG), 22(1), pp.83--105.

Digital Library

[9]

Google 3D Warehouse, Available at: https://3dwarehouse.sketchup.com/. Retrieved 21, Mar, 2016.

[10]

Gruber, T.R., 2008. Ontology. In Encyclopedia of Database Systems. L. Liu and MT Ozsu. Eds.: Springer-Verlag.

[11]

Gutiérrez, M., Thalmann, D., Vexo, F., Moccozet, L., Magnenat-Thalmann, N., Mortara, M. and Spagnuolo, M., 2005. An ontology of virtual humans: incorporating semantics into human shapes. In Proc. Workshop towards Semantic Virtual Environments (SVE05) (No. VRLAB-CONF-2007-004, pp. 56--57).

[12]

Irawati, S., Calderón, D. and Ko, H., 2006, June. Spatial ontology for semantic integration in 3D multimodal interaction framework. In Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications (pp. 129--135). ACM.

Digital Library

[13]

Li, Z. and Ramani, K., 2007. Ontology-based design information extraction and retrieval. AI EDAM: Artificial Intelligence for Engineering Design, Analysis, and Manufacturing, 21(02), pp.137--154.

[14]

Liang, H., Chang, J., Kazmi, I.K., Zhang, J.J. and Jiao, P., 2016. Hand gesture-based interactive puppetry system to assist storytelling for children.The Visual Computer, pp.1--15.

[15]

Liang, H., Sit, J., Chang, J. and Zhang, J.J., 2016. Computer animation data management: Review of evolution phases and emerging issues. International Journal of Information Management, 36(6), pp.1089--1100.

Digital Library

[16]

Ohbuchi, R., Yamamoto, A. and Kobayashi, J., 2007, September. Learning semantic categories for 3D model retrieval. In Proceedings of the international workshop on Workshop on multimedia information retrieval (pp. 31--40). ACM.

Digital Library

[17]

Ontology for Media Resources 1.0. Available at: http://www.w3.org/TR/mediaont-10/. Retrieved 18, Mar, 2016.

[18]

Otto, K.A., 2005. The semantics of multi-user virtual environments. In Proc. of the Workshop towards Semantic Virtual Environments.

[19]

Pellens, B., De Troyer, O., Bille, W., Kleinermann, F. and Romero, R., 2005, October. An ontology-driven approach for modeling behavior in virtual environments. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems" (pp. 1215--1224). Springer Berlin Heidelberg.

Digital Library

[20]

protege.stanford.edu, A free, open-source ontology editor and framework for building intelligent systems, Available at: http://protege.stanford.edu/. Retrieved 15, Sep, 2016.

[21]

Ramaprasad, A. and Papagari, S.S., 2009, May. Ontological design. InProceedings of the 4th International Conference on Design Science Research in Information Systems and Technology (p. 5). ACM.

Digital Library

[22]

Shadow Play, Available at: http://www.chinatraveldesigner.com/travel-guide/culture/chinese-opera/shadow-play.htm Retrieved 15, Sep, 2016.

[23]

SPARQL Query Language for RDF, Available at: https://www.w3.org/TR/rdf-sparql-query//. Retrieved 21, Mar, 2016.

[24]

SWRL: A Semantic Web Rule Language, Available at: https://www.w3.org/Submission/SWRL/. Retrieved 21, Mar, 2016.

[25]

Tangelder, J.W. and Veltkamp, R.C., 2008. A survey of content based 3D shape retrieval methods. Multimedia tools and applications, 39(3), pp.441--471.

Digital Library

[26]

Thomas, B.H., 2012. A survey of visual, mixed, and augmented reality gaming. Computers in Entertainment (CIE), 10(1), p.3.

Digital Library

[27]

Wiebusch, D., Fischbach, M., Latoschik, M.E. and Tramberend, H., 2012, December. Evaluating scala, actors, & ontologies for intelligent realtime interactive systems. In Proceedings of the 18th ACM symposium on Virtual reality software and technology (pp. 153--160). ACM.

Digital Library

[28]

www.w3.org, 2012, Available at: https://www.w3.org/2012/pdf/REC-owl2-overview-20121211.pdf. Retrieved 15, Sep, 2016.

Cited By

Yao ZLu YSun QLyu SLi HYang XWang XLiu GMi H(2024)Lumina: A Software Tool for Fostering Creativity in Designing Chinese Shadow PuppetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676426(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676426
Yao ZLyu SLu YSun QLi HWang XLiu GMi H(2024)ShadowMaker: Sketch-Based Creation Tool for Digital Shadow PuppetryExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648657(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3648657

Recommendations

Semantic framework for interactive animation generation and its application in virtual shadow play performance

Designing and creating complex and interactive animation is still a challenge in the field of virtual reality, which has to handle various aspects of functional requirements (e.g. graphics, physics, AI, multimodal inputs and outputs, and massive data ...
Semi-automatic Generation of an Object-Oriented API Framework over Semantic Repositories
INCOS '15: Proceedings of the 2015 International Conference on Intelligent Networking and Collaborative Systems

This paper presents a system able to generate an abstraction framework over a RDF-based, semantic triplestore, offering Object-Oriented Application Programming Interfaces to be made available for external applications. The system only requires a well-...
Modeling Short-Term Dynamics and Variability for Realistic Interactive Facial Animation

Modern modeling and rendering techniques have produced nearly photorealistic face models, but truly expressive digital faces also require natural-looking movements. Virtual characters in today's applications often display unrealistic facial expressions. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '16: Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry - Volume 1

December 2016

381 pages

ISBN:9781450346924

DOI:10.1145/3013971

Conference Chairs:
Yiyu Cai
Nanyang Technological University, Singapore
,
Daniel Thalmann
École Polytechnique Fédérale de Lausanne, Switzerland and Nanyang Technological University, Singapore

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 December 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRCAI '16

Sponsor:

SIGGRAPH

VRCAI '16: The 15th International Conference on Virtual-Reality Continuum and its Applications in Industry

December 3 - 4, 2016

Zhuhai, China

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
159
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yao ZLu YSun QLyu SLi HYang XWang XLiu GMi H(2024)Lumina: A Software Tool for Fostering Creativity in Designing Chinese Shadow PuppetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676426(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676426
Yao ZLyu SLu YSun QLi HWang XLiu GMi H(2024)ShadowMaker: Sketch-Based Creation Tool for Digital Shadow PuppetryExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648657(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3648657

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents