research-article

A toolset for the authoring, simulation, and rendering of sensory experiences

Authors:

Benjamin Rainer,

Christian Timmerer,

Hermann HellwagnerAuthors Info & Claims

MM '12: Proceedings of the 20th ACM international conference on Multimedia

Pages 1469 - 1472

https://doi.org/10.1145/2393347.2396522

Published: 29 October 2012 Publication History

Abstract

This paper describes a toolset for the authoring, simulating, and rendering of multimedia content annotated with Sensory Effect Metadata (SEM) descriptions as specified in Part 3 of the MPEG V standard. This part of MPEG-V standardizes the description of sensory effects (e.g., light, wind) in order to be rendered on sensory devices (e.g., fans, vibration chairs) aiming at generating a sensory experience stimulating possibly all human senses. Our implementation comprises a toolset to author sensory effects associated with multimedia content and the simulation thereof. Furthermore, it includes a library, a standalone player, and a Web browser plug-in which enables the playback and rendering of sensory effects on off-the-shelf rendering devices and in various contexts. All software modules are available under the GNU General Public License (GPL) v3 and the GNU Lesser General Public License (LGPL) v3 respectively.

References

[1]

amBX UK Ltd. http://www.ambx.com. (Last access: April 2012).

[2]

Bateman, R. Firebreath Project. http://ww.firebreath.org/. (Last access: May 2012).

[3]

Choi, B., Lee, E.-S., and Yoon, K. 2011. Streaming Media with Sensory Effect. Int'l Conference on Information Science and Applications (ICISA), Jeju Island, Korea.

[4]

Cyborg Gaming Lights. http://www.cyborggaming.com. (Last access: April 2012).

[5]

Dale Air. http://www.daleair.com. (Last access: April 2012).

[6]

FFmpeg. http://www.ffmpeg.org. (Last access: April 2012).

[7]

Ghinea, G. and Ademoye, O. A. 2010. Olfaction-enhanced Multimedia: Perspectives and Challenges. Multimedia Tools and Applications. Springer, Netherlands, 601--626.

Digital Library

[8]

Hickson, I. W3C Working Draft. http://www.w3c.org/TR/HTML5. (Last access: May 2012).

[9]

ISO/IEC 23005. 2011. Information technology - Media context and control.

[10]

Java Framework for the vlc Media Player (VLCJ). http://code.google.com/p/vlcj/. (Last access: April 2012).

[11]

Rainer, B., Waltl, M., Cheng, E., Shujau, M., Timmerer, C., Davis, S., Burnett, I., Ritz, C., and Hellwagner, H. 2012. Investigating the Impact of Sensory Effects on User Quality of Experience and Emotional Response in Web Videos. Proceedings of the 4th Int'l Workshop on Quality of Multimedia Experience (QoMEX), Yarra Valley, Australia.

[12]

Scent Sciences. http://www.scentsciences.com. (Last access: April 2012).

[13]

Sensory Acumen. http://www.sensoryacumen.com. (Last access: April 2012).

[14]

Sensory Experience Lab (SELab). http://selab.itec.aau.at. (Last access: April 2012).

[15]

Seuntiens, P., Vogels, I., and van Keersop, A. 2007. Visual Experience of 3D-TV with Pixelated Ambilight. Proceeding of the 10th Annual Int'l Workshop on Presence. 339--344.

[16]

Universal Studios. http://www.universalstudios.com. (Last access: April 2012).

[17]

Waltl, M., Timmerer, C., and Hellwagner, H. 2010. Improving the Quality of Multimedia Experience through Sensory Effects. Proceedings of the 2nd Int'l Workshop on Quality of Multimedia Experience (QoMEX), Trondheim, Norway.

[18]

Waltl, M., Timmerer, C., and Hellwagner, H. 2010. Increasing the User Experience of Multimedia Presentations with Sensory Effects. Proceedings of the 11th Int'l Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Desenzano del Garda, Italy.

[19]

Waltl, M. Timmerer, C., Rainer, B., and Hellwagner, H. 2012. Sensory Effect Dataset and Test Setups. Proceedings of the 4th Int'l Workshop on Quality of Multimedia Experience (QoMEX), Yarra Valley, Australia.

[20]

Waltl, M., Timmerer, C., Rainer, B., and Hellwagner, H. 2012. Sensory Effects for Ambient Experiences in the World Wide Web. Multimedia Tools and Applications, Springer, Netherlands, 1--20.

Cited By

Spence CGao Y(2024)Augmenting home entertainment with digitally delivered touchi-Perception10.1177/2041669524128147415:5Online publication date: 17-Oct-2024
https://doi.org/10.1177/20416695241281474
Xiao JXu KHu MLiao LWang ZLin CWang MSatoh S(2023)Progressive Motion Boosting for Video Frame InterpolationIEEE Transactions on Multimedia10.1109/TMM.2022.323331025(8076-8090)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3233310
Marfil DBoronat FGonzalez JSapena A(2022)Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV ScenariosIEEE Access10.1109/ACCESS.2022.319417010(79071-79089)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3194170
Show More Cited By

Index Terms

A toolset for the authoring, simulation, and rendering of sensory experiences
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

An end-to-end tool chain for Sensory Experience based on MPEG-V

This paper provides an overview of our research conducted in the area of Sensory Experience including our implementations using MPEG-V Part 3 entitled ''Sensory Information''. MPEG-V Part 3 introduces Sensory Experience as a tool to increase the Quality ...
Sensory effects for ambient experiences in the World Wide Web

More and more content in various formats becomes available via the World Wide Web (WWW). Currently available Web browsers are able to access and interpret these contents (i.e., Web videos, text, image, and audio). These contents stimulate only senses ...
Sensory Experience for Videos on the Web
MMWEB '11: Proceedings of the 2011 Workshop on Multimedia on the Web

More and more multimedia content is becoming available via the World Wide Web (WWW). These contents stimulate only senses like hearing or vision. Recently, it has been proposed to stimulate also other senses while consuming multimedia content, through ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '12: Proceedings of the 20th ACM international conference on Multimedia

October 2012

1584 pages

ISBN:9781450310895

DOI:10.1145/2393347

General Chairs:
Noboru Babaguchi
Osaka University, Japan
,
Kiyoharu Aizawa
The University of Tokyo, Japan
,
John Smith
IBM, USA
,
Program Chairs:
Shin'ichi Satoh
National Institute of Informatics, Japan
,
Thomas Plagemann
University of Oslo, Norway
,
Xian-Sheng Hua
Microsoft, USA
,
Rong Yan
Facebook, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '12

Sponsor:

SIGMM

MM '12: ACM Multimedia Conference

October 29 - November 2, 2012

Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
187
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Spence CGao Y(2024)Augmenting home entertainment with digitally delivered touchi-Perception10.1177/2041669524128147415:5Online publication date: 17-Oct-2024
https://doi.org/10.1177/20416695241281474
Xiao JXu KHu MLiao LWang ZLin CWang MSatoh S(2023)Progressive Motion Boosting for Video Frame InterpolationIEEE Transactions on Multimedia10.1109/TMM.2022.323331025(8076-8090)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3233310
Marfil DBoronat FGonzalez JSapena A(2022)Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV ScenariosIEEE Access10.1109/ACCESS.2022.319417010(79071-79089)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3194170
Peschanskyi DBudonnyi PSulema YAndres FPester A(2022)Temporal Data Processing with ASAMPL Programming Language in Mulsemedia ApplicationsArtificial Intelligence and Online Engineering10.1007/978-3-031-17091-1_48(473-485)Online publication date: 15-Oct-2022
https://doi.org/10.1007/978-3-031-17091-1_48
Danieau FGuillotel PDumas OLopez TLeroy BMollet NMorishima SItoh YShiratori TYue YLindeman R(2018)HFX studioProceedings of the 24th ACM Symposium on Virtual Reality Software and Technology10.1145/3281505.3281518(1-9)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3281505.3281518
Guillotel PDanieau FFleureau JRouxel IRonfard RChristie MGalvane QJhala A(2016)Introducing basic principles of haptic cinematography and editingProceedings of the Eurographics Workshop on Intelligent Cinematography and Editing10.5555/3056983.3056986(15-21)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.5555/3056983.3056986
Plerou AVlamos P(2016)Evaluation of Mathematical Cognitive Functions with the Use of EEG Brain ImagingSpecial and Gifted Education10.4018/978-1-5225-0034-6.ch094(2165-2186)Online publication date: 2016
https://doi.org/10.4018/978-1-5225-0034-6.ch094
Deliyannis IPapaioannou G(2016)Augmented Reality Edutainment Systems for Open-Space Archaeological EnvironmentsExperimental Multimedia Systems for Interactivity and Strategic Innovation10.4018/978-1-4666-8659-5.ch015(307-323)Online publication date: 2016
https://doi.org/10.4018/978-1-4666-8659-5.ch015
Plerou AVlamos P(2016)Evaluation of Mathematical Cognitive Functions with the Use of EEG Brain ImagingExperimental Multimedia Systems for Interactivity and Strategic Innovation10.4018/978-1-4666-8659-5.ch014(284-306)Online publication date: 2016
https://doi.org/10.4018/978-1-4666-8659-5.ch014
Murray NLee BQiao YMuntean G(2016)Olfaction-Enhanced MultimediaACM Computing Surveys10.1145/281645448:4(1-34)Online publication date: 2-May-2016
https://dl.acm.org/doi/10.1145/2816454
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten