research-article

Multiple-Scent Enhanced Multimedia Synchronization

Authors:

Gabriel-Miro MunteanAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 11, Issue 1s

Article No.: 12, Pages 1 - 28

https://doi.org/10.1145/2637293

Published: 01 October 2014 Publication History

Abstract

This study looked at users' perception of interstream synchronization between audiovisual media and two olfactory streams. The ability to detect skews and the perception and impact of skews on user Quality of Experience (QoE) is analyzed. The olfactory streams are presented with the same skews (i.e., delay) and with variable skews (i.e., jitter and mix of scents). This article reports the limits beyond which desynchronization reduces user-perceived quality levels. Also, a minimum gap between the presentations of consecutive scents is identified, necessary to ensuring enhanced user-perceived quality. There is no evidence (not considering scent type) that overlapping or mixing of scents increases user QoE levels for olfaction-enhanced multimedia.

References

[1]

Y. Ariyakul and T. Nakamoto. 2011. Olfactory display using a miniaturized pump and a SAW atomizer for presenting low-volatile scents. In Proceedings of the IEEE Virtual Reality Conference. 193--194.

Digital Library

[2]

L. R. Blackwell. 1997. The role of olfactory cues and their effects on food choice and acceptability. Ph.D. Dissertation, Bournemouth University, Poole. http://eprints.bournemouth.ac.uk/407/.

[3]

S. Borromeo, J. A. Hernandez-Tamames, G. Luna, F. Machado, N. Malpica, and A. Toledano. 2010. Objective assessment of olfactory function using functional magnetic resonance imaging (fMRI). IEEE Trans. Instrum. Meas. 59, 10, 2602--2608.

[4]

S. Brewster, D. Mcgookin, and C. Miller. 2006. Olfoto: Designing a smell-based interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 653--662.

Digital Library

[5]

J. Cha, M. Eid, A. Barghout, A. S. M. Mahfujur Rahman, and A. El Saddik. 2009. HugMe: Synchronous haptic teleconferencing. In Proceedings of the 17th ACM International Conference on Multimedia (MM'09). 1135--1136.

Digital Library

[6]

J.-C. Chebat and R. Michon. 2003. Impact of ambient odors on mall shoppers' emotions, cognition, and spending: A test of competitive causal theories. J. Bus. Res. 56, 7, 529--539.

[7]

G. Dann and J. K. S. Jacobsen. 2003. Tourism smellscapes. Tour. Geograph. 5, 1, 3--25.

[8]

M. H. Depledge, R. J. Stone, and W. J. Bird. 2011. Can natural and virtual environments be used to promote improved human health and wellbeing&quest; Environ. Sci. Technol. 45, 11, 4660--4665.

[9]

M. Eid, J. Cha, and A. El Saddik. 2011. Admux: An adaptive multiplexer for haptic-audio-visual-data communication. IEEE Trans. Instrum. Meas. 60, 1, 21--31.

[10]

B. Emsenhuber. 2011. The olfactory medium: Smell in human-computer interaction. Sci. Technol. Innov. Stud. 7, 1.

[11]

Exhalia. 2013. www.exhalia.com (Last accessed March 2013.)

[12]

M. Gerardi, B. O. Rothbaum, K. Ressler, M. Heekin, and A. Rizzo. 2008. Virtual reality exposure therapy using a virtual Iraq: Case report. J. Trauma Stress 21, 2, 209--213.

[13]

G. Ghinea and O. A. Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimedia Comput. Commun. Appl. 8, 1, Article 2.

Digital Library

[14]

G. Ghinea and O. A. Ademoye. 2010. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man Cybernet. Part A: Systems and Humans 40, 4, 657--663.

Digital Library

[15]

G. Ghinea and O. A. Ademoye. 2011. Olfaction-enhanced multimedia: Perspectives and challenges. Multimedia Tools Appl. 55, 3, 601--626.

Digital Library

[16]

N. Guéguen and C. Petr. 2006. Odors and consumer behavior in a restaurant. Int. J. Hospitality Manag. 25, 2, 335--339.

[17]

A. Haehner, T. Hummel, and H. Reichmann. 2009. Olfactory dysfunction as a diagnostic marker for Parkinson's disease. Expert Rev. Neurother. 9, 12, 1773--1779.

[18]

A. R. Hirsch. 2006. Effects of ambient odors on slot-machine usage in a Las Vegas casino. Psychol. Market. 12, 7, 585--594.

[19]

S. Hoshino, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2011. QoE assessment in olfactory and haptic media transmission: Influence of inter-stream synchronization error. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability. 1--6.

[20]

Z. Huang, A. Arefin, P. Agarwal, K. Nahrstedt, and W. Wu. 2012. Towards the understanding of human perceptual quality in tele-immersive shared activity. In Proceedings of the 3rd ACM Multimedia Systems Conference (MMSys'12). 29--34.

Digital Library

[21]

ISO. 2010. ISO/IEC FDIS 23005-3 Information Technology -- Media context and control- Part 3: Sensory information. International Standards Organization (ISO).

[22]

ISO. 2007. ISO/IEC 8589 Sensory analysis—General guidance for the design of test rooms. International Standards Organization (ISO).

[23]

ISO. 2008. ISO 5492:2008 Sensory analysis—Vocabulary. International Standards Organization (ISO).

[24]

ISO. 2006. ISO 5496:2006 Sensory analysis—Methodology—Initiation and training of assessors in the detection and recognition of odours. International Standards Organization (ISO).

[25]

ITU. 2002. ITU-T BT.500. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union (ITU).

[26]

ITU. 2008. ITU-T P.910. Subjective video quality assessment methods for multimedia applications. International Telecommunication Union (ITU).

[27]

J. N. Kaye. 2001. Symbolic olfactory display. M. S. Thesis, Massachusetts Institute of Technology, Cambridge, MA.

[28]

J.-S. Lee, L. Goldmann, and T. Ebrahimi. 2011. A new analysis method for paired comparison and its application to 3D quality assessment. In Proceedings of the 19th ACM International Conference on Multimedia (MM'11). 1281--1284.

Digital Library

[29]

B. Longino. 1999. A century in the arts. Atlanta J. Constitut.

[30]

N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013a. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of the 4th ACM Multimedia Systems Conference (MMSys'13). 162--171.

Digital Library

[31]

N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013b. Age and gender influence on perceived olfactory and visual media synchronization. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME'13). 1--6.

[32]

N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014a. Olfaction enhanced multimedia: A survey of application domains, displays and research challenges. ACM Comput. Surv. (To appear)

[33]

N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014b. User-profile-based perceived olfactory and visual media synchronization. ACM Trans. Multimedia Comput. Commun. Appl. 10, 1s, Article 11.

Digital Library

[34]

N. Murray. 2013. Questionnaire for special sssue on MulseMedia (TOMCCAP). http://www.niallmurray.info/Research/appendix.

[35]

T. Nakamoto, S. Otaguro, M. Kinoshita, M. Nagahama, K. Ohinishi, and T. Ishida. 2008. Cooking up an interactive olfactory game display. IEEE Comput. Graph. Appl. 28, 1, 75--78.

Digital Library

[36]

T. Nakamoto and H. P. D. Minh. 2007. Improvement of olfactory display using solenoid valves. In Proceedings of the IEEE Virtual Reality Conference (VR'07). 179--186.

[37]

T. Nakamoto and K. Yoshikawa. 2006. Movie with scents generated by olfactory display using solenoid valves. IEICE Trans. Fund. Electr. Commun. Comput. Sci. E89-A, 11, 3327--3332.

Digital Library

[38]

T. Narumi, S. Nishizaka, T. Kajinami, T. Tanikawa, and M. Hirose. 2011. Augmented reality flavors: Gustatory display based on edible marker and cross-modal interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). 93--102.

Digital Library

[39]

D. Noguchi, S. Sugimoto, Y. Bannai, and K. Okada. 2011. Time characteristics of olfaction in a single breath. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). 83--92.

Digital Library

[40]

J. Pair, B. Allen, M. Dautricourt, A. Treskunov, M. Liewer, K. Graap, and G. Reger. 2006. A virtual reality exposure therapy application for Iraq war post traumatic stress disorder. In Proceedings of the IEEE Virtual Reality Conference. 67--72.

Digital Library

[41]

L. Shams and A. R. Seitz. 2008. Benefits of multisensory learning. Trends Cogn. Sci. 12, 11, 411--417.

[42]

B. S. Spencer. 2006. Incorporating the sense of smell into patient and haptic surgical simulators. IEEE Trans. Inf. Technol. Biomed. 10, 1, 168--173.

Digital Library

[43]

R. Steinmetz. 1996. Human perception of jitter and media synchronization. IEEE J. Select. Areas Commun. 14, 1, 61--72.

Digital Library

[44]

S. Sugimoto, D. Noguchi, Y. Bannai, and K. Okada. 2010. Ink jet olfactory display enabling instantaneous switches of scents. In Proceedings of the ACM International Conference on Multimedia (MM'10). 301--310.

Digital Library

[45]

J. Tillotson. 2008. Scentsory Design®: Scent whisper and fashion fluidics. In Transdisciplinary Digital Art. Sound, Vision and the New Screen, Communication in Computer and Information Science, Vol. 7, Springer-Verlag, Berlin Heidelberg, 403--417.

[46]

C. Timmerer, M. Waltl, B. Rainer, and H. Hellwagner. 2012. Assessing the quality of sensory experience for multimedia presentations. Signal Process. Image Commun. 27, 8, 909--916.

Digital Library

[47]

A. Tomono, S. Yamamoto, M. Utsunomiya, D. Ikei, Y. Yanagida, and K. Hosaka. 2004. Effect that the image media with scent gives to contents understanding. In Proceedings of the Human Interface Symposium. 249--254.

[48]

D. Warnock. 2011. A subjective evaluation of multimodal notifications. In Proceedings of the 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth'11). 461--468.

[49]

D. A. Washburn and L. M. Jones. 2004. Could olfactory displays improve data visualization&quest; Comput. Sci. Eng. 6, 6, 80--83.

Digital Library

[50]

D. A. Washburn. 2003. Olfactory use in virtual environment training. Model. Simul. 2, 3, 19--25.

Cited By

Zheng YZhang WSong WWang XFu C(2024)Encrypted Video Search with Single/Multiple WritersACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3643887Online publication date: 5-Feb-2024
https://doi.org/10.1145/3643887
Silveira ARaisamo RSpyridonis FCovaci AGhinea GSantos C(2023)Guidelines for conducting biofeedback-enhanced QoE studies in mulsemedia-enhanced virtual realityProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617029(32-40)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3617023.3617029
Wu MTeng WFan CPei SLi PLv Z(2023)An Investigation of Olfactory-Enhanced Video on EEG-Based Emotion RecognitionIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2023.325386631(1602-1613)Online publication date: 2023
https://doi.org/10.1109/TNSRE.2023.3253866
Show More Cited By

Index Terms

Multiple-Scent Enhanced Multimedia Synchronization
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

User-profile-based perceived olfactory and visual media synchronization
Special issue of best papers of ACM MMSys 2013 and ACM NOSSDAV 2013

As a step towards enhancing users' perceived multimedia quality levels, this article presents the results of a study which looked at user's perception of inter-stream synchronization between scent and video. The ability to detect and the perception of ...
Subjective evaluation of olfactory and visual media synchronization
MMSys '13: Proceedings of the 4th ACM Multimedia Systems Conference

As a step towards enhancing users' perceived multimedia quality levels beyond the level offered by the classic audiovisual systems, the authors present the results of an experimental study which looked at user's perception of inter-stream ...
Audio Masking Effect on Inter-Component Skews in Olfaction-Enhanced Multimedia Presentations

Media-rich content plays a vital role in consumer applications today, as these applications try to find new and interesting ways to engage their users. Video, audio, and the more traditional forms of media content continue to dominate with respect to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 11, Issue 1s

Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and Applications

September 2014

260 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/2675060

Editors:
Ralf Steinmetz
Technische Universität Darmstadt, Germany
,
Gheorghita Ghinea,
Christian Timmerer,
Weisi Lin,
Stephen Gulliver,
Zheng-Jun Zha
Institute of Intelligent Machines, Chinese Academy of Sciences
,
Lei Zhang
Bing Multimedia Search, Microsoft Corporation
,
Max Mühlhäuser
Department of Computer Science, Technische Universität Darmstadt
,
Alan F. Smeaton
Insight Centre for Data Analytics, Dublin City University

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2014

Accepted: 01 May 2014

Revised: 01 March 2014

Received: 01 November 2013

Published in TOMM Volume 11, Issue 1s

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
371
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zheng YZhang WSong WWang XFu C(2024)Encrypted Video Search with Single/Multiple WritersACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3643887Online publication date: 5-Feb-2024
https://doi.org/10.1145/3643887
Silveira ARaisamo RSpyridonis FCovaci AGhinea GSantos C(2023)Guidelines for conducting biofeedback-enhanced QoE studies in mulsemedia-enhanced virtual realityProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617029(32-40)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3617023.3617029
Wu MTeng WFan CPei SLi PLv Z(2023)An Investigation of Olfactory-Enhanced Video on EEG-Based Emotion RecognitionIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2023.325386631(1602-1613)Online publication date: 2023
https://doi.org/10.1109/TNSRE.2023.3253866
González Salinas JBoronat Seguí FSapena Piera APastor Castillo F(2023)Key Technologies for Networked Virtual EnvironmentsMultimedia Tools and Applications10.1007/s11042-023-15160-z82:27(41471-41537)Online publication date: 3-Apr-2023
https://doi.org/10.1007/s11042-023-15160-z
Salgado DFlynn RNaves EMurray NMurray NSimon GFarias MViola IMontagud M(2022)A questionnaire-based and physiology-inspired quality of experience evaluation of an immersive multisensory wheelchair simulatorProceedings of the 13th ACM Multimedia Systems Conference10.1145/3524273.3528175(1-11)Online publication date: 14-Jun-2022
https://dl.acm.org/doi/10.1145/3524273.3528175
Holloman ACrawford C(2022)Defining Scents: A Systematic Literature Review of Olfactory-based Computing SystemsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/347097518:1(1-22)Online publication date: 27-Jan-2022
https://dl.acm.org/doi/10.1145/3470975
Marfil DBoronat FGonzalez JSapena A(2022)Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV ScenariosIEEE Access10.1109/ACCESS.2022.319417010(79071-79089)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3194170
Trestian RMuntean GWebster J(2022)Solutions for Improving Rich Media Streaming Quality in Heterogeneous Network EnvironmentsWiley Encyclopedia of Electrical and Electronics Engineering10.1002/047134608X.W8430(1-18)Online publication date: 17-Feb-2022
https://doi.org/10.1002/047134608X.W8430
Covaci ASaleme EMesfin GHussain NKani-Zabihi EGhinea G(2020)How Do We Experience Crossmodal Correspondent Mulsemedia Content?IEEE Transactions on Multimedia10.1109/TMM.2019.294127422:5(1249-1258)Online publication date: May-2020
https://doi.org/10.1109/TMM.2019.2941274
Jalal LMurroni M(2020)On the Impact of Single and Multiple Effects on Quality of Experience for Multisensorial TV in Smart Home2020 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB)10.1109/BMSB49480.2020.9379734(1-6)Online publication date: 27-Oct-2020
https://doi.org/10.1109/BMSB49480.2020.9379734
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents