tutorial

A Tutorial for Olfaction-Based Multisensorial Media Application Design and Evaluation

Authors:

Oluwakemi A. Ademoye,

Gheorghita Ghinea,

Gabriel-Miro MunteanAuthors Info & Claims

ACM Computing Surveys (CSUR), Volume 50, Issue 5

Article No.: 67, Pages 1 - 30

https://doi.org/10.1145/3108243

Published: 26 September 2017 Publication History

Abstract

Recently, multimedia researchers have added several so-called new media to the traditional multimedia components (e.g., olfaction, haptic, and gustation). Evaluating multimedia user-perceived Quality of Experience (QoE) is already non-trivial and the addition of multisensorial media components increases this challenge. No standardized methodology exists to conduct subjective quality assessments of multisensorial media applications. To date, researchers have employed different aspects of audiovisual standards to assess user QoE of multisensorial media applications and thus, a fragmented approach exists. In this article, the authors highlight issues researchers face from numerous perspectives including applicability (or lack of) existing audiovisual standards to evaluate user QoE and lack of result comparability due to varying approaches, specific requirements of olfactory-based multisensorial media applications, and novelty associated with these applications. Finally, based on the diverse approaches in the literature and the collective experience of authors, this article provides a tutorial and recommendations on the key steps to conduct olfactory-based multisensorial media QoE evaluation.

References

[1]

N. Murray, Y. Qiao, B. Lee, A. K. Karunakar, and G.-M. Muntean. 2013. Subjective evaluation of olfactory and visual media synchronization. In Proceedings of ACM Multimedia Systems Conference. 162--171.

Digital Library

[2]

F. Danieau, A. Lecuyer, P. Guillotel, J. Fleureau, N. Mollet, and M. Christie. 2012. Enhancing audiovisual experience with haptic feedback: A survey on HAV. IEEE Trans. Haptics 6, 2 (2012), 193--205.

Digital Library

[3]

T. Narumi, S. Nishizaka, T. Kajinami, T. Tanikawa, and M. Hirose. 2011. Augmented reality flavors: Gustatory display based on edible marker and cross-modal interaction. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems. 93--102, 2011.

Digital Library

[4]

G. Ghinea, S. R. Gulliver, and F. Andres (eds.). 2011. Multisensorial media advances and applications: New developments in mulsemedia. IGI Global.

[5]

G. Ghinea, C. Timmerer, W. Lin, and S. R. Gulliver. 2014. mulsemedia: State of the art, perspectives, and challenges. ACM Trans. Multimedia Comput. Commun. Appl. 11, 1s, Article 17 (October 2014), 23 pages. DOI=10.1145/2617994 http://doi.acm.org/10.1145/2617994

Digital Library

[6]

P. Le Callet, S. Möller, and A. Perkis. 2012. Qualinet white paper on “definitions of quality of experience”. In Proceedings of the European Network on Quality of Experience in Multimedia Systems and Services (COST Action IC 1003), Lausanne, Switzerland, Version 1, 1, 2012.

[7]

L. A. Rowe and R. Jain. 2005. ACM SIGMM retreat report on future directions in multimedia research. ACM Trans. Multimed. Comput., Commun., and Applicat. (TOMM) 1, 1 (2005), 3--13.

Digital Library

[8]

Z. Yuan, S. Chen, G. Ghinea, and G.-M. Muntean. 2015. Beyond multimedia adaptation: Quality of experience-aware multi-sensorial media delivery. IEEE Trans. Multimedia. 17, 1 (2015), 104--117.

[9]

M. Seufert, S. Egger, M. Slanina, T. Zinner, T. Hossfeld, and P. Tran-Gia. 2015. A survey on quality of experience of HTTP adaptive streaming. IEEE Commun. Surv. Tutor. 17, 1 (2015), 469--492.

Digital Library

[10]

D. S. Nunes, P. Zhang, and J. S. Silva. 2015. A survey on human-in-the-loop applications towards an internet of all. IEEE Commun. Surv. Tutor. 17, 2 (2015), 944—965.

Digital Library

[11]

P. Juluri, V. Tamarapalli, and D. Medhi. 2016. Measurement of quality of experience of video-on-demand services: A survey. IEEE Commun. Surv. Tutor. 18, 1 (2016), 401418.

Digital Library

[12]

P. Seeling and M. Reisslein. 2012. Video transport evaluation with H.264 video traces. IEEE Commun. Surv. Tutor. 14, 4 (2012), 1142--1165.

[13]

M. Kennedy, A. Ksentini, Y. Hadjadj-Aoul, and G.-M. Muntean. 2013. Adaptive energy optimization in multimedia-centric wireless devices: A survey. IEEE Commun. Surv. Tutor. 15, 2 (2013), 768--786.

[14]

Y. Chen, K. Wu, and Q. Zhang. 2015. From QoS to QoE: A tutorial on video quality assessment. IEEE Commun. Surv. Tutor. 17, 2 (2015), 1126--1165.

Digital Library

[15]

M. Obrist, A. N. Tuch, and K. Hornbaek. 2014. Opportunities for odor: Experiences with smell and implications for technology. In Proceedings of SIGCHI Conference on Human Factors in Computing Systems. 2843--2852.

Digital Library

[16]

G. Ghinea and O. A. Ademoye. 2011. Olfaction-enhanced multimedia: Perspectives and challenges. Multimed. Tools Applicat. 55, 3 (2011), 601--626.

Digital Library

[17]

N. Murray, B. Lee, Y. Qiao, and G.-M. Muntean. 2016. Olfaction enhanced multimedia: A survey of application domains, displays and research challenges. ACM Comput. Surv. 48, 4 (May 2016), 56.

Digital Library

[18]

Y. Yanagida. 2012. A survey of olfactory displays: Making and delivering scents. IEEE Sensors. 1--4, 2012.

[19]

ISO/IEC FDIS 23005. Information technology -- Media context and control -- Part 1-7, ISO Publication (2010).

[20]

B. Rainer, C. Timmerer, and M. Waltl. 2013. Recommendations for the subjective evaluation of sensory experience. In Proceedings of the 4th International Workshop on Perceptual Quality of Systems, 2013.

[21]

ITU-T P.910. 2008. Subjective video quality assessment methods for multimedia applications.

[22]

A. Hamam, M. Eid, A. El Saddik, and N. D. Georganas. 2008. A fuzzy logic system for evaluating quality of experience of haptic-based applications. In Proceedings of the International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, Berlin.

Digital Library

[23]

A. Hamam, M. Eid, A. El Saddik, and N. D. Georganas. 2008. A quality of experience model for haptic user interfaces. In Proceedings of the Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems, Institute for Computer Sciences. Social-Informatics and Telecommunications Engineering, February 2008.

[24]

N. Murray, Y. Qiao, B. Lee, G.-M. Muntean, and A. K. Karunakar. 2013. Age and gender influence on perceived olfactory 8 visual media synchronization. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME). 1--6.

[25]

N. Murray, Y. Qiao, B. Lee, and G.-M. Muntean. 2014. User-profile-based perceived olfactory and visual media synchronization. ACM Trans. Multimed. Comput., Commun., Applicat. (TOMM) 11, 1, (2014).

[26]

N. Murray, B. Lee, Y. Qiao, and G.-M. Muntean. 2014. Multiple-scent enhanced multimedia synchronization. ACM Trans. Multimed. Comput. Commun. Applicat. (TOMM) 11, 1s (2014), 12.

Digital Library

[27]

C. Timmerer, M. Waltl, B. Rainer, and N. Murray. 2014. Sensory experience: Quality of experience beyond audio-visual. In Quality of Experience: Advanced Concepts, Applications and Methods. Springer, Heidelberg, Germany. (S. Mauller and A. Raake, Eds.) 351--365.

[28]

N. Murray, B. Lee, Y. Qiao, and G.-M. Muntean. 2016. Impact of scent type on olfaction enhanced multimedia quality of experience. IEEE Trans. Syst. Man Cybernet. Syst. 99, (2016).

[29]

O. A. Ademoye and G. Ghinea. 2009. Synchronization of olfaction-enhanced multimedia. IEEE Trans. Multimed. 11, 3 (2009), 561--565.

Digital Library

[30]

O. A. Ademoye and G. Ghinea. 2013. Information recall task impact in olfaction-enhanced multimedia. ACM Trans. Multimed. Comput. Commun. Applic. (TOMM), 9, 3 (2013), 17.

Digital Library

[31]

G. Ghinea and O. A. Ademoye. 2012. The sweet smell of success: Enhancing multimedia applications with olfaction. ACM Trans. Multimed. Comput. Commun. Applic. (TOMM), 8, 1, 2, 2012.

Digital Library

[32]

Exhalia website. Retrieved from http://www.exhalia.com.

[33]

G. Ghinea and O. A. Ademoye. 2010. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst., Man, Cybernet—Part A: Systems and Humans. 40, 4 (2010), 657--663.

Digital Library

[34]

G. Ghinea and O. A. Ademoye. 2009. Olfaction-enhanced multimedia: Bad for information recall? In Proceedings of the International Conference on Multimedia and Expo (ICME). 970--973, 2009.

[35]

G. Ghinea and O. A. Ademoye. 2012. User perception of media content association in olfaction-enhanced multimedia. ACM Trans. Multimed. Comput. Commun. Applic. (TOMM), 8, 4 (2012), 52.

Digital Library

[36]

F. Anderson, M. Annett, W. F. Bischof, and P. Boulanger. 2010. Virtual equine assisted therapy. In Proceedings of the Virtual Reality Conference. IEEE, 255--256.

Digital Library

[37]

E. Arroyo, T. Selker, and A. Stouffs. 2002. Interruptions as multimodal outputs: Which are less disruptive? In Proceedings of the IEEE International Conference on Multimodal Interfaces. 479--482, 2002.

Digital Library

[38]

B. Berglund, U. Berglund, T. Engen, and T. Lindvall. 1971. The effect of adaptation on odour detection. Percept. Psychophys. 9, 5 (1971), 435--438.

[39]

ITU-T BT.500-2002. Methodology for the Subjective Assessment of the Quality of Television Pictures.

[40]

A. Bodnar. 2004. AROMA: Ambient awareness through olfaction in a messaging application. In Proceedings of the 6th International Conference on Multimodal Interfaces (ICMI). 183190.

Digital Library

[41]

S. A. Brewster, D. K. McGoookin, and C. A. Miller. 2006. Olfoto: Designing a smell-based interaction. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems. 653--662.

Digital Library

[42]

Dale Air Website. Retrieved from www.daleair.com.

[43]

B. R. Brkic, A. Chalmers, K. Boulanger, S. Pattanaik, and J. Covington. 2009. Cross-modal effects of smell on the real-time rendering of grass. In Proceedings of the 25th Spring Conference on Computer Graphics (SCCG). 161--166, 2009.

Digital Library

[44]

J.-C. Chebat and R. Michon. 2003. Impact of ambient odours on mall shoppers’ emotions, cognition, and spending: A test of competitive causal theories. J. Bus. Res. 56, 7 (2003), 529--539.

[45]

R. Chi-Wai Kwok, S. Han Cheng, H. Ho-Shing Ip, and J. Siu-Lung Kong. 2011. Design of affectively evocative smart ambient media for learning. Comput. Educat. 56, 1 (2011), 101--111.

Digital Library

[46]

H. O. Dinh, N. Walker, C. Song, A. Kobayashi, and L. F. Hodges. 1999. Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. IEEE Virtual Reality. 222--228.

[47]

M. A. Garcia-Ruiz, A. Edwards, R. Aquino-Santos, O. Alvarez-Cardenas, and M. G. Mayoral-Baldivia. 2008. Integrating the sense of smell in virtual reality for second language learning. In Proceedings of the World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education. 2647--2652.

[48]

P. Huang, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2012. Effect of dynamic control of fragrance output timing in networked virtual environment. In Proceedings of the 18th Asia-Pacific Conference on Communications. 104--109.

[49]

S. Hoshino, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2011. QoE assessment in olfactory and haptic media transmission: Influence of inter-stream synchronization error. In Proceedings of the IEEE International Workshop on Communications Quality and Reliability. 2011, 1--6.

[50]

H. Matsukura, T. Nihei, and H. Ishida. 2011. Multi-sensorial field display: Presenting spatial distribution of airflow and odour. In Proceedings of the IEEE Virtual Reality Conference (VR). 2011, 119--222.

Digital Library

[51]

T. Narumi, T. Kajinami, S. Nishizaka, T. Tankiawa, and M. Hirose. 2011. Pseudo-gustatory display system based on cross-modal integration of vision, olfaction and gustation. In Proceedings of the IEEE Virtual Reality. 2011, 127--130.

Digital Library

[52]

D. Noguchi, S. Sugimoto, Y. Bannai, and K. Okada. 2011. Time characteristics of olfaction in a single breath. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (CHI2011). 2011, 83--92.

Digital Library

[53]

D. Noguchi, K. Ohtsu, Y. Bannai, and K. Okada. 2008. Scent presentation expressing two smells of different intensity simultaneously. In Proceedings of the Joint Virtual Eurographics Conference on Virtual Environments. 2008. 53--60.

[54]

K. Tomono, H. Katsuyama, and A. Tomono. 2012. Scent emitting display panel and its psychological effects. J. Inf. Media Tech. 7, 2 (2012), 761--769.

[55]

R. Tortell, D. P. Luigi, A. Dozois, S. Bouchard, J. F. Morie, and D. Ilan. 2007. The effects of scent and game play experience on memory of a virtual environment. IEEE Virtual Reality 11, 1 (2007), 61--68.

Digital Library

[56]

Anthrotronix website, http://www.anthrotronix.com/our-work/simulation-and-training/.

[57]

J. S. Warm, W. N. Dember, and E. Parasuraman. 1991. Effects of olfactory stimulation on performance and stress in a visual sustained attention task. J. Soc. Cosmet. Chemists 42 (1991), 199--210.

[58]

D. Warnock. 2011. A subjective evaluation of multimodal notifications. In Proceedings of the 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth). 461--468.

[59]

A. Yazdani, E. Kroupi, J. Vesin, and T. Ebrahimi. 2012. Electroencephalogram alterations during perception of pleasant and unpleasant odors. In Proceedings of the 4th International Workshop on Quality of Multimedia Experience (QoMEX). 272--277.

[60]

ITU-T P.913:2014. Methods for the Subjective Assessment of Video Quality, Audio Quality and Audiovisual Quality of Internet Video and Distribution Quality Television in any Environment, 2014.

[61]

ISO standard (ISO/IEC 8589:2007). Sensory Analysis -- General Guidance for the Design of Test Rooms, 2007.

[62]

R. E. Cytowic. 2002. Synesthesia: A Union of the Senses (2nd ed,). The MIT Press. Cambridge, MA.

[63]

ISO 5496:2006. Sensory analysis -- methodology -- initiation and training of assessors in the detection and recognition of odors, 2006.

[64]

Z. Yuan, S. Chen, G. Ghinea, and G. M. Muntean. 2014. User quality of experience of Mulsemedia applications. ACM Trans. Multimed. Comput. Communicat. Applicat. (TOMM) 11, 1 (2014), 15.

[65]

ITU-T Recommendation P.911-1998. Subjective Audiovisual Quality Assessment Methods for Multimedia Applications. Dec. 1998

[66]

A. Nambu, T. Narumi, K. Nishimura, T. Tanikawa, and M. Hirose. 2010. Visual-olfactory display using olfactory sensory map. In Proceedings of the IEEE Virtual Reality Conference. 39--42, 2010.

Digital Library

[67]

B. Ramic, A. Chalmers, J. Hasic, S. Rizvic. 2007. Selective rendering in a multimodal environment: scent and graphics. Proceedings of the 23rd Spring Conference on Computer Graphics. 147--151, 2007.

Digital Library

[68]

T. Tanikawa and M. Hirose. 2008. A study of multi-modal display system with visual feedback. Proceedings of the International Symposium on Universal Communication. 2008, 285--292.

Digital Library

[69]

T. Sikora. 2001. The MPEG-7 visual standard for content description: An overview. IEEE Trans. Circuits Syst. Video Technol. 11, 6 (June 2001), 696--702.

Digital Library

[70]

N. Murray, B. Lee, Y. Qiao, and G.-M. Muntean. 2016. The influence of human factors on olfaction-based Mulsemedia quality of experience. In Proceedings of the 8th International Conference on Quality of Multimedia Experience (QoMEX 2016).

[71]

G.-M. Muntean. 2006. Efficient delivery of multimedia streams over broadband networks using QOAS. IEEE Trans. Broadcast. 52, 2 (2006), 230--235.

[72]

G.-M. Muntean, P. Perry, and L. Murphy. 2005. Objective and subjective evaluation of QOAS video streaming over broadband networks. IEEE Trans. Netw. Serv. Manage. 2, 1 (2005), 19--28.

Digital Library

[73]

Z. Yuan and G.-M. Muntean. 2013. A prioritized adaptive scheme for multimedia services over IEEE 802.11 WLANs. IEEE Trans. Netw. Serv. Manage. 10, 4 (2013), 340--355.

[74]

ISO Standard 5496:2006. Sensory analysis -- Methodology -- Initiation and training of assessors in the detection and recognition of odours.

[75]

ISO/IEC FDIS 23005-2:2010. Information technology -- Media context and control -- Part 2: Control information.

[76]

ISO/IEC FDIS 23005-3:2010. Information technology -- Media context and control -- Part 3: Sensory information.

[77]

ISO/IEC FDIS 23005-4:2010. Information technology -- Media context and control -- Part 4: Virtual world object characteristics.

[78]

ISO/IEC FDIS 23005-5:2010. Information technology -- Media context and control -- Part 5: Data formats for interaction devices.

[79]

ISO/IEC FDIS 23005-6:2010. Information technology -- Media context and control -- Part 6: Common types and tools.

[80]

ISO/IEC FDIS 23005-7:2010. Information technology -- Media context and control -- Part 7: Reference software and conformance.

[81]

P. T. Kovács, N. Murray, G. Rozinaj, Y. Sulema, and Renata Rybárová. 2015. Application of immersive technologies for education: State of the art. In Proceedings of the 9th International Conference on Interactive Mobile Communication Technologies and Learning (IMCL 2015). 2015.

[82]

G. Calvert, C. Spence, and B. E. Stein. 2004. The Handbook of Multisensory Processes. The MIT Press, Cambridge, MA.

[83]

M. Obrist, E. Gatti, E. Maggioni, C. T. Vi, and C. Velasco. 2017. Multisensory experiences in HCI. IEEE Trans. Multimed. 24, 2 (June 2017), 9--13.

Digital Library

[84]

N. S. Herrera and R. P. McMahan. 2014. Development of a simple and low-cost olfactory display for immersive media experiences. In Proceedings of the 2nd ACM International Workshop on Immersive Media Experiences (ImmersiveME’14). ACM, New York, 2014, 1--6.

Digital Library

[85]

Y. Yanagida, S. Kawato, H. Noma, A. Tomono, and N. Tesutani. 2004. Projection based olfactory display with nose tracking. In Proceedings of IEEE Virtual Reality 2004. 43--50.

[86]

D. McGookin and D. Escobar. 2016. Hajukone. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA’16. 2016, 1721--1728.

[87]

B. Ramic-Brkic and A. Chalmers. 2014. Olfactory adaptation in virtual environments. ACM Trans. Appl. Percept. 11, 2 (June 2014), 1--16.

Digital Library

[88]

J. N. Kaye. 2001. Symbolic Olfactory Display. Massachusetts Institute of Technology, Cambridge, MA, 2001.

[89]

N. Ranasinghe, G. Suthokumar, K.-Y. Lee, and E. Y.-L. Do. 2015. Digital flavor. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction - ICMI’15. 2015, 139--146.

Digital Library

[90]

S. A. Seah, D. Martinez Plasencia, P. D. Bennett, A. Karnik, V. S. Otrocol, J. Knibbe, A. Cockburn, and S. Subramanian. 2014. SensaBubble. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI’14). 2863--2872.

Digital Library

[91]

E. B. Saleme and C. A. S. Santos. 2015. Playsem: A platform for rendering Mulsemedia compatible with MPEG-V. In Proceedings of the 21st Brazilian Symposium on Multimedia and the Web (WebMedia'15). 145--148.

Digital Library

[92]

M. Waltl, B. Rainer, C. Timmerer, and H. Hellwagner. 2013. An end-to-end tool chain for sensory experience based on MPEG-V. Image Commun. 28, 3 (2013), 136--150.

Digital Library

[93]

M. Rank, Z. Shi, and S. Hirche. 2010. Perception of delay in haptic telepresence systems. Presence. 19, 5 (2010), 389--399.

Digital Library

[94]

Z. Yuan, T. Bi, G.-M. Muntean, and G. Ghinea. 2015. G. Perceived synchronization of Mulsemedia services. IEEE Transactions on Multimedia 17, 7, 957--966, 2015.

Digital Library

[95]

O. A. Ademoye, N. Murray, G.-M. Muntean, and G. Ghinea. 2016. Audio masking effect on inter-component skews. Olfaction-Enhanced Multimedia Presentations. ACM Trans. Multimed. Comput., Commun. Applicat. (TOMM). 12, 4, 51, 2016.

[96]

J. M. Silva, M. Orozco, J. Cha, A. E. Saddik, and E. M. Petriu. 2013. Human perception of haptic-to-video and haptic-to-audio skew in multimedia applications. ACM Trans. Multimed. Comput. Commun. Appl. 9, 2 (2013), 1--16.

Digital Library

[97]

A. Tatematsu, Y. Ishibashi, N. Fukushima, and S. Sugawara. 2010. QoE assessment in haptic media, sound and video transmission: Influences of network latency. In Proceedings of the IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR 2010). 1--6.

[98]

Q. Zeng, Y. Ishibashi, N. Fukushima, S. Sugawara, and K. E. Psannis. 2013. Influences of inter-stream synchronization errors among haptic media, sound, and video on quality of experience in networked ensemble. In Proceedings of the IEEE 2nd Global Conference on Consumer Electronics (GCCE). (2013), 466--470.

[99]

N. Ranasinghe, A. Cheok, R. Nakatsu, and E. Y. L. Do. 2013. Simulating the sensation of taste for immersive experiences. In Proceedings of the 2013 ACM International Workshop on Immersive Media Experiences. ACM, New York, 2013, 29--34.

Digital Library

[100]

D. Dmitrenko, C. T. Vi, and M. Obrist. 2016. A comparison of scent-delivery devices and their meaningful use for in-car olfactory interaction. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 23--26

Digital Library

[101]

D. Egan, S. Brennan, J. Barrett, Y. Qiao, C. Timmerer, and N. Murray. 2016. An evaluation of heart rate and electrodermal activity as an objective QOE evaluation method for immersive virtual reality environments. In Proceedings of Quality of Multimedia Experience (QoMEX), 2016.

[102]

I. Ghergulescu and C. H. Muntean. 2014. A novel sensor-based methodology for Learner's motivation analysis in game-based learning. Interacting with Computers 26, 4 (2014), 305--320.

[103]

A. N. Moldovan, I. Ghergulescu, S. Weibelzahl, and C. H. Muntean. 2013. User-centered EEG-based multimedia quality assessment. In Proceedings of the IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB). IEEE, 2013, 1--8.

Cited By

Zhang YGao PKang FLi JLiu JLu QXu Y(2024)OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00034(105-114)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00034
Murugan Mda Silveira ASubashini PGhinea GSantos C(2024)Technology-Enhanced Mulsemedia Learning (TEML) Through Design for Learners with Dyslexia for Enhancing the Quality of Experience (QoE)Envisioning the Future of Education Through Design10.1007/978-981-97-0076-9_10(221-243)Online publication date: 11-Apr-2024
https://doi.org/10.1007/978-981-97-0076-9_10
Silveira ARaisamo RSpyridonis FCovaci AGhinea GSantos C(2023)Guidelines for conducting biofeedback-enhanced QoE studies in mulsemedia-enhanced virtual realityProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617029(32-40)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3617023.3617029
Show More Cited By

Index Terms

A Tutorial for Olfaction-Based Multisensorial Media Application Design and Evaluation
1. General and reference
  1. Cross-computing tools and techniques
    1. Evaluation
    2. Experimentation
2. Information systems
  1. Data management systems
  2. Information systems applications
    1. Multimedia information systems

Recommendations

Subjective Evaluation of an Olfaction Enhanced Immersive Virtual Reality Environment
AltMM '17: Proceedings of the 2nd International Workshop on Multimedia Alternate Realities

Recent research efforts have reported findings on user Quality of Experience (QoE) of immersive virtual reality (VR) experiences. Truly immersive multimedia experiences also include multisensory components such as factional, tactile etc., in addition to ...
Olfaction-enhanced multimedia: perspectives and challenges

Olfaction--or smell--is one of the last challenges which multimedia and multimodal applications have to conquer. Enhancing such applications with olfactory stimuli has the potential to create a more complex--and richer--user multimedia experience, by ...
QoE assessment in tele-operation with 3D video and haptic media
ICME '11: Proceedings of the 2011 IEEE International Conference on Multimedia and Expo

In this paper, we investigate the influence of network delay on the quality of experience (QoE) for a tele-operation system with 3D (i.e., stereoscopic) video and haptic media. We assess the video output quality, operability of the haptic interface ...

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys

ACM Computing Surveys Volume 50, Issue 5

September 2018

573 pages

ISSN:0360-0300

EISSN:1557-7341

DOI:10.1145/3145473

Editor:
Sartaj Sahni
Department of Computer and Information Science and Engineering / University of Florida / Gainesville, FL 32611

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2017

Accepted: 01 June 2017

Revised: 01 June 2017

Received: 01 November 2016

Published in CSUR Volume 50, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial
Research
Refereed

Funding Sources

Horizon 2020

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
598
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)7

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YGao PKang FLi JLiu JLu QXu Y(2024)OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00034(105-114)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00034
Murugan Mda Silveira ASubashini PGhinea GSantos C(2024)Technology-Enhanced Mulsemedia Learning (TEML) Through Design for Learners with Dyslexia for Enhancing the Quality of Experience (QoE)Envisioning the Future of Education Through Design10.1007/978-981-97-0076-9_10(221-243)Online publication date: 11-Apr-2024
https://doi.org/10.1007/978-981-97-0076-9_10
Silveira ARaisamo RSpyridonis FCovaci AGhinea GSantos C(2023)Guidelines for conducting biofeedback-enhanced QoE studies in mulsemedia-enhanced virtual realityProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617029(32-40)Online publication date: 23-Oct-2023
https://dl.acm.org/doi/10.1145/3617023.3617029
Szabó PSimiscuka AMasneri SZorrilla MMuntean G(2023)A CNN-Based Framework for Enhancing 360° VR Experiences With Multisensorial EffectsIEEE Transactions on Multimedia10.1109/TMM.2022.315755625(3245-3258)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1109/TMM.2022.3157556
Mohana MValliammal NSuvetha VKrishnaveni MSubashini PGhinea G(2023)A Study on Technology-Enhanced Mulsemedia Learning for Enhancing Learner's Experience in E-Learning2023 International Conference on Network, Multimedia and Information Technology (NMITCON)10.1109/NMITCON58196.2023.10275964(01-06)Online publication date: 1-Sep-2023
https://doi.org/10.1109/NMITCON58196.2023.10275964
Gonçalves GMelo MPeixoto BBarbosa LBessa M(2023)Examining the Influence of Trimodal Multisensory Stimuli on Presence, Perceived Realism, and Quality of Experience in Video Visualization2023 International Conference on Graphics and Interaction (ICGI)10.1109/ICGI60907.2023.10452723(1-8)Online publication date: 2-Nov-2023
https://doi.org/10.1109/ICGI60907.2023.10452723
Alkasasbeh AGhinea G(2023)That Scent Evokes an Image—On the Impact of Olfactory Cues on User Image Recall in Digital Multisensory EnvironmentsInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2254618(1-15)Online publication date: 19-Sep-2023
https://doi.org/10.1080/10447318.2023.2254618
Rodrigues Rda Silva Jr. JBrandão Ddos Santos J(2022)An Approach for Sensory Effects Dispersion Simulation with Computational Fluid DynamicsProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3556999(368-376)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3556999
Lei YLu QXu Y(2022)O&O: A DIY toolkit for designing and rapid prototyping olfactory interfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502033(1-21)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502033
Holloman ACrawford C(2022)Defining Scents: A Systematic Literature Review of Olfactory-based Computing SystemsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/347097518:1(1-22)Online publication date: 27-Jan-2022
https://dl.acm.org/doi/10.1145/3470975
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents