short-paper

Evaluating the Influence of Mulsemedia Content in Reading

Authors:

Natália Vieira,

Anderson Pinto,

Taymison Ramos,

Gustavo Paiva Guedes,

Joel dos SantosAuthors Info & Claims

WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the Web

Pages 133 - 136

https://doi.org/10.1145/3243082.3267446

Published: 16 October 2018 Publication History

Abstract

Augmented e-books provide the reader with a better quality of experience (QoE) by enriching the e-books with multimedia content and interactive elements. In the multimedia field, an improve in QoE has been performed by the use of sensory effects, creating the so-called mulsemedia applications. In this paper, it is considered that e-books augmented with mulsemedia content influence the reader perception of the history environment, besides improving its QoE. It is presented a mulsemedia setup with light, wind and audio effects, which are synchronized with a written history. Among other discoveries, the collected data suggest that such elements have a more significant influence on the reader when the environment description tend to be vague, whereas in scenes whose details are precisely described this influence is rather minored.

References

[1]

Kazi Masudul Alam, Abu Saleh Md Mahfujur Rahman, and Abdulmotaleb El Saddik. 2013. Mobile haptic e-book system to support 3D immersive reading in ubiquitous environments. ACM Transactions on Multimedia Computing, Communications, and Applications 9, 4 (2013), 27.

Digital Library

[2]

Liam Borgstrom. 2011. Developing story-time: The importance of interactivity in encouraging childhood reading. Mousaion 29, 3 (2011), 193--208.

[3]

Luca Colombo and Monica Landoni. 2014. A diary study of children's user experience with EBooks using flow theory as framework. In Proceedings of the 2014 conference on Interaction design and children. ACM, 135--144.

Digital Library

[4]

David M Durant. 2015. Resistance is Not Futile: Why Print Collections Still Matter in the Digital Age. Against the Grain 27, 3 (2015), 11.

[5]

Gheorghita Ghinea, Christian Timmerer, Weisi Lin, and Stephen R Gulliver. 2014. Mulsemedia: State of the art, perspectives, and challenges. ACM Transactions on Multimedia Computing, Communications, and Applications 11, 1s (2014), 17.

Digital Library

[6]

Burak Gökbulut and Mustafa Yeniasır. 2017. Analysis of children's interest in books and their reading levels depending on the education status of family. Quality & Quantity (2017), 1--11.

[7]

Gustavo Paiva Guedes. 2018. Multisensorial Books: improving readers' quality of experience. In 2018 XIII Latin American Conference on Learning Objects and Technology (LACLO).

[8]

Kyong-Ho Lee, Nicholas Guttenberg, and Victor McCrary. 2002. Standardization aspects of eBook content formats. Computer Standards & Interfaces 24, 3 (2002), 227--239.

Digital Library

[9]

Jim-Min Lin, Che Wun Chiou, Chiou-Yng Lee, and Jing-Rui Hsiao. 2016. Supporting Physical Agents in an Interactive e-book. In Genetic and Evolutionary Computing. Springer International Publishing, 243--252.

[10]

Angus Phillips. 2014. Turning the page: The evolution of the book. Routledge.

[11]

Abu Saleh Md Mahfujur Rahman, Kazi Masudul Alam, and Abdulmotaleb El Saddik. 2011. Augmented HE-Book: A Multimedia Based Extension to Support Immersive Reading Experience. In Autonomous and Intelligent Systems. 321--330.

Digital Library

[12]

Benjamin Rainer, Markus Waltl, Eva Cheng, Muawiyath Shujau, Christian Timmerer, Stephen Davis, Ian Burnett, Christian Ritz, and Hermann Hellwagner. 2012. Investigating the impact of sensory effects on the quality of experience and emotional response in web videos. In Fourth International Workshop on Quality of Multimedia Experience. 278--283.

[13]

Carlos Sánchez-Azqueta, Cecilia Gimeno, Santiago Celma, and Concepción Aldea. 2016. Enhanced eBooks in the teaching/learning process of electronics. In 2nd. International conference on higher education advances. 84--91.

[14]

Ronald E Wolf. 1977. What is reading good for? Perspectives from senior citizens. Journal of reading 21, 1 (1977), 15--17.

[15]

Zhenhui Yuan, Gheorghita Ghinea, and Gabriel-Miro Muntean. 2015. Beyond multimedia adaptation: Quality of experience-aware multi-sensorial media delivery. IEEE Transactions on Multimedia 17, 1 (2015), 104--117.

Cited By

Silva EVieira NAmorim GMousinho RGuedes GGhinea GDos Santos J(2021)Using Multisensory Content to Impact the Quality of Experience of Reading Digital BooksACM Transactions on Multimedia Computing, Communications, and Applications10.1145/345867617:4(1-18)Online publication date: 12-Nov-2021
https://dl.acm.org/doi/10.1145/3458676
Okuno HMoura BNetto SGuedes G(2021)Multisensorial Audiobooks: Improving Accessibility with WCAG Standard2021 XVI Latin American Conference on Learning Technologies (LACLO)10.1109/LACLO54177.2021.00089(502-505)Online publication date: Oct-2021
https://doi.org/10.1109/LACLO54177.2021.00089
Okuno HNetto SGuedes G(2020)Multisensorial Audiobooks2020 XV Conferencia Latinoamericana de Tecnologias de Aprendizaje (LACLO)10.1109/LACLO50806.2020.9381171(1-6)Online publication date: 19-Oct-2020
https://doi.org/10.1109/LACLO50806.2020.9381171
Show More Cited By

Index Terms

Evaluating the Influence of Mulsemedia Content in Reading
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Virtual worlds software

Recommendations

Using Multisensory Content to Impact the Quality of Experience of Reading Digital Books
Multisensorial books enrich a story with either traditional multimedia content or sensorial effects. The main idea is to increase children’s interest in reading by enhancing their QoE while reading. Studies on enriched and/or augmented e-books also ...
User Quality of Experience of Mulsemedia Applications
Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and Applications

User Quality of Experience (QoE) is of fundamental importance in multimedia applications and has been extensively studied for decades. However, user QoE in the context of the emerging multiple-sensorial media (mulsemedia) services, which involve ...
Sensory Effect Extraction for 360° Media Content
WebMedia '21: Proceedings of the Brazilian Symposium on Multimedia and the Web

The presentation of sensory effects in sync with 360° content has the potential to increase user immersion. However, the authoring process for such effects is laborious and slow. It requires the author to specify in time and space the presentation ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the Web

October 2018

437 pages

ISBN:9781450358675

DOI:10.1145/3243082

General Chairs:
Manoel Carvalho Marques Neto
IFBA
,
Renato Lima Novais
IFBA
,
Carlos Ferraz
UFPE
,
Windson Viana
UFC

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
SBC: Brazilian Computer Society
SIGMM: ACM Special Interest Group on Multimedia
CNPq: Conselho Nacional de Desenvolvimento Cientifico e Tecn
CGIBR: Comite Gestor da Internet no Brazil
CAPES: Brazilian Higher Education Funding Council

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

WebMedia '18

WebMedia '18: Brazilian Symposium on Multimedia and the Web

October 16 - 19, 2018

BA, Salvador, Brazil

Acceptance Rates

WebMedia '18 Paper Acceptance Rate 37 of 111 submissions, 33%;

Overall Acceptance Rate 270 of 873 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
92
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Silva EVieira NAmorim GMousinho RGuedes GGhinea GDos Santos J(2021)Using Multisensory Content to Impact the Quality of Experience of Reading Digital BooksACM Transactions on Multimedia Computing, Communications, and Applications10.1145/345867617:4(1-18)Online publication date: 12-Nov-2021
https://dl.acm.org/doi/10.1145/3458676
Okuno HMoura BNetto SGuedes G(2021)Multisensorial Audiobooks: Improving Accessibility with WCAG Standard2021 XVI Latin American Conference on Learning Technologies (LACLO)10.1109/LACLO54177.2021.00089(502-505)Online publication date: Oct-2021
https://doi.org/10.1109/LACLO54177.2021.00089
Okuno HNetto SGuedes G(2020)Multisensorial Audiobooks2020 XV Conferencia Latinoamericana de Tecnologias de Aprendizaje (LACLO)10.1109/LACLO50806.2020.9381171(1-6)Online publication date: 19-Oct-2020
https://doi.org/10.1109/LACLO50806.2020.9381171
Okuno HGuedes G(2020)Automatic XML creation for Multisensorial Books2020 XV Conferencia Latinoamericana de Tecnologias de Aprendizaje (LACLO)10.1109/LACLO50806.2020.9381139(1-6)Online publication date: 19-Oct-2020
https://doi.org/10.1109/LACLO50806.2020.9381139
Silva EAmorim GSantos Jdos Santos JMuchaluat Saade Dda Graça C. Pimentel MMacedo A(2019)Adding temporal semantic to textual media objects with eye tracking technologyProceedings of the 25th Brazillian Symposium on Multimedia and the Web10.1145/3323503.3360636(217-220)Online publication date: 29-Oct-2019
https://dl.acm.org/doi/10.1145/3323503.3360636

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents