Experts prefer text but videos help novices: an analysis of the utility of multi-media content
Authors: 
Hayeong Song, Jennifer Healey, 
Alexa F Siu, Curtis Wigington, 
John StaskoAuthors Info & Claims
Hayeong Song, Jennifer Healey, Alexa F Siu, Curtis Wigington, John StaskoAuthors Info & ClaimsArticle No.: 108, Pages 1 - 9
Abstract
Multi-media increases engagement and is increasingly prevalent in online content including news, web blogs, and social media, however, it may not always be beneficial to users. To determine what types of media users actually wanted, we conducted an exploratory study where users got to choose their own media augmentation. Our findings showed that users desired different amounts and types of media depending on their familiarity with the content. To further investigate this difference, we created two versions of a media augmented document, one designed for novices and one designed for experts. We evaluated these prototypes in a two-way between-subject study with 48 participants and found that while multi-media enhanced novice readers’ perception of usability (p = .0100) and helped them with reading time (p = .0427), time on task (p= .0156), comprehension (p = .0161), experts largely ignored multi-media and primarily utilized text.
Supplementary Material
Pre-recorded Video Presentation
- Download
- 5.14 MB
References
[1]
2020. Look Up Words, People, and Places While You Read.https://www.amazon.com/b?ie=UTF8&node=17717476011
[2]
2023. User Testing.https://www.usertesting.com/platform?utm_source=mkto-fallback
[3]
Jesper Aagaard. 2019. Multitasking as distraction: A conceptual analysis of media multitasking research. Theory & Psychology 29, 1 (2019), 87–99.
[4]
Mehdi Allahyari, Seyedamin Pouriyeh, Mehdi Assefi, Saeid Safaei, Elizabeth D Trippe, Juan B Gutierrez, and Krys Kochut. 2017. Text summarization techniques: a brief survey. arXiv preprint arXiv:1707.02268 (2017).
[5]
Anima 2022. Anima for Adobe XD. https://docs.animaapp.com/v3/adobe-xd/getting-started/.
[6]
Henriette Arndt and Robert Woore. 2018. Vocabulary learning from watching YouTube videos and reading blog posts. Language Learning and Technology 22, 3 (2018).
[7]
Thomas Balslev, Willem S De Grave, Arno MM Muijtjens, and AJJA Scherpbier. 2005. Comparison of text and video cases in a postgraduate problem-based learning format. Medical education 39, 11 (2005), 1086–1092.
[8]
John Brooke. 1996. "SUS-A quick and dirty usability scale." Usability evaluation in industry. CRC Press. https://www.crcpress.com/product/isbn/9780748404605 ISBN: 9780748404605.
[9]
Kyle Byers. 2022. 151 Content Marketing Statistics for 2022. https://growthbadger.com/content-marketing-statistics/
[10]
Heloisa Candello. 2013. Multimedia information delivery on mobile cultural applications. In International Conference on Universal Access in Human-Computer Interaction. Springer, 583–592.
[11]
Anne Castles, Kathleen Rastle, and Kate Nation. 2018. Ending the reading wars: Reading acquisition from novice to expert. Psychological Science in the Public Interest 19, 1 (2018), 5–51.
[12]
Bay-Wei Chang, Jock D Mackinlay, Polle T Zellweger, and Takeo Igarashi. 1998. A negotiation architecture for fluid documents. In Proceedings of the 11th annual ACM symposium on User interface software and technology. 123–132.
[13]
Parmit K Chilana, Amy J Ko, and Jacob O Wobbrock. 2012. LemonAid: selection-based crowdsourced contextual help for web applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1549–1558.
[14]
Thomas KF Chiu, Morris Siu-yung Jong, and Ida AC Mok. 2020. Does learner expertise matter when designing emotional multimedia for learners of primary school mathematics?Educational Technology Research and Development 68, 5 (2020), 2305–2320.
[15]
Thomas KF Chiu and Ida AC Mok. 2017. Learner expertise and mathematics different order thinking skills in multimedia learning. Computers & Education 107 (2017), 147–164.
[16]
Veronica Margherita Cocco, Elisa Bisagno, Gian Antonio Di Bernardo, Alessia Cadamuro, Sara Debora Riboldi, Eleonora Crapolicchio, Elena Trifiletti, Sofia Stathi, and Loris Vezzali. 2021. Comparing story reading and video watching as two distinct forms of vicarious contact: An experimental intervention among elementary school children. British Journal of Social Psychology 60, 1 (2021), 74–94.
[17]
Andy Cockburn, Carl Gutwin, Joey Scarr, and Sylvain Malacria. 2014. Supporting novice to expert transitions in user interfaces. ACM Computing Surveys (CSUR) 47, 2 (2014), 1–36.
[18]
Harry M Collins and Robert Evans. 2002. The third wave of science studies: Studies of expertise and experience. Social studies of science 32, 2 (2002), 235–296.
[19]
Jeff Conklin. 1987. Hypertext: An introduction and survey. computer 20, 09 (1987), 17–41.
[20]
National Research Council 2000. How people learn: Brain, mind, experience, and school: Expanded edition. National Academies Press.
[21]
Dennis E Egan, Joel R Remde, Louis M Gomez, Thomas K Landauer, Jennifer Eberhardt, and Carol C Lochbaum. 1989. Formative design evaluation of superbook. ACM Transactions on information systems (TOIS) 7, 1 (1989), 30–57.
[22]
Enrique Frias-Martinez, Sherry Y Chen, and Xiaohui Liu. 2006. Survey of data mining approaches to user modeling for adaptive hypermedia. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 36, 6 (2006), 734–749.
[23]
Jamey Graham. 1999. The reader’s helper: a personalized document reading environment. In Proceedings of the SIGCHI conference on human factors in computing systems. 481–488.
[24]
Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904–908.
[25]
Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S Weld, and Marti A Hearst. 2021. Augmenting scientific papers with just-in-time, position-sensitive definitions of terms and symbols. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18.
[26]
William C Hill, James D Hollan, Dave Wroblewski, and Tim McCandless. 1992. Edit wear and read wear. In Proceedings of the SIGCHI conference on Human factors in computing systems. 3–9.
[27]
Christoph Hölscher and Gerhard Strube. 2000. Web search behavior of Internet experts and newbies. Computer networks 33, 1-6 (2000), 337–346.
[28]
Slava Kalyuga. 2013. Effects of learner prior knowledge and working memory limitations on multimedia learning. Procedia-Social and Behavioral Sciences 83 (2013), 25–29.
[29]
Slava Kalyuga. 2014. The expertise reversal principle in multimedia learning. (2014).
[30]
Ard W Lazonder, Harm JA Biemans, and Iwan GJH Wopereis. 2000. Differences between novice and experienced users in searching information on the World Wide Web. Journal of the American society for Information science 51, 6 (2000), 576–581.
[31]
Mackenzie Leake, Hijung Valentina Shin, Joy O Kim, and Maneesh Agrawala. 2020. Generating audio-visual slideshows from text articles using word concreteness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.
[32]
Danielle S McNamara and Walter Kintsch. 1996. Learning from texts: Effects of prior knowledge and text coherence. Discourse processes 22, 3 (1996), 247–288.
[33]
Sungjin Nam, Zoya Bylinskii, Christopher Tensmeyer, Curtis Wigington, Rajiv Jain, and Tong Sun. 2020. Using Behavioral Interactions from a Mobile Device to Classify the Reader’s Prior Familiarity and Goal Conditions. arXiv preprint arXiv:2004.12016 (2020).
[34]
Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
[35]
Heather L O’Brien, Luanne Freund, and Richard Kopak. 2016. Investigating the role of user engagement in digital reading environments. In Proceedings of the 2016 ACM on conference on human information interaction and retrieval. 71–80.
[36]
Yasuhiro Ozuru, Kyle Dempsey, and Danielle S McNamara. 2009. Prior knowledge, reading skill, and text cohesion in the comprehension of science texts. Learning and instruction 19, 3 (2009), 228–242.
[37]
Charmi Patel. 2018. An Analysis of Jean Lave and Etienne Wenger’s: Situated Learning: Legitimate Peripheral Participation. Macat Library.
[38]
Napol Rachatasumrit, Jonathan Bragg, Amy X Zhang, and Daniel S Weld. 2022. CiteRead: Integrating Localized Citation Contexts into Scientific Paper Reading. In 27th International Conference on Intelligent User Interfaces. 707–719.
[39]
Bill N Schilit, Gene Golovchinsky, and Morgan N Price. 1998. Beyond paper: supporting active reading with free form digital ink annotations. In Proceedings of the SIGCHI conference on Human factors in computing systems. 249–256.
[40]
Matt G. Southern. 2019. Twitter Reveals Tweets With Video Generate 10X More Engagement. https://www.searchenginejournal.com/twitter-reveals-tweets-with-video-generate-10x-more-engagement/322523/#close
[41]
Zsofia K Takacs, Elise K Swart, and Adriana G Bus. 2015. Benefits and pitfalls of multimedia and interactive features in technology-enhanced storybooks: A meta-analysis. Review of educational research 85, 4 (2015), 698–739.
[42]
Barbara Tversky, Julie Bauer Morrison, and Mireille Betrancourt. 2002. Animation: can it facilitate?International journal of human-computer studies 57, 4 (2002), 247–262.
[43]
Polle T Zellweger, Bay-Wei Chang, and Jock D Mackinlay. 1998. Fluid links for informed and incremental link transitions. In Proceedings of the ninth ACM conference on Hypertext and hypermedia: links, objects, time and space—structure in hypermedia systems: links, objects, time and space—structure in hypermedia systems. 50–57.
[44]
Xiaojin Zhu, Andrew B Goldberg, Mohamed Eldawy, Charles R Dyer, and Bradley Strock. 2007. A text-to-picture synthesis system for augmenting communication. In AAAI, Vol. 7. 1590–1595.
[45]
Ingrid Zukerman and David W Albrecht. 2001. Predictive statistical models for user modeling. User Modeling and User-Adapted Interaction 11, 1 (2001), 5–18.
Index Terms
- Experts prefer text but videos help novices: an analysis of the utility of multi-media content
Recommendations
Desktop and Virtual-Reality Training Under Varying Degrees of Task Difficulty in a Complex Search-and-Shoot Scenario
HCI International 2020 – Late Breaking Papers: Virtual and Augmented RealityAbstractTwo-dimensional (2D) desktop and three-dimensional (3D) Virtual-Reality (VR) play a significant role in providing military personnel with training environments to hone their decision-making skills. The nature of the environment (2D versus 3D) and ...
A Pilot Study to Explore Novice Debriefers’ Post-Simulation Debriefing Experiences
Introduction.Effective debriefing of simulation-based experiences is critical for learning. Approximately 33% of health professions instructors are debriefing novices. However, specific faculty development needs of novice debriefers has not been ...
Understanding How Social Prompts Influence Expert's Sharing of How-to Knowledge
CSCW '19 Companion: Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social ComputingNumerous how-to tutorials and videos are pre-produced and archived for future learners' self-paced online learning. However, the co-presence of instructor and potential learners is missing when experts pre-produce how-to tutorials or videos offline. ...
Comments
Information & Contributors
Information
Published In
April 2023
3914 pages
ISBN:9781450394222
DOI:10.1145/3544549
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 April 2023
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
CHI '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 225Total Downloads
- Downloads (Last 12 months)130
- Downloads (Last 6 weeks)18
Reflects downloads up to 23 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format