research-article

Grab the Frog: Comparing Intuitive Use and User Experience of a Smartphone-only, AR-only, and Tangible AR Learning Environment

Authors:

Sebastian Oberdörfer,

Anne Elsässer,

Marc Erich LatoschikAuthors Info & Claims

MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction

Article No.: 31, Pages 1 - 12

https://doi.org/10.1145/3447526.3472016

Published: 27 September 2021 Publication History

Abstract

The integration of Augmented Reality (AR) in teaching concepts allows for the visualization of complex learning contents and can simultaneously enhance the learning motivation. By providing Tangible Augmented Reality (TAR), an AR learning environment receives a haptic aspect and allows for a direct manipulation of augmented learning materials. However, manipulating tangible objects while using handheld AR might reduce the intuitive use and hence user experience. Users need to simultaneously control the application and manipulate the tangible object. Therefore, we compare the differences in intuitive use and user experience evoked by varied technologies of knowledge presentation in an educational context. In particular, we compare a TAR learning environment targeting the learning of the anatomy of vertebrates to its smartphone-only and AR-only versions. The three versions of the learning environment only differ in their method of knowledge presentation. The three versions show a similar perceived intuitive use. The TAR version, however, yielded a significantly higher attractiveness and stimulation than AR-only and smartphone-only. This suggests a positive effect of TAR learning environments on the overall learning experience.

References

[1]

Alissa Antle and Alyssa Wise. 2013. Getting down to details: Using learning theory to inform tangibles research and design for children. Interacting with Computers 25 (01 2013), 1–20. https://doi.org/10.1093/iwc/iws007

[2]

Ronald T Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4(1997), 355–385.

Digital Library

[3]

Jorge Bacca, Silvia Baldiris, Samon Fabregat, Sabine Graf, and Kinishuk. 2014. Augmented Reality Trends in Education: A Systematic Review of Research and Applications. Educational Technology & Society 17, 4 (2014), 133–149.

[4]

B. Bach, R. Sicat, J. Beyer, M. Cordeil, and H. Pfister. 2018. The Hologram in My Hand: How Effective is Interactive Exploration of 3D Visualizations in Immersive Tangible Augmented Reality?IEEE Transactions on Visualization and Computer Graphics 24, 1(2018), 457–467.

[5]

Jonathan Balcombe. 2013. Alternatives to dissection. In The Global Guide to Animal Protection, Andrew Linzey (Ed.). University of Illinois Press, 271–272.

[6]

Eric A. Bier, Maureen C. Stone, Ken Pier, William Buxton, and Tony D. DeRose. 1993. Toolglass and Magic Lenses: The See-through Interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, CA) (SIGGRAPH ’93). Association for Computing Machinery, New York, NY, USA, 73–80. https://doi.org/10.1145/166117.166126

Digital Library

[7]

Mark Billinghurst, Hirokazu Kato, and Ivan Poupyrev. 2008. Tangible augmented reality. ACM SIGGRAPH ASIA 2008 Courses (01 2008). https://doi.org/10.1145/1508044.1508051

[8]

B’in Games. 2018. Frog anatomy. https://assetstore.unity.com/packages/3d/characters/animals/frog-anatomy-113389.

[9]

T Chandrasekera and S Yoon. 2015. The Effect of Tangible User Interfaces on Cognitive Load in the Creative Design Process. In 2015 IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design. 6–8. https://doi.org/10.1109/ISMAR-MASHD.2015.18

[10]

Dennis Charsky. 2010. From Edutainment to Serious Games: A Change in the Use of Game Characteristics. Games and Culture 5, 2 (2010), 177–198. https://doi.org/10.1177/1555412009354727

[11]

GP Strategies Corporation. 2020. Frog Dissection. available at https://apps.apple.com/us/app/frog-dissection/id377626675.

[12]

Sara de Freitas and Fotis Liarokapis. 2011. Serious Games: A New Paradigm for Education?In Serious Games and Edutainment Applications, Minhua Ma, Andreas Oikonomou, and Lakhmi C Jain(Eds.). Springer-Verlag, London, 9–23. https://doi.org/10.1007/978-1-4471-2161-9_2

[13]

P Diegmann, M Schmidt-Kraepelin, S Van den Eynden, and D Basten. 2015. Benefits of Augmented Reality in Educational Environments - A Systematic Literature Review. In Proceedings of the 12th International Conference on Wirtschaftsinformatik. Osnabrück, Germany, 1542–1556.

[14]

Inc. Digital Frog Internation. 2020. Digital Frog. available at https://www.digitalfrog.com.

[15]

Tristan C Endslay, Kelly A Sprehn, Ryan M Brill, Kimberly J Ryan, Emily C Vincent, and James M Martin. 2017. Augmented Reality Design Heuristics: Designing for Dynamic Interactions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61, 1(2017), 2100–2104. https://doi.org/10.1177/1541931213602007

[16]

Kenneth R Fleischmann. 2003. Frog and Cyberfrog are Friends: Dissection Simulation and Animal Advocacy. Society & Animals 11, 2 (2003), 123–143.

[17]

Thorsten Fraterman, Ramón Gomez-Islinger, Dietmar Kalusche, Alexander Röhrer, and Marianne Walcher. 2017. PRISMA Biologie 6 (1sted.). Ernst Klett Verlag, Stuttgart/Leipzig.

[18]

Staatsinstitut für Schulqualität und Bildungsforschung München. 2020. LehrplanPLUS. available at https://www.lehrplanplus.bayern.de/.

[19]

M Gervautz and Dieter Schmalstieg. 2012. Anywhere Interfaces Using Handheld Augmented Reality. Computer 45, 7 (2012), 26–31. https://doi.org/10.1109/MC.2012.72

Digital Library

[20]

Joanne Gikas and Michael M Grant. 2013. Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media. The Internet and Higher Education 19 (2013), 18–26. https://doi.org/10.1016/j.iheduc.2013.06.002

[21]

Julián Esteban Gutiérrez Posada, Elaine C S Hayashi, and M. Cecília C Baranauskas. 2014. On Feelings of Comfort, Motivation and Joy that GUI and TUI Evoke. In Design, User Experience, and Usability. User Experience Design Practice, Aaron Marcus (Ed.). Springer International Publishing, Cham, 273–284.

[22]

Steve Hinske, Marc Langheinrich, and Matthias Lampe. 2008. Towards Guidelines for Designing Augmented Toy Environments. In Proceedings of the 7th ACM Conference on Designing Interactive Systems. 78–87. https://doi.org/10.1145/1394445.1394454

Digital Library

[23]

Zhao Huang. 2019. Developing Usability Heuristics for Recommendation Systems Within the Mobile Context. In Design, User Experience, and Usability. Practice and Case Studies, Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, Cham, 143–151.

[24]

Epic Games Inc.2021. Unreal Engine. available at https://www.unrealengine.com/.

[25]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In Proceedings of the 1997 CHI Conference on Human Factors in Computing Systems (CHI ’97). Atlanta, USA, 234–241. https://doi.org/10.1145/258549.258715

Digital Library

[26]

Mina Khan, Fernando Trujano, Ashris Choudhury, and Pattie Maes. 2018. Mathland: Playful Mathematical Learning in Mixed Reality. In CHI’18 Extended Abstracts. Montréal, Canada.

Digital Library

[27]

K Kim, Mark Billinghurst, Gerd Bruder, H B Duh, and G F Welch. 2018. Revisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008–2017). IEEE Transactions on Visualization and Computer Graphics 24, 11(2018), 2947–2962. https://doi.org/10.1109/TVCG.2018.2868591

[28]

Andreas Knote, Sabine C Fischer, Sylvain Cussat-Blanc, Florian Niebling, David Bernard, Florian Cogoni, and Sebastian von Mammen. 2019. Immersive Analysis of 3D Multi-cellular In-Vitro and In-Silico Cell Cultures. In 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). https://doi.org/10.1109/AIVR46125.2019.00021

[29]

Andreas Knote, Sebastian von Mammen, YunYun Gao, and Andrea Thorn. 2020. Immersive Analysis of Crystallographic Diffraction Data. In 26th ACM Symposium on Virtual Reality Software and Technology. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3385956.3422097

[30]

S M Ko, W S Chang, and Y G Ji. 2013. Usability Principles for Augmented Reality Applications in a Smartphone Environment. International Journal of Human-Computer Interaction 29, 8(2013), 501–515.

[31]

Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. In Symposium of the Austrian HCI and usability engineering group, Proceedings of the 4th Symposium of the Workgroup Human-Computer Interaction, Usability Engineering of the Austrian Computer Society on HCI, Usability for Education, and Work (Eds.). Springer-Verlag, 63–76.

[32]

Woon-Hyung Lee and Hyun-Kyung Lee. 2016. The usability attributes and evaluation measurements of mobile media AR (augmented reality). Cogent Arts & Humanities 3, 1 (2016). https://doi.org/10.1080/23311983.2016.1241171

[33]

Lili Liu, Christian Wagner, and Ayoung Suh. 2017. Understanding the Success of Pokémon Go: Impact of Immersion on Players’ Continuance Intention. In Augmented Cognition. Enhancing Cognition and Behavior in Complex Human Environments, Dylan D Schmorrow and Cali M Fidopiastis (Eds.). Springer International Publishing, Cham, 514–523.

[34]

Designmate (I) Pvt. Ltd.2020. Froggipedia. available at https://apps.apple.com/us/app/froggipedia/id1348306157.

[35]

Zhihan Lv, Alex Tek, Franck Da Silva, Charly Empereur-mot, Matthieu Chavent, and Marc Baaden. 2013. Game On, Science - How Video Game Technology May Help Biologists Tackle Visualization Challenges. PLoS ONE 8, 3 (2013), e57990. https://doi.org/10.1371/journal.pone.0057990

[36]

Jane McGonigal. 2011. Reality is Broken: Why Games Make Us Better and How They Can Change the World (1st ed.). Penguin Press, New York.

[37]

Anja Naumann and Jörn Hurtienne. 2010. Benchmarks for Intuitive Interaction with Mobile Devices. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’10). ACM, Lisboa, Portugal, 401–402. https://doi.org/10.1145/1851600.1851685

Digital Library

[38]

Sebastian Oberdörfer. 2021. Better Learning with Gaming: Knowledge Encoding and Knowledge Learning Using Gamification. Ph.D. Dissertation. University of Würzburg. https://doi.org/10.25972/OPUS-21970

[39]

Sebastian Oberdörfer, Anne Elsässer, David Schraudt, Silke Grafe, and Marc Erich Latoschik. 2020. Horst – The Teaching Frog: Learning the Anatomy of a Frog Using Tangible AR. In Proceedings of the 2020 Mensch und Computer Conference (MuC ’20). Magdeburg, Germany, 303–307. https://doi.org/10.1145/3404983.3410007

Digital Library

[40]

Sebastian Oberdörfer and Marc Erich Latoschik. 2018. Gamified Knowledge Encoding: Knowledge Training Using Game Mechanics. In Proceedings of the 10th International Conference on Virtual Worlds and Games for Serious Applications (VS Games ’18). ©2018 IEEE. Reprinted, with permission., Würzburg, Germany. https://doi.org/10.1109/VS-Games.2018.8493425

[41]

Sebastian Oberdörfer and Marc Erich Latoschik. 2019. Knowledge Encoding in Game Mechanics: Transfer-Oriented Knowledge Learning in Desktop-3D and VR. International Journal of Computer Games Technology 2019 (2019). https://doi.org/10.1155/2019/7626349

Digital Library

[42]

Sebastian Oberdörfer and Marc Erich Latoschik. 2019. Predicting Learning Effects of Computer Games Using the Gamified Knowledge Encoding Model. Entertainment Computing 32 (2019). https://doi.org/10.1016/j.entcom.2019.100315

[43]

PTC, Inc.2021. Vuforia. available at https://developer.vuforia.com.

[44]

Katie Seaborn and Deborah I Fels. 2015. Gamification in theory and action: A survey. International Journal of Human-Computer Studies 74 (2015), 14–31. https://doi.org/10.1016/j.ijhcs.2014.09.006

Digital Library

[45]

Sophia C Steinhaeusser, Anna Riedmann, Max Haller, Sebastian Oberdörfer, Kristina Bucher, and Marc Erich Latoschik. 2019. Fancy Fruits - An Augmented Reality Application for Special Needs Education. In Proceedings of the 11th International Conference on Virtual Worlds and Games for Serious Applications (VS Games ’19). IEEE, Vienna, Austria.

[46]

Home Science Tools. 2020. Frog Dissection Guide Project. available at https://learning-center.homesciencetools.com/article/frog-dissection-project/.

[47]

Unity. 2021. Unity. available at https://unity.com.

[48]

Unity. 2021. Unity. available at https://unity3d.com/unity/whats-new/2019.3.9.

[49]

Penny Ur. 1996. A Course in Language Teaching. Cambridge University Press.

[50]

Christine Youngblut. 2001. Use of multimedia technology to provide solutions to existing curriculum problems: Virtual frog dissection. Ph.D. Dissertation. George Mason University, United States.

Cited By

Bouquet EVon Der Au SSchneegass CAlt F(2024)CoAR-TV: Design and Evaluation of Asynchronous Collaboration in AR-Supported TV ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656320(231-245)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656320
Oberdörfer SElsässer AGrafe SLatoschik M(2023)Superfrog: Comparing Learning Outcomes and Potentials of a Worksheet, Smartphone, and Tangible AR Learning EnvironmentImmersive Learning Research Network10.1007/978-3-031-47328-9_26(343-364)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-47328-9_26
Oberdörfer SBirnstiel SLatoschik MGrafe S(2021)Mutual Benefits: Interdisciplinary Education of Pre-Service Teachers and HCI Students in VR/AR Learning Environment DesignFrontiers in Education10.3389/feduc.2021.6930126Online publication date: 30-Jun-2021
https://doi.org/10.3389/feduc.2021.693012

Recommendations

Horst - The teaching frog: learning the anatomy of a frog using tangible AR
MuC '20: Proceedings of Mensch und Computer 2020

Learning environments targeting Augmented Reality (AR) visualize complex facts, can increase a learner's motivation, and allow for the application of learning contents. When using tangible user interfaces, the learning process receives a physical aspect ...
AR and VR Enhances Learning
Smart Learning for A Sustainable Society
Abstract
AR and VR technologies hold significant potential for enhancing learning by creating captivating and interactive environments. AR overlays digital information onto the real world, while VR generates fully simulated settings, offering realistic ...
Membrane AR: varifocal, wide field of view augmented reality display from deformable membranes
SIGGRAPH '17: ACM SIGGRAPH 2017 Emerging Technologies

Accommodative depth cues, a wide field of view, and ever-higher resolutions present major design challenges for near-eye displays. Optimizing a design to overcome one of them typically leads to a trade-off in the others. We tackle this problem by ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction

September 2021

637 pages

ISBN:9781450383288

DOI:10.1145/3447526

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Deutsche Telekom Stiftung

Conference

MobileHCI '21

Sponsor:

SIGCHI

MobileHCI '21: 23rd International Conference on Mobile Human-Computer Interaction

September 27 - October 1, 2021

Toulouse & Virtual, France

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
370
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)7

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bouquet EVon Der Au SSchneegass CAlt F(2024)CoAR-TV: Design and Evaluation of Asynchronous Collaboration in AR-Supported TV ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656320(231-245)Online publication date: 7-Jun-2024
https://dl.acm.org/doi/10.1145/3639701.3656320
Oberdörfer SElsässer AGrafe SLatoschik M(2023)Superfrog: Comparing Learning Outcomes and Potentials of a Worksheet, Smartphone, and Tangible AR Learning EnvironmentImmersive Learning Research Network10.1007/978-3-031-47328-9_26(343-364)Online publication date: 31-Oct-2023
https://doi.org/10.1007/978-3-031-47328-9_26
Oberdörfer SBirnstiel SLatoschik MGrafe S(2021)Mutual Benefits: Interdisciplinary Education of Pre-Service Teachers and HCI Students in VR/AR Learning Environment DesignFrontiers in Education10.3389/feduc.2021.6930126Online publication date: 30-Jun-2021
https://doi.org/10.3389/feduc.2021.693012

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents