Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3491102.3517636acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

ExposAR: Bringing Augmented Reality to the Computational Thinking Agenda through a Collaborative Authoring Tool

Published: 28 April 2022 Publication History

Abstract

There is a growing focus on computational thinking (CT) in terms of supporting children’s understanding of everyday technologies. But unlike other technologies, Augmented Reality (AR) has received limited attention. In this paper, we present ExposAR – a collaborative cross-device AR system enabling children to create, use, and reflect on AR technologies through the co-creation of a simple AR application. With ExposAR, we explore three core design principles: 1) reify computational concepts, 2) support collaborative cross-device authoring, and 3) incorporate the user’s own world. These principles were developed through a co-design process with teachers and evaluated with 46 primary school students. We found that the collaborative authoring process with ExposAR supported students in understanding AR concepts and challenged their perspectives on AR. With these results, we bring AR to the CT agenda and contribute novel design principles for exposing the underlying mechanisms and implications of AR.

Supplementary Material

MP4 File (3491102.3517636-video-figure.mp4)
Video Figure
MP4 File (3491102.3517636-video-preview.mp4)
Video Preview
MP4 File (3491102.3517636-talk-video.mp4)
Talk Video

References

[1]
Adobe. 2021. Adobe Aero. Retrieved 2021-02-11 from https://www.adobe.com/products/aero.html
[2]
Murat Akçayır and Gökçe Akçayır. 2017. Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review 20 (2017), 1–11.
[3]
Yuliana Apaza-Yllachura, Alfredo Paz-Valderrama, and Carlo Corrales-Delgado. 2019. SimpleAR: Augmented Reality high-level content design framework using visual programming. In 2019 38th International Conference of the Chilean Computer Science Society (SCCC). IEEE, 1–7.
[4]
Apple Inc.2021. Reality Composer. Retrieved 2021-02-11 from https://developer.apple.com/augmented-reality/tools/
[5]
Apple Inc.2022. ARKit. Retrieved 2022-01-10 from https://developer.apple.com/augmented-reality/arkit/
[6]
Michel Beaudouin-Lafon and Wendy E. Mackay. 2000. Reification, Polymorphism and Reuse: Three Principles for Designing Visual Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (Palermo, Italy) (AVI ’00). Association for Computing Machinery, New York, NY, USA, 102–109. https://doi.org/10.1145/345513.345267
[7]
Karl-Emil Kjær Bilstrup, Magnus H. Kaspersen, and Marianne Graves Petersen. 2020. Staging Reflections on Ethical Dilemmas in Machine Learning: A Card-Based Design Workshop for High School Students. Association for Computing Machinery, New York, NY, USA, 1211–1222. https://doi.org/10.1145/3357236.3395558
[8]
Paulo Blikstein. 2013. Gears of Our Childhood: Constructionist Toolkits, Robotics, and Physical Computing, Past and Future. In Proceedings of the 12th International Conference on Interaction Design and Children (New York, New York, USA) (IDC ’13). Association for Computing Machinery, New York, NY, USA, 173–182. https://doi.org/10.1145/2485760.2485786
[9]
Karen Brennan and Mitchel Resnick. 2012. New frameworks for studying and assessing the development of computational thinking. In Proceedings of the 2012 annual meeting of the American educational research association, Vancouver, Canada, Vol. 1. 25.
[10]
Frederik Brudy, Christian Holz, Roman Rädle, Chi-Jui Wu, Steven Houben, Clemens Nylandsted Klokmose, and Nicolai Marquardt. 2019. Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices. Association for Computing Machinery, New York, NY, USA, 1–28. https://doi.org/10.1145/3290605.3300792
[11]
ByteDance. 2021. TikTok. Retrieved 2022-01-10 from https://www.tiktok.com/en/
[12]
Joshua Chan, Tarun Pondicherry, and Paulo Blikstein. 2013. LightUp: an augmented, learning platform for electronics. In Proceedings of the 12th International Conference on Interaction Design and Children. 491–494.
[13]
Victoria Clarke and Virginia Braun. 2014. Thematic analysis. In Encyclopedia of critical psychology. Springer, 1947–1952.
[14]
CoSpaces Edu. 2021. CoSpaces Edu. Retrieved 2021-02-11 from https://cospaces.io/edu/
[15]
Kurtis Danyluk, Barrett Ens, Bernhard Jenny, and Wesley Willett. 2021. A Design Space Exploration of Worlds in Miniature. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445098
[16]
E Gutiérrez de Ravé, Francisco J Jiménez-Hornero, Ana B Ariza-Villaverde, and J Taguas-Ruiz. 2016. DiedricAR: a mobile augmented reality system designed for the ubiquitous descriptive geometry learning. Multimedia Tools and Applications 75, 16 (2016), 9641–9663.
[17]
Christian Dindler, Rachel Smith, and Ole Sejer Iversen. 2020. Computational empowerment: participatory design in education. CoDesign 16, 1 (2020), 66–80.
[18]
Forbes. 2021. 9 Powerful Real-world Applications of Augmented Reality. Retrieved 2021-02-11 from https://www.forbes.com/sites/bernardmarr/2018/07/30/9-powerful-real-world-applications-of-augmented-reality-ar-today/
[19]
Anna Fuste and Chris Schmandt. 2019. HyperCubes: A Playful Introduction to Computational Thinking in Augmented Reality. In Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. 379–387.
[20]
Anna Gardeli and Spyros Vosinakis. 2019. ARQuest: A tangible augmented reality approach to developing computational thinking skills. In 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games). IEEE, 1–8.
[21]
Engida H Gebre. 2018. Young adults’ understanding and use of data: insights for fostering secondary school students’ data literacy. Canadian Journal of Science, Mathematics and Technology Education 18, 4(2018), 330–341.
[22]
Google. 2022. ARCore. Retrieved 2022-01-10 from https://developers.google.com/ar
[23]
Jens Emil Grønbæk, Mille Skovhus Knudsen, Kenton O’Hara, Peter Gall Krogh, Jo Vermeulen, and Marianne Graves Petersen. 2020. Proxemics Beyond Proximity: Designing for Flexible Social Interaction Through Cross-Device Interaction. Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376379
[24]
Shuchi Grover and Roy Pea. 2013. Computational Thinking in K–12: A Review of the State of the Field. Educational Researcher 42, 1 (2013), 38–43. https://doi.org/10.3102/0013189X12463051 arXiv:https://doi.org/10.3102/0013189X12463051
[25]
Guillermo Rauch. 2022. Socket.IO. Retrieved 2022-01-10 from https://socket.io/
[26]
Leila Homaeian, Nippun Goyal, James R Wallace, and Stacey D Scott. 2018. Group vs individual: Impact of touch and tilt cross-device interactions on mixed-focus collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.
[27]
Steven Houben, Connie Golsteijn, Sarah Gallacher, Rose Johnson, Saskia Bakker, Nicolai Marquardt, Licia Capra, and Yvonne Rogers. 2016. Physikit: Data Engagement Through Physical Ambient Visualizations in the Home. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1608–1619. https://doi.org/10.1145/2858036.2858059
[28]
Steven Houben, Nicolai Marquardt, Jo Vermeulen, Clemens Klokmose, Johannes Schöning, Harald Reiterer, and Christian Holz. 2017. Opportunities and challenges for cross-device interactions in the wild. interactions 24, 5 (2017), 58–63.
[29]
Ole Sejer Iversen, Rachel Charlotte Smith, and Christian Dindler. 2018. From computational thinking to computational empowerment: a 21st century PD agenda. In Proceedings of the 15th Participatory Design Conference: Full Papers-Volume 1. 1–11.
[30]
Yasmin Kafai, Chris Proctor, and Debora Lui. 2020. From Theory Bias to Theory Dialogue: Embracing Cognitive, Situated, and Critical Framings of Computational Thinking in K-12 CS Education. ACM Inroads 11, 1 (feb 2020), 44–53. https://doi.org/10.1145/3381887
[31]
Seokbin Kang, Ekta Shokeen, Virginia L Byrne, Leyla Norooz, Elizabeth Bonsignore, Caro Williams-Pierce, and Jon E Froehlich. 2020. ARMath: Augmenting Everyday Life with Math Learning. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15.
[32]
Magnus Høholt Kaspersen, Karl-Emil Kjær Bilstrup, and Marianne Graves Petersen. 2021. [IN PRESS] The Machine Learning Machine: A Tangible User Interface for Teaching Machine Learning. Fifteenth International Conference onTangible, Embedded, and Embodied Interaction (TEI ’21), 12.
[33]
Hannes Kaufmann, Dieter Schmalstieg, and Michael Wagner. 2000. Construct3D: a virtual reality application for mathematics and geometry education. Education and information technologies 5, 4 (2000), 263–276.
[34]
Keiichi Matsuda. 2022. Hyper Reality. Retrieved 2022-01-10 from http://hyper-reality.co
[35]
Soo Kyun Kim, Shin-Jin Kang, Yoo-Joo Choi, Min-Hyung Choi, and Min Hong. 2017. Augmented-reality survey: from concept to application. KSII Transactions on Internet and Information Systems (TIIS) 11, 2(2017), 982–1004.
[36]
Veronika Krauß, Alexander Boden, Leif Oppermann, and René Reiners. 2021. Current Practices, Challenges, and Design Implications for Collaborative AR/VR Application Development. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445335
[37]
Susan Lechelt, Yvonne Rogers, and Nicolai Marquardt. 2020. Coming to Your Senses: Promoting Critical Thinking about Sensors through Playful Interaction in Classrooms. In Proceedings of the Interaction Design and Children Conference (London, United Kingdom) (IDC ’20). Association for Computing Machinery, New York, NY, USA, 11–22. https://doi.org/10.1145/3392063.3394401
[38]
Susan Lechelt, Yvonne Rogers, and Nicolai Marquardt. 2020. Coming to Your Senses: Promoting Critical Thinking about Sensors through Playful Interaction in Classrooms. In Proceedings of the Interaction Design and Children Conference (London, United Kingdom) (IDC ’20). Association for Computing Machinery, New York, NY, USA, 11–22. https://doi.org/10.1145/3392063.3394401
[39]
Germán Leiva, Nolwenn Maudet, Wendy Mackay, and Michel Beaudouin-Lafon. 2019. Enact: Reducing Designer–Developer Breakdowns When Prototyping Custom Interactions. ACM Trans. Comput.-Hum. Interact. 26, 3, Article 19 (May 2019), 48 pages. https://doi.org/10.1145/3310276
[40]
Duri Long and Brian Magerko. 2020. What is AI Literacy? Competencies and Design Considerations. Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3313831.3376727
[41]
Sze Yee Lye and Joyce Hwee Ling Koh. 2014. Review on teaching and learning of computational thinking through programming: What is next for K-12?Computers in Human Behavior 41 (2014), 51 – 61. https://doi.org/10.1016/j.chb.2014.09.012
[42]
Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-Device Interaction via Micro-Mobility and f-Formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). Association for Computing Machinery, New York, NY, USA, 13–22. https://doi.org/10.1145/2380116.2380121
[43]
Niantec Labs. 2021. Niantec Labs’ business site. Retrieved 2021-02-08 from https://nianticlabs.com/en/business/
[44]
Niantec Labs. 2022. Pokémon GO. Retrieved 2022-01-10 from https://pokemongolive.com/en/
[45]
OpenJS Foundation. 2022. Node.js. Retrieved 2022-01-10 from https://nodejs.org/en/
[46]
Seymour Papert and Idit Harel. 1991. Situating constructionism. Constructionism 36, 2 (1991), 1–11.
[47]
Seymour A Papert. 1990. Mindstorms: Children, computers, and powerful ideas. Basic books.
[48]
Iulian Radu and Blair MacIntyre. 2009. Augmented-reality scratch: a children’s authoring environment for augmented-reality experiences. In Proceedings of the 8th International Conference on Interaction Design and Children. 210–213.
[49]
Beatriz Redondo, Ramón Cózar-Gutiérrez, José Antonio González-Calero, and Raquel Sánchez Ruiz. 2020. Integration of augmented reality in the teaching of English as a foreign language in early childhood education. Early Childhood Education Journal 48, 2 (2020), 147–155.
[50]
Mitchel Resnick and Brian Silverman. 2005. Some Reflections on Designing Construction Kits for Kids. In Proceedings of the 2005 Conference on Interaction Design and Children (Boulder, Colorado) (IDC ’05). Association for Computing Machinery, New York, NY, USA, 117–122. https://doi.org/10.1145/1109540.1109556
[51]
Ricardo Cabello. 2022. Three.js. Retrieved 2022-01-10 from https://threejs.org
[52]
Savia Lobo. 2021. TorchAR, a 3D design platform for prototyping mobile AR. Retrieved 2021-09-01 from https://hub.packtpub.com/torch-ar-a-3d-design-platform-for-prototyping-mobile-ar/
[53]
Shourya Pratap Singh, Ankit Kumar Panda, Susobhit Panigrahi, Ajaya Kumar Dash, and Debi Prosad Dogra. 2018. PlutoAR: An Inexpensive, Interactive And Portable Augmented Reality Based Interpreter For K-10 Curriculum. arXiv preprint arXiv:1809.00375(2018).
[54]
Snap Inc.2021. Lens Studio. Retrieved 2021-02-11 from https://lensstudio.snapchat.com/
[55]
Snap Inc.2021. Snapchat. Retrieved 2022-01-10 from https://www.snapchat.com
[56]
Maximilian Speicher, Brian D. Hall, Ao Yu, Bowen Zhang, Haihua Zhang, Janet Nebeling, and Michael Nebeling. 2018. XD-AR: Challenges and Opportunities in Cross-Device Augmented Reality Application Development. Proc. ACM Hum.-Comput. Interact. 2, EICS, Article 7 (June 2018), 24 pages. https://doi.org/10.1145/3229089
[57]
Sonja Špiranec, Denis Kos, and Michael George. 2019. Searching for critical dimensions in data literacy. (2019).
[58]
Anthony Tang, Melanie Tory, Barry Po, Petra Neumann, and Sheelagh Carpendale. 2006. Collaborative coupling over tabletop displays. In Proceedings of the SIGCHI conference on Human Factors in computing systems. 1181–1190.
[59]
David Touretzky, Christina Gardner-McCune, Fred Martin, and Deborah Seehorn. 2019. Envisioning AI for K-12: What should every child know about AI?. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 9795–9799.
[60]
Unity Technologies. 2022. AR Foundations. Retrieved 2021-01-10 from https://docs.unity3d.com/Packages/[email protected]/manual/index.html
[61]
Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Kylie Peppler, Thomas Redick, and Karthik Ramani. 2020. Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[62]
Jeannette M Wing. 2006. Computational thinking. Commun. ACM 49, 3 (2006), 33–35.
[63]
Jeannette M Wing. 2008. Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 366, 1881 (2008), 3717–3725.
[64]
Rabia Meryem Yilmaz and Yuksel Goktas. 2017. Using augmented reality technology in storytelling activities: examining elementary students’ narrative skill and creativity. Virtual Reality 21, 2 (2017), 75–89.
[65]
Johannes Zagermann, Ulrike Pfeil, Roman Rädle, Hans-Christian Jetter, Clemens Klokmose, and Harald Reiterer. 2016. When tablets meet tabletops: The effect of tabletop size on around-the-table collaboration with personal tablets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5470–5481.
[66]
LeChen Zhang and Jalal Nouri. 2019. A systematic review of learning computational thinking through Scratch in K-9. Computers & Education 141 (2019), 103607. https://doi.org/10.1016/j.compedu.2019.103607
[67]
Abigail Zimmermann-Niefield, Makenna Turner, Bridget Murphy, Shaun K. Kane, and R. Benjamin Shapiro. 2019. Youth Learning Machine Learning through Building Models of Athletic Moves. In Proceedings of the 18th ACM International Conference on Interaction Design and Children(Boise, ID, USA) (IDC ’19). Association for Computing Machinery, New York, NY, USA, 121–132. https://doi.org/10.1145/3311927.3323139
[68]
Shoshana Zuboff. 2018. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power(1st ed.).

Cited By

View all
  • (2024)Using Artmaking Generative AIs to Support Augmented Reality Learning Designs With Adobe Aero AppInquiries of Pedagogical Shifts and Critical Mindsets Among Educators10.4018/979-8-3693-1078-6.ch006(132-152)Online publication date: 8-Mar-2024
  • (2024)Spools and Sparks: The Role of Materiality in Computational Making with E-textiles and BBC Micro:bitProceedings of the Halfway to the Future Symposium10.1145/3686169.3686182(1-11)Online publication date: 21-Oct-2024
  • (2024)SurfShareProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314187:4(1-24)Online publication date: 12-Jan-2024
  • Show More Cited By

Index Terms

  1. ExposAR: Bringing Augmented Reality to the Computational Thinking Agenda through a Collaborative Authoring Tool

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
      April 2022
      10459 pages
      ISBN:9781450391573
      DOI:10.1145/3491102
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 April 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Augmented reality
      2. computational thinking
      3. education
      4. interactive learning system

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      CHI '22
      Sponsor:
      CHI '22: CHI Conference on Human Factors in Computing Systems
      April 29 - May 5, 2022
      LA, New Orleans, USA

      Acceptance Rates

      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)192
      • Downloads (Last 6 weeks)12
      Reflects downloads up to 01 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Using Artmaking Generative AIs to Support Augmented Reality Learning Designs With Adobe Aero AppInquiries of Pedagogical Shifts and Critical Mindsets Among Educators10.4018/979-8-3693-1078-6.ch006(132-152)Online publication date: 8-Mar-2024
      • (2024)Spools and Sparks: The Role of Materiality in Computational Making with E-textiles and BBC Micro:bitProceedings of the Halfway to the Future Symposium10.1145/3686169.3686182(1-11)Online publication date: 21-Oct-2024
      • (2024)SurfShareProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314187:4(1-24)Online publication date: 12-Jan-2024
      • (2024)“Oh My God! It’s Recreating Our Room!” Understanding Children’s Experiences with A Room-Scale Augmented Reality Authoring ToolkitProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642043(1-17)Online publication date: 11-May-2024
      • (2024)RoboVisAR: Immersive Authoring of Condition-based AR Robot VisualisationsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634972(462-471)Online publication date: 11-Mar-2024
      • (2024)A research agenda for computational empowerment for emerging technology educationInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2023.10061638:COnline publication date: 27-Feb-2024
      • (2024)Co-design Pedagogy for Computational Thinking Education in K-12: A Systematic Literature ReviewTechnology, Knowledge and Learning10.1007/s10758-024-09765-yOnline publication date: 6-Aug-2024
      • (2023)Getting Started With Augmented Reality (AR) in Inclusive Online Teaching and Learning in Higher EducationNavigating Virtual Worlds and the Metaverse for Enhanced E-Learning10.4018/979-8-3693-1034-2.ch003(20-83)Online publication date: 24-Nov-2023
      • (2023)The Reflective Make-AR In-Action: Using Augmented Reality for Reflection-based Learning of MakerskillsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585850(1-6)Online publication date: 19-Apr-2023
      • (2023)Co-designing sustainable practices for emerging technologies educationInternational Journal of Technology and Design Education10.1007/s10798-023-09857-334:3(1187-1209)Online publication date: 13-Oct-2023
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media