research-article

Public Access

Unequal Impacts of Augmented Reality on Learning and Collaboration During Robot Programming with Peers

Authors:

Bertrand SchneiderAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 4, Issue CSCW3

Article No.: 245, Pages 1 - 23

https://doi.org/10.1145/3432944

Published: 05 January 2021 Publication History

Abstract

Augmented reality (AR) applications are growing in popularity in educational settings. While the effects of AR experiences on learning have been widely studied, there is relatively less research on understanding the impact of AR on the dynamics of co-located collaborative learning, specifically in the context of novices programming robots. Educational robotics are a powerful learning context because they engage students with problem solving, critical thinking, STEM (Science, Technology, Engineering, Mathematics) concepts, and collaboration skills. However, such collaborations can suffer due to students having unequal access to resources or dominant peers. In this research we investigate how augmented reality impacts learning and collaboration while peers engage in robot programming activities. We use a mixed methods approach to measure how participants are learning, manipulating resources, and engaging in problem solving activities with peers. We investigate how these behaviors are impacted by the presence of augmented reality visualizations, and by participants? proximity to resources. We find that augmented reality improved overall group learning and collaboration. Detailed analysis shows that AR strongly helps one participant more than the other, by improving their ability to learn and contribute while remaining engaged with the robot. Furthermore, augmented reality helps both participants maintain a common ground and balance contributions during problem solving activities. We discuss the implications of these results for designing AR and non-AR collaborative interfaces.

Supplementary Material

MP4 File (v4cscw245.mp4)

Supplemental video

Download
76.42 MB

References

[1]

M. Billinghurst, A. Clark, and G. Lee, 'A survey of augmented reality,' Foundations and Trends® in Human--Computer Interaction, vol. 8, no. 2--3, pp. 73--272, 2015.

[2]

I. Radu, 'Augmented reality in education: a meta-review and cross-media analysis,' Personal and Ubiquitous Computing, vol. 18, no. 6, pp. 1533--1543, 2014.

Digital Library

[3]

M. B. Ibáñez, Á. Di Serio, D. Villarán, and C. D. Kloos, 'Experimenting with electromagnetism using augmented reality: Impact on flow student experience and educational effectiveness,' Computers & Education, vol. 71, pp. 1--13, 2014.

[4]

D. P. Maloney, T. L. O'Kuma, C. J. Hieggelke, and A. Van Heuvelen, 'Surveying students' conceptual knowledge of electricity and magnetism,' American Journal of Physics, vol. 69, no. S1, pp. S12--S23, 2001.

[5]

S. Lukosch, M. Billinghurst, K. Kiyokawa, S. Feiner, and L. Alem, 'Collaboration in Mediated and Augmented Reality (CiMAR) Summary,' in 2015 IEEE International Symposium on Mixed and Augmented Reality Workshops (ISMARW), 2015, pp. 1--2.

[6]

I. Radu and B. Schneider, 'Impacts of Augmented Reality on Collaborative Physics Learning, Leadership, and Knowledge Imbalance,' 2019.

[7]

R. Arora and S. Goel, 'Learning to write programs with others: Collaborative quadruple programming,' in 2012 IEEE 25th Conference on Software Engineering Education and Training, 2012, pp. 32--41.

[8]

B. Bevan, 'The promise and the promises of Making in science education,' Studies in Science Education, vol. 53, no. 1, pp. 75--103, Jan. 2017.

[9]

M. Berland, 'Making, tinkering, and computational literacy,' Makeology: Makers as learners, vol. 2, pp. 196--205, 2016.

[10]

D. Weintrop and U. Wilensky, 'Supporting computational expression: How novices use programming primitives in achieving a computational goal,' 2013.

[11]

M. U. Bers, L. Flannery, E. R. Kazakoff, and A. Sullivan, 'Computational thinking and tinkering: Exploration of an early childhood robotics curriculum,' Computers & Education, vol. 72, pp. 145--157, 2014.

[12]

S. Papert, Mindstorms: children, computers, and powerful ideas. New York, NY, USA: Basic Books, Inc., 1980.

Digital Library

[13]

W.-Y. Hwang and S.-Y. Wu, 'A case study of collaboration with multi-robots and its effect on children's interaction,' Interactive Learning Environments, vol. 22, no. 4, pp. 429--443, 2014.

[14]

M. E. Jordan and R. R. McDaniel Jr, 'Managing uncertainty during collaborative problem solving in elementary school teams: The role of peer influence in robotics engineering activity,' Journal of the Learning Sciences, vol. 23, no. 4, pp. 490--536, 2014.

[15]

M. Ucgul and K. Cagiltay, 'Design and development issues for educational robotics training camps,' International Journal of Technology and Design Education, vol. 24, no. 2, pp. 203--222, 2014.

[16]

S. Somyürek, 'An effective educational tool: construction kits for fun and meaningful learning,' International Journal of Technology and Design Education, vol. 25, no. 1, pp. 25--41, 2015.

[17]

A. Eguchi, 'Educational robotics theories and practice: Tips for how to do it right,' in Robots in K-12 education: A new technology for learning, IGI Global, 2012, pp. 1--30.

[18]

T. Yuen et al., 'Group tasks, activities, dynamics, and interactions in collaborative robotics projects with elementary and middle school children,' Journal of STEM Education, vol. 15, no. 1, 2014.

[19]

S. Lukosch, M. Billinghurst, L. Alem, and K. Kiyokawa, 'Collaboration in augmented reality,' Computer Supported Cooperative Work (CSCW), vol. 24, no. 6, pp. 515--525, 2015.

Digital Library

[20]

B. Barron, 'Achieving coordination in collaborative problem-solving groups,' The journal of the learning sciences, vol. 9, no. 4, pp. 403--436, 2000.

[21]

F. C. Brodbeck, R. Kerschreiter, A. Mojzisch, and S. Schulz-Hardt, 'Group decision making under conditions of distributed knowledge: The information asymmetries model.,' Academy of Management Review, vol. 32, no. 2, pp. 459--479, 2007.

[22]

G. Salomon and T. Globerson, 'When teams do not function the way they ought to,' International journal of Educational research, vol. 13, no. 1, pp. 89--99, 1989.

[23]

J. R. Larson Jr, C. Christensen, T. M. Franz, and A. S. Abbott, 'Diagnosing groups: The pooling, management, and impact of shared and unshared case information in team-based medical decision making.,' Journal of personality and social psychology, vol. 75, no. 1, p. 93, 1998.

[24]

M. Baker, T. Hansen, R. Joiner, and D. Traum, 'The role of grounding in collaborative learning tasks,' Collaborative learning: Cognitive and computational approaches, vol. 31, p. 63, 1999.

[25]

R. T. Azuma, 'A survey of augmented reality,' Presence-Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355--385, 1997.

Digital Library

[26]

R. B. Valimont, D. A. Vincenzi, S. N. Gangadharan, and A. E. Majoros, 'The effectiveness of augmented reality as a facilitator of information acquisition,' in Digital Avionics Systems Conference, 2002. Proceedings. The 21st, 2002, vol. 2, pp. 7C5--7C5.

[27]

P. Wijdenes, D. Borkenhagen, J. Babione, I. Ma, and G. Hallihan, 'Leveraging Augmented Reality Training Tool for Medical Education: a Case Study in Central Venous Catheterization,' in Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, 2018, p. CS11.

[28]

A. Tang, C. Owen, F. Biocca, and W. Mou, 'Comparative effectiveness of augmented reality in object assembly,' in Proceedings of the SIGCHI conference on Human factors in computing systems, 2003, pp. 73--80.

[29]

M. Ibanez, C. Delgado Kloos, D. Leony, J. J. Garcia Rueda, and D. Maroto, 'Learning a Foreign Language in a Mixed-Reality Environment,' IEEE Internet Computing, vol. 15, no. 6, pp. 44--47, Nov. 2011.

Digital Library

[30]

K. R. Bujak, I. Radu, R. Catrambone, B. Macintyre, R. Zheng, and G. Golubski, 'A psychological perspective on augmented reality in the mathematics classroom,' Computers & Education, vol. 68, pp. 536--544, 2013.

[31]

M. Dunleavy and C. Dede, 'Augmented reality teaching and learning,' in Handbook of research on educational communications and technology, Springer, 2014, pp. 735--745.

[32]

H. H. Clark and S. E. Brennan, 'Grounding in communication,' in Perspectives on socially shared cognition, L. B. Resnick, J. M. Levine, and S. D. Teasley, Eds. Washington, DC, US: American Psychological Association, 1991, pp. 127--149.

[33]

A. Unahalekhaka, I. Radu, and B. Schneider, 'How Augmented Reality Affects Collaborative Learning of Physics: a Qualitative Analysis,' Jun. 2019, Accessed: Sep. 11, 2020. [Online]. Available: https://repository.isls.org//handle/1/1577.

[34]

K. Kiyokawa, M. Billinghurst, S. E. Hayes, A. Gupta, Y. Sannohe, and H. Kato, 'Communication behaviors of co-located users in collaborative AR interfaces,' in Proceedings. International Symposium on Mixed and Augmented Reality, 2002, pp. 139--148.

[35]

D. N. E. Phon, M. B. Ali, and N. D. A. Halim, 'Collaborative augmented reality in education: A review,' in Teaching and Learning in Computing and Engineering (LaTiCE), 2014 International Conference on, 2014, pp. 78--83.

[36]

T. Pettersen, J. Pretlove, C. Skourup, T. Engedal, and T. Lokstad, 'Augmented reality for programming industrial robots,' in The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings., 2003, pp. 319--320.

[37]

H. C. Fang, S. K. Ong, and A. Y. C. Nee, 'Robot path and end-effector orientation planning using augmented reality,' Procedia CIRP, vol. 3, pp. 191--196, 2012.

[38]

S. Hashimoto, A. Ishida, M. Inami, and T. Igarashi, 'Touchme: An augmented reality based remote robot manipulation,' in The 21st International Conference on Artificial Reality and Telexistence, Proceedings of ICAT2011, 2011, vol. 2.

[39]

B. Akan, A. Ameri, B. Cürüklü, and L. Asplund, 'Intuitive industrial robot programming through incremental multimodal language and augmented reality,' in 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 3934--3939.

[40]

M. Walker, H. Hedayati, J. Lee, and D. Szafir, 'Communicating robot motion intent with augmented reality,' in Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, 2018, pp. 316--324.

[41]

S. A. Green, M. Billinghurst, X. Chen, and J. G. Chase, 'Human-robot collaboration: A literature review and augmented reality approach in design,' International journal of advanced robotic systems, vol. 5, no. 1, p. 1, 2008.

[42]

A. M. Borrero and J. A. Márquez, 'A pilot study of the effectiveness of augmented reality to enhance the use of remote labs in electrical engineering education,' Journal of science education and technology, vol. 21, no. 5, pp. 540--557, 2012.

[43]

C.-W. Chang, J.-H. Lee, C.-Y. Wang, and G.-D. Chen, 'Improving the authentic learning experience by integrating robots into the mixed-reality environment,' Computers & Education, vol. 55, no. 4, pp. 1572--1578, 2010.

Digital Library

[44]

M. Cheli, J. Sinapov, E. E. Danahy, and C. Rogers, 'Towards an augmented reality framework for k-12 robotics education,' 2018.

[45]

A. Sipitakiat, P. Blikstein, and D. P. Cavallo, 'GoGo board: augmenting programmable bricks for economically challenged audiences,' in Proceedings of the 6th international conference on Learning sciences, 2004, pp. 481--488, Accessed: Aug. 31, 2012. [Online]. Available: http://dl.acm.org/citation.cfm'id=1149126.1149185.

[46]

I. Radu and B. Schneider, 'What Can We Learn from Augmented Reality (AR)',' in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, p. 544.

[47]

J. R. Landis and G. G. Koch, 'An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers,' Biometrics, pp. 363--374, 1977.

[48]

B. Schneider and P. Blikstein, 'Unraveling students' interaction around a tangible interface using multimodal learning analytics,' Journal of Educational Data Mining, vol. 7, no. 3, pp. 89--116, 2015.

[49]

D. M. Teague and P. Roe, 'Learning to program: from pear-shaped to pairs,' in Proceedings of the First International Conference on Computer Supported Education, 2009, vol. 2, pp. 151--158.

Cited By

Liu SToreini PMaedche A(2025)AF-Mix: A gaze-aware learning system with attention feedback in mixed realityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2025.103467198(103467)Online publication date: Apr-2025
https://doi.org/10.1016/j.ijhcs.2025.103467
Efthymiou E(2024)The Synergy of Augmented Reality (AR) and Universal Design for Learning (UDL) in Inclusive EducationRevolutionizing Inclusive Education10.4018/979-8-3693-1405-0.ch006(129-152)Online publication date: 21-Aug-2024
https://doi.org/10.4018/979-8-3693-1405-0.ch006
Johansen SBrophy CRittenbruch MDonovan J(2024)Characterising CSCW Research on Human-Robot CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36409998:CSCW1(1-31)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3640999
Show More Cited By

Index Terms

Unequal Impacts of Augmented Reality on Learning and Collaboration During Robot Programming with Peers
1. Applied computing
  1. Education
    1. Collaborative learning
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Collaboration in Augmented Reality

Augmented Reality (AR) is a technology that allows users to view and interact in real time with virtual images seamlessly superimposed over the real world. AR systems can be used to create unique collaborative experiences. For example, co-located users ...
Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and Practice

Augmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 4, Issue CSCW3

CSCW

December 2020

1825 pages

EISSN:2573-0142

DOI:10.1145/3446568

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 January 2021

Published in PACMHCI Volume 4, Issue CSCW3

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
769
Total Downloads

Downloads (Last 12 months)265
Downloads (Last 6 weeks)43

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu SToreini PMaedche A(2025)AF-Mix: A gaze-aware learning system with attention feedback in mixed realityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2025.103467198(103467)Online publication date: Apr-2025
https://doi.org/10.1016/j.ijhcs.2025.103467
Efthymiou E(2024)The Synergy of Augmented Reality (AR) and Universal Design for Learning (UDL) in Inclusive EducationRevolutionizing Inclusive Education10.4018/979-8-3693-1405-0.ch006(129-152)Online publication date: 21-Aug-2024
https://doi.org/10.4018/979-8-3693-1405-0.ch006
Johansen SBrophy CRittenbruch MDonovan J(2024)Characterising CSCW Research on Human-Robot CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36409998:CSCW1(1-31)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3640999
Lee GHealey JManocha D(2024)DocuBits: VR Document Decomposition for Procedural Task Completion2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00053(309-319)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00053
Friedl-Knirsch JStach CPointecker FAnthes CRoth D(2024)A Study on Collaborative Visual Data Analysis in Augmented Reality with Asymmetric Display TypesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337210330:5(2633-2643)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372103
Imashev AKydyrbekova AOralbayeva NKenzhekhan ASandygulova A(2024)Learning sign language with mixed reality applications - the exploratory case study with deaf studentsEducation and Information Technologies10.1007/s10639-024-12525-129:13(17261-17292)Online publication date: 23-Feb-2024
https://dl.acm.org/doi/10.1007/s10639-024-12525-1
Grubišić VCrnokić B(2024)A Systematic Review of Robotics’ Transformative Role in EducationDigital Transformation in Education and Artificial Intelligence Application10.1007/978-3-031-62058-4_16(257-272)Online publication date: 3-Jul-2024
https://doi.org/10.1007/978-3-031-62058-4_16
Beheshti MYujin Kang EYan SLouime EHancock CHira A(2023)Augmented Reality in A Sustainable Engineering Design Context: Understanding Students’ Collaboration and Negotiation PracticesSustainability10.3390/su1601037916:1(379)Online publication date: 31-Dec-2023
https://doi.org/10.3390/su16010379
Venigalla AChimalakonda SChoppella VPhatak DLuxton-Reilly ACraig M(2023)FlowARP - Using Augmented Reality for Visualizing Control Flows in ProgramsProceedings of the ACM Conference on Global Computing Education Vol 110.1145/3576882.3617922(161-167)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3576882.3617922
Radu ISchneider B(2023)How Augmented Reality (AR) Can Help and Hinder Collaborative Learning: A Study of AR in Electromagnetism EducationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.316998029:9(3734-3745)Online publication date: 1-Sep-2023
https://doi.org/10.1109/TVCG.2022.3169980
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents