Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3411764.3445726acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article
Open access

RobotAR: An Augmented Reality Compatible Teleconsulting Robotics Toolkit for Augmented Makerspace Experiences

Published: 07 May 2021 Publication History

Abstract

Distance learning is facing a critical moment finding a balance between high quality education for remote students and engaging them in hands-on learning. This is particularly relevant for project-based classrooms and makerspaces, which typically require extensive trouble-shooting and example demonstrations from instructors. We present RobotAR, a teleconsulting robotics toolkit for creating Augmented Reality (AR) makerspaces. We present the hardware and software for an AR-compatible robot, which behaves as a student’s voice assistant and can be embodied by the instructor for teleconsultation. As a desktop-based teleconsulting agent, the instructor has control of the robot’s joints and position to better focus on areas of interest inside the workspace. Similarly, the instructor has access to the student’s virtual environment and the capability to create AR content to aid the student with problem-solving. We also performed a user study which compares current techniques for distance hands-on learning and an implementation of our toolkit.

Supplementary Material

VTT File (3411764.3445726_videofigurecaptions.vtt)
MP4 File (3411764.3445726_videofigure.mp4)
Supplemental video

References

[1]
2020. ARCore. https://developers.google.com/ar/.
[2]
2020. Baxter, a versatile manufacturing robot. https://robots.ieee.org/robots/baxter/.
[3]
2020. Bioloid, STEM Standard Robot Kit. https://www.trossenrobotics.com/bioloid-stem-standard-robot-kit.aspx.
[4]
2020. Darwin OP2 Robot. https://www.robotlab.com/store/darwin-op2-robot.
[5]
2020. Double Robotics - Telepresence Robot for Telecommuters. https://www.doublerobotics.com/.
[6]
2020. Google Classroom - Manage the Classroom with Ease. https://classroom.google.com/h.
[7]
2020. Keepon, a social robot. https://robots.ieee.org/robots/keepon/.
[8]
2020. KUBI Telepresence Robot. https://www.kubiconnect.com/.
[9]
2020. Nao, the humanoid and programmable robot. https://www.softbankrobotics.com/emea/en/nao.
[10]
2020. Ohmni Robot - OhmniLabs. https://ohmnilabs.com/.
[11]
2020. Robot Tiro. https://www.roboticstoday.com/robots/tiro.
[12]
2020. RoboThespian. https://robots.ieee.org/robots/robothespian/.
[13]
2020. Skype | Communication tool for free calls and chat. https://www.skype.com/en/.
[14]
2020. WebEx. https://www.webex.com/.
[15]
2020. Wit.ai. https://wit.ai/.
[16]
2020. Zoom: Video Conferencing, Web Conferencing, Webinars. https://zoom.us/.
[17]
Batu Akan, Afshin Ameri, Baran Cürüklü, and Lars Asplund. 2011. Intuitive industrial robot programming through incremental multimodal language and augmented reality. In 2011 IEEE International Conference on Robotics and Automation. IEEE, 3934–3939.
[18]
Minoo Alemi, Ali Meghdari, and Maryam Ghazisaedy. 2014. Employing humanoid robots for teaching English language in Iranian junior high-schools. International Journal of Humanoid Robotics 11, 03 (2014), 1450022.
[19]
Ronald T Azuma. 1997. A survey of augmented reality. Presence: Teleoperators & Virtual Environments 6, 4(1997), 355–385.
[20]
Wilma A Bainbridge, Justin Hart, Elizabeth S Kim, and Brian Scassellati. 2008. The effect of presence on human-robot interaction. In RO-MAN 2008-The 17th IEEE International Symposium on Robot and Human Interactive Communication. IEEE, 701–706.
[21]
Wilma A Bainbridge, Justin W Hart, Elizabeth S Kim, and Brian Scassellati. 2011. The benefits of interactions with physically present robots over video-displayed agents. International Journal of Social Robotics 3, 1 (2011), 41–52.
[22]
Tucker Balch, Jay Summet, Doug Blank, Deepak Kumar, Mark Guzdial, Keith O’hara, Daniel Walker, Monica Sweat, Gaurav Gupta, Stewart Tansley, 2008. Designing personal robots for education: Hardware, software, and curriculum. IEEE Pervasive Computing 7, 2 (2008), 5–9.
[23]
Tony Belpaeme, James Kennedy, Paul Baxter, Paul Vogt, Emiel EJ Krahmer, Stefan Kopp, Kirsten Bergmann, Paul Leseman, Aylin C Küntay, Tilbe Göksun, 2015. L2TOR-second language tutoring using social robots. In Proceedings of the ICSR 2015 WONDER Workshop.
[24]
Tony Belpaeme, James Kennedy, Aditi Ramachandran, Brian Scassellati, and Fumihide Tanaka. 2018. Social robots for education: A review. Science robotics 3, 21 (2018).
[25]
Tony Belpaeme, Paul Vogt, Rianne Van den Berghe, Kirsten Bergmann, Tilbe Göksun, Mirjam De Haas, Junko Kanero, James Kennedy, Aylin C Küntay, Ora Oudgenoeg-Paz, 2018. Guidelines for designing social robots as second language tutors. International Journal of Social Robotics 10, 3 (2018), 325–341.
[26]
Brittany J Bice-Urbach and Thomas R Kratochwill. 2016. Teleconsultation: The use of technology to improve evidence-based practices in rural communities. Journal of School Psychology 56 (2016), 27–43.
[27]
A Mejías Borrero and JM Andújar Márquez. 2012. A pilot study of the effectiveness of augmented reality to enhance the use of remote labs in electrical engineering education. Journal of science education and technology 21, 5 (2012), 540–557.
[28]
Keith Brownlee, John R Graham, Esther Doucette, Nicole Hotson, and Glenn Halverson. 2010. Have communication technologies influenced rural social work practice?British Journal of Social Work 40, 2 (2010), 622–637.
[29]
Yuanzhi Cao, Zhuangying Xu, Fan Li, Wentao Zhong, Ke Huo, and Karthik Ramani. 2019. V. Ra: An In-Situ Visual Authoring System for Robot-IoT Task Planning with Augmented Reality. In Proceedings of the 2019 on Designing Interactive Systems Conference. 1059–1070.
[30]
Chih-Wei Chang, Jih-Hsien Lee, Chin-Yeh Wang, and Gwo-Dong Chen. 2010. Improving the authentic learning experience by integrating robots into the mixed-reality environment. Computers & Education 55, 4 (2010), 1572–1578.
[31]
Andrew Chiou. 2012. Teaching technology using educational robotics. In Proceedings of the Australian conference on science and mathematics education (formerly UniServe Science Conference), Vol. 10.
[32]
Autumn Edwards, Chad Edwards, Patric R Spence, Christina Harris, and Andrew Gambino. 2016. Robots in the classroom: Differences in students’ perceptions of credibility and learning between “teacher as robot” and “robot as teacher”. Computers in Human Behavior 65 (2016), 627–634.
[33]
HC Fang, SK Ong, and AYC Nee. 2012. Robot path and end-effector orientation planning using augmented reality. Procedia CIRP 3(2012), 191–196.
[34]
Aaron J Fischer, Bradley S Bloomfield, Racheal R Clark, Amelia L McClelland, and William P Erchul. 2019. Increasing student compliance with teacher instructions using telepresence robot problem-solving teleconsultation. International Journal of School & Educational Psychology 7, sup1(2019), 158–172.
[35]
Aaron J Fischer, Evan H Dart, Keith C Radley, Dylan Richardson, Racheal Clark, and Joy Wimberly. 2017. An evaluation of the effectiveness and acceptability of teleconsultation. Journal of Educational and Psychological Consultation 27, 4(2017), 437–458.
[36]
Ann Bainbridge Frymier and Catherine A Thompson. 1992. Perceived teacher affinity-seeking in relation to perceived teacher credibility. Communication Education 41, 4 (1992), 388–399.
[37]
Jason L Gibson, Robert C Pennington, Donald M Stenhoff, and Jessica S Hopper. 2010. Using desktop videoconferencing to deliver interventions to a preschool student with autism. Topics in Early Childhood Special Education 29, 4 (2010), 214–225.
[38]
Andrea Gomoll, Selma Šabanović, Erin Tolar, Cindy E Hmelo-Silver, Matthew Francisco, and Orion Lawlor. 2018. Between the social and the technical: Negotiation of human-centered robotics design in a middle school classroom. International Journal of Social Robotics 10, 3 (2018), 309–324.
[39]
Scott A Green, Mark Billinghurst, XiaoQi Chen, and J Geoffrey Chase. 2008. Human-robot collaboration: A literature review and augmented reality approach in design. International journal of advanced robotic systems 5, 1 (2008), 1.
[40]
Sunao Hashimoto, Akihiko Ishida, Masahiko Inami, and Takeo Igarashi. [n.d.]. Touchme: An augmented reality based remote robot manipulation.
[41]
Anthony J Hirst, Jeffrey Johnson, Marian Petre, Blaine A Price, and Mike Richards. 2003. What is the best programming environment/language for teaching robotics using Lego Mindstorms?Artificial Life and Robotics 7, 3 (2003), 124–131.
[42]
Ivy S Huang and Johan F Hoorn. 2018. Having an Einstein in Class. Teaching Maths with Robots is Different for Boys and Girls. In 2018 13th World Congress on Intelligent Control and Automation (WCICA). IEEE, 424–427.
[43]
Joris B Janssen, Chrissy C van der Wal, Mark A Neerincx, and Rosemarijn Looije. 2011. Motivating children to learn arithmetic with an adaptive robot game. In International conference on social robotics. Springer, 153–162.
[44]
James Kennedy, Paul Baxter, and Tony Belpaeme. 2015. Comparing robot embodiments in a guided discovery learning interaction with children. International Journal of Social Robotics 7, 2 (2015), 293–308.
[45]
James Kennedy, Paul Baxter, Emmanuel Senft, and Tony Belpaeme. 2016. Social robot tutoring for child second language learning. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 231–238.
[46]
Jacqueline Kory and Cynthia Breazeal. 2014. Storytelling with robots: Learning companions for preschool children’s language development. In The 23rd IEEE international symposium on robot and human interactive communication. IEEE, 643–648.
[47]
Jacqueline M Kory-Westlund and Cynthia Breazeal. 2019. A long-term study of young children’s rapport, social emulation, and language learning with a peer-like robot playmate in preschool. Frontiers in Robotics and AI 6 (2019), 81.
[48]
Jacqueline M Kory Westlund, Sooyeon Jeong, Hae W Park, Samuel Ronfard, Aradhana Adhikari, Paul L Harris, David DeSteno, and Cynthia L Breazeal. 2017. Flat vs. expressive storytelling: young children’s learning and retention of a social robot’s narrative. Frontiers in human neuroscience 11 (2017), 295.
[49]
Hatice Köse, Pınar Uluer, Neziha Akalın, Rabia Yorgancı, Ahmet Özkul, and Gökhan Ince. 2015. The effect of embodiment in sign language tutoring with assistive humanoid robots. International Journal of Social Robotics 7, 4 (2015), 537–548.
[50]
Iolanda Leite, Marissa McCoy, Daniel Ullman, Nicole Salomons, and Brian Scassellati. 2015. Comparing models of disengagement in individual and group interactions. In 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 99–105.
[51]
Daniel Leyzberg, Aditi Ramachandran, and Brian Scassellati. 2018. The effect of personalization in longer-term robot tutoring. ACM Transactions on Human-Robot Interaction (THRI) 7, 3 (2018), 1–19.
[52]
Daniel Leyzberg, Samuel Spaulding, Mariya Toneva, and Brian Scassellati. 2012. The physical presence of a robot tutor increases cognitive learning gains. In Proceedings of the annual meeting of the cognitive science society, Vol. 34.
[53]
Jennifer Lock, Petrea Redmond, Lindy Orwin, Alwyn Powell, Sandra Becker, Paula Hollohan, and Carol Johnson. 2020. Bridging distance: Practical and pedagogical implications of virtual Makerspaces. Journal of Computer Assisted Learning(2020).
[54]
Patrick Lowenthal, Jered Borup, Richard West, and Leanna Archambault. 2020. Thinking Beyond Zoom: Using Asynchronous Video to Maintain Connection and Engagement During the COVID-19 Pandemic. Journal of Technology and Teacher Education 28, 2 (2020), 383–391.
[55]
Zhanat Makhataeva and Huseyin Atakan Varol. 2020. Augmented Reality for Robotics: A Review. Robotics 9, 2 (2020), 21.
[56]
Steve Masson, Patrice Potvin, Martin Riopel, and Lorie-Marlène Brault Foisy. 2014. Differences in brain activation between novices and experts in science during a task involving a common misconception in electricity. Mind, Brain, and Education 8, 1 (2014), 44–55.
[57]
Kelsey P Moore and Adam S Richards. 2019. The Effects of Instructor Credibility, Grade Incentives, and Framing of a Technology Policy on Students’ Intent to Comply and Motivation to Learn. Communication Studies 70, 4 (2019), 394–411.
[58]
Omar Mubin, Catherine J Stevens, Suleman Shahid, Abdullah Al Mahmud, and Jian-Jie Dong. 2013. A review of the applicability of robots in education. Journal of Technology in Education and Learning 1, 209-0015(2013), 13.
[59]
Kate Murphy. 2020. Why zoom is terrible. The New York Times 23(2020).
[60]
Huaishu Peng, Jimmy Briggs, Cheng-Yao Wang, Kevin Guo, Joseph Kider, Stefanie Mueller, Patrick Baudisch, and François Guimbretière. 2018. RoMA: Interactive fabrication with augmented reality and a robotic 3D printer. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–12.
[61]
Kylie Peppler and Diane Glosson. 2013. Stitching circuits: Learning about circuitry through e-textile materials. Journal of Science Education and Technology 22, 5 (2013), 751–763.
[62]
Kylie Peppler, Karen Wohlwend, Naomi Thompson, Verily Tan, and AnnMarie Thomas. 2019. Squishing circuits: Circuitry learning with electronics and playdough in Early Childhood. Journal of Science Education and Technology 28, 2 (2019), 118–132.
[63]
André Pereira, Carlos Martinho, Iolanda Leite, and Ana Paiva. 2008. iCat, the chess player: the influence of embodiment in the enjoyment of a game. In Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems-Volume 3. 1253–1256.
[64]
Thomas Pettersen, John Pretlove, Charlotte Skourup, Torbjorn Engedal, and T Lokstad. 2003. Augmented reality for programming industrial robots. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings. IEEE, 319–320.
[65]
Aditi Ramachandran, Sarah Strohkorb Sebo, and Brian Scassellati. 2019. Personalized robot tutoring using the assistive tutor pOMDP (AT-POMDP). In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 8050–8057.
[66]
Violeta Rosanda and Andreja Istenic Starcic. 2019. The Robot in the Classroom: A Review of a Robot Role. In International Symposium on Emerging Technologies for Education. Springer, 347–357.
[67]
Ben Smith and Jared Mader. 2016. Do I need a robot?The Science Teacher 83, 1 (2016), 8.
[68]
Jaryd Urbani, Mohammed Al-Sada, Tatsuo Nakajima, and Thomas Höglund. 2018. Exploring Augmented Reality Interaction for Everyday Multipurpose Wearable Robots. In 2018 IEEE 24th International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA). IEEE, 209–216.
[69]
Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Kylie Peppler, Thomas Redick, and Karthik Ramani. 2020. Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[70]
Michael Walker, Hooman Hedayati, Jennifer Lee, and Daniel Szafir. 2018. Communicating robot motion intent with augmented reality. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. 316–324.
[71]
Jacqueline Kory Westlund and Cynthia Breazeal. 2015. The interplay of robot language level with children’s language learning during storytelling. In Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction extended abstracts. 65–66.
[72]
Zhen-Jia You, Chi-Yuh Shen, Chih-Wei Chang, Baw-Jhiune Liu, and Gwo-Dong Chen. 2006. A robot as a teaching assistant in an English class. In Sixth IEEE international conference on advanced learning technologies (ICALT’06). IEEE, 87–91.

Cited By

View all
  • (2024)Empowering Autonomous Digital Learning for Older AdultsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651133(1-6)Online publication date: 11-May-2024
  • (2024)ClassMeta: Designing Interactive Virtual Classmate to Promote VR Classroom ParticipationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642947(1-17)Online publication date: 11-May-2024
  • (2024)SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote CollaborationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642945(1-14)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. RobotAR: An Augmented Reality Compatible Teleconsulting Robotics Toolkit for Augmented Makerspace Experiences
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
          May 2021
          10862 pages
          ISBN:9781450380966
          DOI:10.1145/3411764
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 07 May 2021

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. augmented reality
          2. makerspaces
          3. robot
          4. robotics
          5. teleconsulting
          6. voice

          Qualifiers

          • Research-article
          • Research
          • Refereed limited

          Funding Sources

          • NSF
          • OIA
          • C R I

          Conference

          CHI '21
          Sponsor:

          Acceptance Rates

          Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

          Upcoming Conference

          CHI 2025
          ACM CHI Conference on Human Factors in Computing Systems
          April 26 - May 1, 2025
          Yokohama , Japan

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)552
          • Downloads (Last 6 weeks)56
          Reflects downloads up to 24 Dec 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Empowering Autonomous Digital Learning for Older AdultsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651133(1-6)Online publication date: 11-May-2024
          • (2024)ClassMeta: Designing Interactive Virtual Classmate to Promote VR Classroom ParticipationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642947(1-17)Online publication date: 11-May-2024
          • (2024)SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote CollaborationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642945(1-14)Online publication date: 11-May-2024
          • (2024)Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone ApplicationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641901(1-18)Online publication date: 11-May-2024
          • (2024)Usability of visualizing position and orientation deviations for manual precise manipulation of objects in augmented realityVirtual Reality10.1007/s10055-024-01030-y28:3Online publication date: 9-Jul-2024
          • (2023)Periscope: A Robotic Camera System to Support Remote Physical CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/36101997:CSCW2(1-39)Online publication date: 4-Oct-2023
          • (2023)HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606727(1-12)Online publication date: 29-Oct-2023
          • (2023)Designing Robotic Camera Systems to Enable Synchronous Remote CollaborationCompanion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568294.3579974(751-753)Online publication date: 13-Mar-2023
          • (2023)Physica: Interactive Tangible Physics Simulation based on Tabletop Mobile Robots Towards Explorable Physics EducationProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596037(1485-1499)Online publication date: 10-Jul-2023
          • (2023)InstruMentAR: Auto-Generation of Augmented Reality Tutorials for Operating Digital Instruments Through Recording Embodied DemonstrationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581442(1-17)Online publication date: 19-Apr-2023
          • Show More Cited By

          View Options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media