research-article

HoloCollab: a shared virtual platform for physical assembly training using spatially-aware head-mounted displays

Authors:

Mareike Kritzler,

Florian MichahellesAuthors Info & Claims

IoT '17: Proceedings of the Seventh International Conference on the Internet of Things

Article No.: 19, Pages 1 - 7

https://doi.org/10.1145/3131542.3131559

Published: 22 October 2017 Publication History

Abstract

Today's industrial jobs require a skilled and trained workforce as tasks such as maintenance, service, and repair are becoming more complicated and more demanding. Therefore, both education and training for executing these tasks are becoming more important. Usually training is conducted on-site at designated training facilities with physical hardware. However, on-site hands-on training can be expensive as it requires designated training facilities that have to be maintained and need to be traveled to. With Augmented Reality (AR) becoming a substantial part of modern day manufacturing, using AR-based systems to train new workforces is becoming increasingly popular. In this paper, we investigate different training environments that use AR-based support during workforce training. We draw the design space for a shared collaborative AR-based learning space, and present the concept and implementation of HoloCollab which combines having a scalable virtual representation of an industrial scenario, such as assembly, with the benefit of having a trainer on-site with a trainee.

References

[1]

Alexander Bannat, Frank Wallhoff, Gerhard Rigoll, Florian Friesdorf, H Bubb, Sonja Stork, HJ Müller, Anna Schubö, Mathey Wiesbeck, and Michael F Zäh. 2008. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proceedings of the 1st international workshop on cognition for technical systems, Cotesys.

[2]

Mark Billinghurst, Mika Hakkarainen, and Charles Woodward. 2008. Augmented assembly using a mobile phone. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia. ACM, 84--87.

Digital Library

[3]

Jonas Blattgerste, Benjamin Strenge, Patrick Renner, Thies Pfeiffer, and Kai Essig. 2017. Comparing Conventional and Augmented Reality Instructions for Manual Assembly Tasks. (2017).

Digital Library

[4]

Sébastien Bottecchia, Jean-Marc Cieutat, and Jean-Pierre Jessel. 2010. TAC: augmented reality system for collaborative tele-assistance in the field of maintenance through internet. In Proceedings of the 1st Augmented Human International Conference. ACM, 14.

Digital Library

[5]

Sebastian Büttner, Markus Funk, Oliver Sand, and Carsten Röcker. 2016. Using Head-Mounted Displays and In-Situ Projection for Assistive Systems: A Comparison. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 44.

Digital Library

[6]

Sebastian Büttner, Henrik Mucha, Markus Funk, Thomas Kosch, Mario Aehnelt, Sebastian Robert, and Carsten Röcker. 2017. The Design Space of Augmented and Virtual Reality Applications for Assistive Environments in Manufacturing: A Visual Approach. In Proceedings of the 10th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, NY, USA.

Digital Library

[7]

Pierre Dillenbourg, Daniel Schneider, and Paraskevi Synteta. 2002. Virtual learning environments. In 3rd Hellenic Conference" Information & Communication Technologies in Education". Kastaniotis Editions, Greece, 3--18.

[8]

Markus Funk, Andreas Bächler, Liane Bächler, Thomas Kosch, Thomas Heidenreich, and Albrecht Schmidt. 2017. Working with Augmented Reality? A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace. In Proceedings of the 10th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, NY, USA.

Digital Library

[9]

Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015. Using in-situ projection to support cognitively impaired workers at the workplace. In Proceedings of the 17th international ACM SIGACCESS conference on Computers & accessibility. ACM, 185--192.

Digital Library

[10]

Steffen Gauglitz, Cha Lee, Matthew Turk, and Tobias Höllerer. 2012. Integrating the physical environment into mobile remote collaboration. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. ACM, 241--250.

Digital Library

[11]

Scott W Greenwald, Markus Funk, Luke Loreti, David Mayo, and Pattie Maes. 2016. EVA: Exploratory Learning with Virtual Companions Sharing Attention and Context. In Advanced Learning Technologies (ICALT), 2016 IEEE 16th International Conference on. IEEE, 26--30.

[12]

Pavel Gurevich, Joel Lanir, Benjamin Cohen, and Ran Stone. 2012. TeleAdvisor: a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 619--622.

Digital Library

[13]

Jim Hollan and Scott Stornetta. 1992. Beyond being there. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 119--125.

Digital Library

[14]

Mareike Kritzler, Magdalena Murr, and Florian Michahelles. 2016. RemoteBob: Support of On-site Workers via a Telepresence Remote Expert System. In Proceedings of the 6th International Conference on the Internet of Things. ACM, 7--14.

Digital Library

[15]

Jaron Lanier. 2001. Virtually there. Scientific American 284, 4 (2001), 66--75.

[16]

Kangdon Lee. 2012. Augmented reality in education and training. TechTrends 56, 2 (2012), 13--21.

[17]

Fotis Liarokapis and Eike F Anderson. 2010. Using augmented reality as a medium to assist teaching in higher education. (2010).

[18]

Fotis Liarokapis, Nikolaos Mourkoussis, Martin White, Joe Darcy, Maria Sifniotis, Panos Petridis, Anirban Basu, and Paul F Lister. 2004. Web3D and augmented reality to support engineering education. World Transactions on Engineering and Technology Education 3, 1 (2004), 11--14.

[19]

Wei Liu, Adrian David Cheok, Charissa Lim Mei-Ling, and Yin-Leng Theng. 2007. Mixed reality classroom: learning from entertainment. In Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts. ACM, 65--72.

Digital Library

[20]

GI McCalla, JE Greer, VS Kumar, P Meagher, JA Collins, R Tkatch, and B Parkinson. 1997. A peer help system for workplace training. Artificial Intelligence in Education: Knowledge and Media in Learning Systems (1997), 183--190.

[21]

Sakata Nobuchika, Kurata Takeshi, and Kuzuoka Hideaki. Visual Assist with a Laser Pointer and Wearable Display for Remote Collaboration. In Proceedings of The Second International Conference on Collaboration Technologies, Vol. 2006. 66--71.

[22]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, and others. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 741--754.

Digital Library

[23]

N Sakata, T Kurata, T Kato, M Kourogi, and H Kuzuoka. 2005. WACL: supporting telecommunications using-wearable active camera with laser pointer. In Wearable Computers, 2003. Proceedings. Seventh IEEE International Symposium on. IEEE, 53--56.

Digital Library

[24]

S Yuen, Gallayanee Yaoyuneyong, and Erik Johnson. 2011. Augmented reality: An overview and five directions for AR in education. Journal of Educational Technology Development and Exchange 4, 1 (2011), 119--140.

Cited By

Pannakkong WSinghaphandu R(2023)A Review on Enabling Technologies of Industrial Virtual Training SystemsInternational Journal of Knowledge and Systems Science10.4018/IJKSS.35251515:1(1-33)Online publication date: 10-Nov-2023
https://dl.acm.org/doi/10.4018/IJKSS.352515
Kassem KPavlova GSchlund SMichahelles F(2023)Build-A-Bot: Developing A Software Platform For A Modular Mobile RobotProceedings of the 13th International Conference on the Internet of Things10.1145/3627050.3627054(74-81)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3627050.3627054
Cim VHounsell M(2023)Augmented Reality for Assembly Training in Industry: A Systematic Literature MappingProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625020(77-87)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625020
Show More Cited By

Recommendations

Augmented Reality Training for Industrial Assembly Work - Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training?
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Augmented Reality (AR) systems are on their way to industrial application, e.g. projection-based AR is used to enhance assembly work. Previous studies showed advantages of the systems in permanent-use scenarios, such as faster assembly times. In this ...
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
Impact of augmented reality guidance for car repairs on novice users of AR: a field experiment on familiar and unfamiliar tasks
MuC '20: Proceedings of Mensch und Computer 2020

The use of augmented reality (AR) guidance is seen as an opportunity to address the growing complexity of industrial tasks. Previous research showed benefits of AR for different industrial tasks especially for novice users, while other research suggests ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IoT '17: Proceedings of the Seventh International Conference on the Internet of Things

October 2017

211 pages

ISBN:9781450353182

DOI:10.1145/3131542

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IoT '17

IoT '17: 7th International Conference on the Internet of Things

October 22 - 25, 2017

Linz, Austria

Acceptance Rates

Overall Acceptance Rate 28 of 84 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
365
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)1

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pannakkong WSinghaphandu R(2023)A Review on Enabling Technologies of Industrial Virtual Training SystemsInternational Journal of Knowledge and Systems Science10.4018/IJKSS.35251515:1(1-33)Online publication date: 10-Nov-2023
https://dl.acm.org/doi/10.4018/IJKSS.352515
Kassem KPavlova GSchlund SMichahelles F(2023)Build-A-Bot: Developing A Software Platform For A Modular Mobile RobotProceedings of the 13th International Conference on the Internet of Things10.1145/3627050.3627054(74-81)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3627050.3627054
Cim VHounsell M(2023)Augmented Reality for Assembly Training in Industry: A Systematic Literature MappingProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625020(77-87)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3625008.3625020
Fidalgo CYan YCho HSousa MLindlbauer DJorge J(2023)A Survey on Remote Assistance and Training in Mixed Reality EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324708129:5(2291-2303)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247081
Palmarini Rdel Amo IAriansyah DErkoyuncu JRoy R(2023)Augmented Reality for Remote Assistance (ARRA)Springer Handbook of Augmented Reality10.1007/978-3-030-67822-7_27(669-685)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_27
Ang SQuarles J(2022)You’re in for a Bumpy Ride! Uneven Terrain Increases Cybersickness While Navigating with Head Mounted Displays2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR51125.2022.00062(428-435)Online publication date: Mar-2022
https://doi.org/10.1109/VR51125.2022.00062
Chidambaram SReddy SRumple MIpsita AVillanueva ARedick TStuerzlinger WRamani K(2022)EditAR: A Digital Twin Authoring Environment for Creation of AR/VR and Video Instructions from a Single Demonstration2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00048(326-335)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00048
Breitkreuz DMüller MStegelmeyer DMishra R(2022)Augmented Reality Remote Maintenance in Industry: A Systematic Literature ReviewExtended Reality10.1007/978-3-031-15553-6_21(287-305)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1007/978-3-031-15553-6_21
Chidambaram SHuang HHe FQian XVillanueva ARedick TStuerzlinger WRamani K(2021)ProcessAR: An augmented reality-based tool to create in-situ procedural 2D/3D AR InstructionsProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462126(234-249)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462126
Valentina DValentina DSalvatore MStefano R(2021)Smart operators: How Industry 4.0 is affecting the worker’s performance in manufacturing contextsProcedia Computer Science10.1016/j.procs.2021.01.347180(958-967)Online publication date: 2021
https://doi.org/10.1016/j.procs.2021.01.347
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents