Abstract
Mixed reality technology has evolved from virtual reality and enables the creation of interactive feedback loops between the real and virtual worlds. It has practical applications in training and industrial manufacturing. This paper proposes a virtual assembly guidance system based on mixed reality technology and helmets to overcome the challenges of high cost, danger, and difficulty in equipment installation during training and practice. Using Unity 3D and Microsoft’s Hololens 2, the system integrates virtual models with real space to guide operators in assembling fictitious spaceships. The system improves the existing third-person perspective scheme of mixed reality, enabling bystanders to watch the virtual-reality fusion operation process through their mobile phones, thereby overcoming the exclusivity problem of virtual reality and mixed reality. Results show that the system’s interaction mode is more natural and efficient, while the third-person perspective function solves the isolation problem of existing virtual assembly systems. The design is universal and highly useful.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Yang, Q., Zhong, S.: Research on the development of virtual reality technology in China: review and prospect. Sci. Manage. Res. 38(05), 20–26 (2020)
Zhao, Z.: Research on online quality control method for assembly process of complex mechanical products. Hefei University of Technology, Hefei (2013)
Ye, N., Banerjee, P., Banerjee, A., et al.: A comparative study of assembly planning in traditional and virtual environments. IEEE Trans. Syst. Man Cybern. Part C 29(4), 546–555 (2002)
Shan, X., Zhu, M., Li, J., et al.: Research on ship digital assembly process design and simulation technology. Aviat. Manuf. Technol. 465(21), 57–59 (2014)
Boonmee, P., Jantarakongkul, B., Jitngernmadan, P.: VR training environment for electrical vehicle assembly training in EEC. In: 2020-5th International Conference on Information Technology (INCIT 2020), pp. 238–242 (2020)
Liu, Y., Tang, Y., Zhao, J., et al.: 5G+ VR industrial technology application. In: 2020 International Conference on virtual reality and visualization (ICVRV 2020), pp. 336–337 (2020)
Jayaram, S., Connacher, H.I., Lyons, K.W.: Virtual assembly using virtual reality techniques. Comput. Aided Des. 29(8), 575–584 (1997)
Sagardia, M., Hulin, T., Hertkorn, K., et al.: A platform for bimanual virtual assembly training with haptic feedback in large multi-object environments. In: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pp. 153–162 (2016)
Roo, J.S., Hachet, M.: One reality: augmenting how the physical world is experienced by combining multiple mixed reality modalities. In: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, pp. 787–795 (2017)
Abidi, M.H., Al-Ahmari, A.M., Ahmad, A., et al.: Semi-immersive virtual turbine engine simulation system. Int. J. Turbo Jet-Engines 35(2), 149–160 (2018)
Noghabaei, M., Asadi, K., Han, K.: Virtual manipulation in an immersive virtual environment: simulation of virtual assembly. In: ASCE International Conference on Computing in Civil Engineering, pp. 95–102 (2019)
Meier, N., Müller-Polyzou, R., Brach, L., et al.: Digital twin support for laser-based assembly assistance. Procedia CIRP 99(5), 460–465 (2021)
Shang, L., Wang, B., Yang, Z., et al.: Research and implementation of ship auxiliary engine disassembly and assembly system based on HoloLens. China Navig. 41(3), 38–42 (2018)
Zhang, X., Zhang, Y., Wang, M., et al.: Mining equipment maintenance guidance system based on hybrid reality. Ind. Mining Autom. 45(6), 27–31 (2019)
Wei, Y., Zhang, Y., Zhang, H., et al.: Research on third-party perspective technology for headworn augmented/hybrid reality devices. Comput. Worker Cheng 47(6), 284–291 (2021)
Zhang, P.: Design and implementation of manufacturing cell simulation system based on unity engine. University of the Chinese Academy of Sciences (Shenyang Institute of Computing Technology, Chinese Academy of Sciences), Shenyang (2018)
Chen, X.: Research on robot teaching and reproduction technology based on augmented reality and natural human-computer interaction. South China University of Technology, Guangdong (2018)
Zhao, C.: Research and development of steam turbine maintenance auxiliary system based on AR. North China Electric Power University, Beijing (2021)
Xing, L.: Printing machine operation training system based on mixed reality. Xi’an University of Technology, Xi’an (2021)
Spectator view for Hololens and Hololens 2. https://docs.microsoft.com/en-us/windows/mixedreality/design/spectator-view. Accessed 8 Mar 2022
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wu, H., Sun, N. (2023). Design of Virtual Assembly Guidance System Based on Mixed Reality. In: Lu, H., et al. Image and Graphics . ICIG 2023. Lecture Notes in Computer Science, vol 14359. Springer, Cham. https://doi.org/10.1007/978-3-031-46317-4_27
Download citation
DOI: https://doi.org/10.1007/978-3-031-46317-4_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46316-7
Online ISBN: 978-3-031-46317-4
eBook Packages: Computer ScienceComputer Science (R0)