Abstract
Augmented Reality (AR) technology has become an effective tool in many domains as visualization, planning, operations design in construction, manufacturing, surgery, and other applications. Incorporating virtual objects in a physical world to obtain a realistic augmentation requires correct relationships between real and virtual objects. The traditional static vision of AR consists of interaction and navigation through human beings using computer screens. However, the new technology based on photogrammetry and AR allows strengthening the possibilities in 3D data visualization, navigation, and interaction. This paper proposes a close-range photogrammetry method for 3D reconstruction based on imagery acquisition to get a highly accurate 3D model. The proposed method will deal with real-time orientation and tracking, merging close-range photogrammetry and AR. We validated our approach on data sets representing realistic scenes. Obtained results show the proposed approach’s efficiency and accuracy for solving the occlusion problem in AR systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bullinger, S., Bodensteiner, C., Arens, M.: A photogrammetry-based framework to facilitate image-based modeling and automatic camera tracking. arXiv preprint arXiv:2012.01044 (2020)
Carrión-Ruiz, B., Blanco-Pons, S., Weigert, A., Fai, S., Lerma, J.: Merging photogrammetry and augmented reality: the Canadian library of parliament. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 42(2/W11), 367–371 (2019)
Fukiage, T., Oishi, T., Ikeuchi, K.: Reduction of contradictory partial occlusion in mixed reality by using characteristics of transparency perception. In: 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 129–139. IEEE (2012)
Hayashi, K., Kato, H., Nishida, S.: Occlusion detection of real objects using contour based stereo matching. In: Proceedings of the 2005 International Conference on Augmented Tele-Existence, pp. 180–186 (2005)
Kim, H., Yang, S.j., Sohn, K.: 3D reconstruction of stereo images for interaction between real and virtual worlds. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality 2003. Proceedings, pp. 169–176. IEEE (2003)
Kortaberria, G., Mutilba, U., Gomez-Acedo, E., Tellaeche, A., Minguez, R.: Accuracy evaluation of dense matching techniques for casting part dimensional verification. Sensors 18(9), 3074 (2018)
Lepetit, V., Berger, M.O.: A semi-automatic method for resolving occlusion in augmented reality. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662), vol. 2, pp. 225–230. IEEE (2000)
Lu, Y., Smith, S.: GPU-based real-time occlusion in an immersive augmented reality environment. J. Comput. Inf. Sci. Eng. 9(2), 024501 (2009)
Ohta, Y., Sugaya, Y., Igarashi, H., Ohtsuki, T., Taguchi, K.: Share-Z: client/server depth sensing for see-through head-mounted displays. Presence Teleoperators Virtual Environ. 11(2), 176–188 (2002)
Portalés, C., Lerma, J.L., Navarro, S.: Augmented reality and photogrammetry: a synergy to visualize physical and virtual city environments. ISPRS J. Photogramm. Remote Sens. 65(1), 134–142 (2010). https://doi.org/10.1016/j.isprsjprs.2009.10.001
Potabatti, N.S.: Photogrammetry for 3D reconstruction in SOLIDWORKS and its applications in industry. Ph.D. thesis, Purdue University Indianapolis, Indiana (2019)
Rabbi, I., Ullah, S.: A survey on augmented reality challenges and tracking. Acta graphica: znanstveni časopis za tiskarstvo i grafičke komunikacije 24(1–2), 29–46 (2013)
Sanches, S.R., Tokunaga, D.M., Silva, V.F., Sementille, A.C., Tori, R.: Mutual occlusion between real and virtual elements in augmented reality based on fiducial markers. In: 2012 IEEE Workshop on the Applications of Computer Vision (WACV), pp. 49–54. IEEE (2012)
Setohara, H., Kato, H., Kawamoto, K., Tachibana, K.: A simple solution of occlusion problem in augmented reality and its application for interaction. Trans. Virtual Reality Soc. Jpn. 9(4), 387–395 (2004)
Tian, Y., Guan, T., Wang, C.: An automatic occlusion handling method in augmented reality. Sens. Rev. (2010)
Tian, Y., Guan, T., Wang, C.: Real-time occlusion handling in augmented reality based on an object tracking approach. Sensors 10(4), 2885–2900 (2010)
Tian, Y., Long, Y., Xia, D., Yao, H., Zhang, J.: Handling occlusions in augmented reality based on 3D reconstruction method. Neurocomputing 156, 96–104 (2015)
Yokoya, N.: Stereo vision based video see-through mixed reality. In: Proceedings of the 1st International Symposium On Mixed Reality, Yokohama, March 1999 (1999)
Zhou, Y., Ma, J.-T., Hao, Q., Wang, H., Liu, X.-P.: A novel optical see-through head-mounted display with occlusion and intensity matching support. In: Hui, K., et al. (eds.) Edutainment 2007. LNCS, vol. 4469, pp. 56–62. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73011-8_8
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Roumaissa, B., Chaouki, B.M. (2022). Real Time Handling Occlusion in Augmented Reality Based on Photogrammetry. In: Djeddi, C., Siddiqi, I., Jamil, A., Ali Hameed, A., Kucuk, İ. (eds) Pattern Recognition and Artificial Intelligence. MedPRAI 2021. Communications in Computer and Information Science, vol 1543. Springer, Cham. https://doi.org/10.1007/978-3-031-04112-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-04112-9_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-04111-2
Online ISBN: 978-3-031-04112-9
eBook Packages: Computer ScienceComputer Science (R0)