Abstract
Optical-reflection type Augmented Reality (AR) mirror displays use half-silvered mirrors attached in front of a digital display to show virtual objects overlaid into the physical world reflected in the mirror. Prior works mostly displayed 2D images on the surface of the mirror hence suffered from visual depth mismatch between the optical reflection of the 3D physical space and the virtual image. In this paper, we propose to use 3D visualisation to overcome this problem and improve the user experience by providing better depth perception for watching and interacting with the content displayed on an AR mirror. As a proof-of-concept, we developed two prototype optical-reflection type 3D AR mirror displays, one using a multi-view autostereoscopic 3D display and another using a head tracked stereoscopic 3D display that supports hand gesture interaction. A preliminary user study showed that the participants were able to perform selection tasks faster and with less error under 3D visualisation, and felt the 3D visualisation required less mental effort, was more comfortable to watch and interact with compared to the traditional 2D visualisation. The results also indicated the participants felt the virtual image was closer to their body, supporting the visual perception model of 3D AR mirror we postulated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Anderson, F., Grossman, T., Matejka, J., Fitzmaurice, G.: YouMove: enhancing movement training with an augmented reality mirror. In: Proceedings of the 26th annual ACM symposium. on User interface software and technology. pp. 311–320. ACM, New York, NY, USA (2013)
Chu, M., Dalal, B., Walendowski, A., Begole, B.: Countertop responsive mirror: supporting physical retail shopping for sellers, buyers and companions. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2533–2542. (2010)
Ehara, J., Saito, H.: Texture overlay for virtual clothing based on PCA of silhouettes. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 139–142 (2006)
Eisert, P., Fechteler, P., Rurainsky, J.: 3-D tracking of shoes for virtual mirror applications. In: IEEE Conf. on Computer Vision and Pattern Recognition 2008, pp. 1–6 (2008)
Fujinami, K., Kawsar, F., Nakajima, T.: AwareMirror: a personalized display using a mirror. In: Pervasive, pp. 315–332 (2005)
Kinect for Windows Retail Clothing Scenario Video. https://www.youtube.com/watch?v=Mr71jrkzWq8 Accessed 2 Oct 2020
Lee, G., Rudhru, O., Park, H., Kim, H., Billinghurst, M.: User interface agents for guiding interaction with augmented virtual mirrors. In: Proceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments (ICAT-EGVE 2017), pp. 109–116 (2017)
Lee, G. A., Wong, J., Park, H., Choi, J., Park, C., Billinghurst, M.: User Defined Gestures for Augmented Virtual Mirrors: A Guessability Study. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA 2015), pp. 959–964. ACM, New York, NY, USA (2015)
Li, W.H.A., Fu, H.: Augmented reflection of reality. In: ACM SIGGRAPH 2012 Emerging Technologies, Article No. 3, pp. 1 (2012)
Marquardt, Z., Beira, J., Em, N., Paiva, I., Kox, S.: Super Mirror: a kinect interface for ballet dancers. In: CHI’12 Extended Abstracts on Human Factors in Computing Systems, pp. 1619–1624 (2012)
Mottura, S., Greci, L., Travaini, E., Viganò, G., Sacco, M.: MagicMirror & FootGlove: a new system for the customized shoe try-on. The future of product development, pp. 441–450 (2007)
Ng, K.C., Weyde, T., Larkin, O., Neubarth, K., Koerselman, T., Ong, B.: 3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support. In: Proceedings of the 9th international conf. on Multimodal interfaces, pp. 339–345 (2007)
Portalés, C., Gimeno, J., Casas, S., Olanda, R., MartÃnez, F.G.: Interacting with augmented reality mirrors. In: Handbook of Research on Human-Computer Interfaces, Developments, and Applications, pp. 216–244. IGI Global (2016)
Ushida, K., Tanaka, Y., Naemura, T., Harashima, H.: I-Mirror: an interaction/information environment based on a mirror metaphor aiming to install into our life space. In: Proceedings of the 12th International Conference on Artificial Reality and Telexistence (ICAT 2002), pp. 113–118 (2002)
Plasencia, D. M., Berthaut, F., Karnik, A., Subramanian S.: Through the combining glass. In: Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST 2014), pp. 341–350. ACM, New York, NY, USA (2014)
Zijlstra, F.: Efficiency in work behaviour: A design approach for modern tools (1993)
Acknowledgement
This work was supported by Institute for Information & communications Technology Promotion (IITP) grant funded by the Korea government (MSIT) (No.2017-0-01849, Development of Core Technology for Real-Time Image Composition in Unstructured In-outdoor Environment).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Lee, G.A., Park, H.S., Kim, S., Billinghurst, M. (2020). Improving User Experience in Augmented Reality Mirrors with 3D Displays. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2020. Lecture Notes in Computer Science(), vol 12509. Springer, Cham. https://doi.org/10.1007/978-3-030-64556-4_50
Download citation
DOI: https://doi.org/10.1007/978-3-030-64556-4_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-64555-7
Online ISBN: 978-3-030-64556-4
eBook Packages: Computer ScienceComputer Science (R0)