research-article

On the Interplay between Data Overlay and Real-World Context using See-through Displays

Authors:

Andrea Albarelli,

Augusto Celentano,

Renato MarchiAuthors Info & Claims

CHItaly '15: Proceedings of the 11th Biannual Conference of the Italian SIGCHI Chapter

Pages 58 - 65

https://doi.org/10.1145/2808435.2808455

Published: 28 September 2015 Publication History

Abstract

The recent availability of affordable see-through wearable displays has fostered the development of several new interfaces and applications. Some of them take the augmented reality path, by seeking the blending of physical objects with overlaid 3D models or textual information. Some, on the other hand, are much simpler and follow a rather basic paradigm where the spatial integration between real world and data overlay is dropped. This is the case, for instance, with most applications based on Google Glass hardware, where textual data and images partially share the field of view of the user, but are not pinpointed to physical features. This is a rather important difference, since it marks the shift from a cooperative see-through mode, that characterizes proper augmented reality, to a competitive overlay, where the user attention is actually contended between real objects and displayed data. To this end, the user focus must continuously shift from one context to the other, possibly leading to both reduced productivity and usage strain. With this paper we are addressing exactly this issue. Specifically, we are assessing the role of different properties of the overlay, including the level of occlusion, the depth of the data layer, the position of the view frustum and the impact of stereo vision. Such study has been implemented by mean of a real-world evaluation which has been performed using a general purpose see-through device in a practical application scenario.

References

[1]

B. Bell, S. Feiner, and T. Höllerer. View management for virtual and augmented reality. In 14th Annual ACM Symposium on User Interface Software and Technology, UIST '01, pages 101--110, New York, NY, USA, 2001. ACM.

Digital Library

[2]

J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, and M. Ivkovic. Augmented reality technologies, systems and applications. Multimedia Tools and Applications, 51(1):341--377, 2011.

Digital Library

[3]

S. Debernardis, M. Fiorentino, M. Gattullo, G. Monno, and A. E. Uva. Text readability in head-worn displays: Color and style optimization in video versus optical see-through devices. Visualization and Computer Graphics, 20(1):125--139, 2014.

Digital Library

[4]

S. R. Ellis and U. J. Bucher. Distance perception of stereoscopically presented virtual objects optically superimposed on physical objects by a head-mounted see-through display. In Human Factors and Ergonomics Society, volume 2, pages 1300--1304, 1994. cited By 8.

[5]

Y. Genc, M. Tuceryan, and N. Navab. Practical solutions for calibration of optical see-through devices. In 1st International Symposium on Mixed and Augmented Reality, ISMAR '02, pages 169--, Washington, DC, USA, 2002. IEEE Computer Society.

Digital Library

[6]

M. Gervautz and D. Schmalstieg. Anywhere interfaces using handheld augmented reality. Computer, 45(7):26--31, 2012.

Digital Library

[7]

D. A. Guttentag. Virtual reality: Applications and implications for tourism. Tourism Management, 31(5):637--651, 2010.

[8]

M. Halsey. What's new for end users? In Windows 10 Primer, pages 49--62. Springer, 2015.

[9]

B. L. Harrison, H. Ishii, K. J. Vicente, and W. A. S. Buxton. Transparent layered user interfaces: An evaluation of a display design to enhance focused and divided attention. In SIGCHI Conference on Human Factors in Computing Systems, CHI '95, pages 317--324, New York, NY, USA, 1995. ACM Press/Addison-Wesley Publishing Co.

Digital Library

[10]

O. Hilliges, D. Kim, S. Izadi, M. Weiss, and A. Wilson. Holodesk: direct 3d interactions with a situated see-through display. In SIGCHI Conference on Human Factors in Computing Systems, pages 2421--2430. ACM, 2012.

Digital Library

[11]

F. Kellner, B. Bolte, G. Bruder, U. Rautenberg, F. Steinicke, M. Lappe, and R. Koch. Geometric calibration of head-mounted displays and its effects on distance estimation. Visualization and Computer Graphics, 18(4):589--596, 2012.

Digital Library

[12]

S.-H. Kim, L. J. Prinzel, D. B. Kaber, A. L. Alexander, E. M. Stelzer, K. Kaufmann, and T. Veil. Multidimensional measure of display clutter and pilot performance for advanced head-up display. Aviation, space, and environmental medicine, 82(11):1013--1022, 2011.

[13]

K. Kiyokawa, Y. Kurata, and H. Ohno. An optical see-through display for mutual occlusion with a real-time stereovision system. Computers & Graphics, pages 765--779, 2001.

[14]

F. L. Kooi and A. Toet. Visual comfort of binocular and 3D displays. Displays, 25(2--3):99--108, 2004.

[15]

C. D. Kounavis, A. E. Kasimati, E. D. Zamani, and G. Giaglis. Enhancing the tourism experience through mobile augmented reality: Challenges and prospects. International Journal of Engineering Business Management, 4(10):1--6, 2012.

[16]

M. Kytö, A. Mäkinen, T. Tossavainen, and P. Oittinen. Stereoscopic depth perception in video see-through augmented reality within action space. Journal of Electronic Imaging, 23(1):011006, 2014.

[17]

S. Liu, D. Cheng, and H. Hua. An optical see-through head mounted display with addressable focal planes. In ISMAR 2008, pages 33--42, Sept 2008.

Digital Library

[18]

A. Lucero, K. Lyons, A. Vetek, T. Järvenpää, S. White, and M. Salmimaa. Exploring the interaction design space for interactive glasses. In CHI'13 Extended Abstracts on Human Factors in Computing Systems, pages 1341--1346. ACM, 2013.

Digital Library

[19]

V. Mazza, M. Turatto, and C. Umiltà. Foreground-background segmentation and attention: A change blindness study. Psychological Research, 69(3):201--210, 2005.

[20]

A. Nee, S. Ong, G. Chryssolouris, and D. Mourtzis. Augmented reality applications in design and manufacturing. CIRP Annals-Manufacturing Technology, 61(2):657--679, 2012.

[21]

S. D. Peterson, M. Axholt, and S. R. Ellis. Objective and subjective assessment of stereoscopically separated labels in augmented reality. Computers & Graphics, 33(1):23--33, 2009.

Digital Library

[22]

V. T. Phan and S. Y. Choo. Interior design in augmented reality environment. International Journal of Computer Applications, 5(5), 2010.

[23]

R. Radkowski and C. Stritzke. Interactive hand gesture-based assembly for augmented reality applications. In ACHI 2012, The Fifth International Conference on Advances in Computer-Human Interactions, pages 303--308, 2012.

[24]

E. Redondo, I. Navarro, A. Sánchez Riera, and D. Fonseca. Augmented reality on architectural and building engineering learning processes. two study cases. UbiCC Journal, pages 1269--1279, 2012.

[25]

J. P. Rolland and H. Fuchs. Optical versus video see-through head-mounted displays in medical visualization. Presence: Teleoper. Virtual Environ., 9(3):287--309, June 2000.

Digital Library

[26]

J. P. Rolland, R. L. Holloway, and H. Fuchs. Comparison of optical and video see-through, head-mounted displays. In Proc. SPIE, volume 2351, pages 293--307, 1995.

[27]

S. Smith and S.-H. Fu. The relationships between automobile head-up display presentation images and drivers' Kansei. Displays, 32(2):58--68, 2011.

[28]

T. Starner. Project glass: An extension of the self. Pervasive Computing, IEEE, 12(2):14--16, 2013.

Digital Library

[29]

L. B. Stelmach and W. J. Tam. Stereoscopic image coding: Effect of disparate image-quality in left- and right-eye views. Signal Processing: Image Communication, 14(1--2):111--117, 1998.

[30]

C. Sulisz and P. Seeling. An off-the-shelf wearable hud system for support in indoor environments. In 11th International Conference on Mobile and Ubiquitous Multimedia, page 60. ACM, 2012.

Digital Library

[31]

B. L. William Wong, R. Joyekurun, H. Mansour, P. Amaldi, A. Nees, and R. Villanueva. Depth, layering and transparency: Developing design techniques. In 17th Australia Conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future, OZCHI '05, pages 1--10, Narrabundah, Australia, Australia, 2005. Computer-Human Interaction Special Interest Group (CHISIG) of Australia.

Digital Library

Cited By

Woodward JSmith JWang ICuenca SRuiz J(2023)Designing Critical and Secondary Information in Augmented Reality Headsets for Situational AwarenessJournal of Engineering Research and Sciences10.55708/js02030012:3(1-15)Online publication date: Mar-2023
https://doi.org/10.55708/js0203001
Woodward JRuiz J(2023)Designing Textual Information in AR Headsets to Aid in Adults’ and Children's Task PerformanceProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3589373(27-39)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3589373
Woodward JRuiz J(2023)Analytic Review of Using Augmented Reality for Situational AwarenessIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314158529:4(2166-2183)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3141585
Show More Cited By

Index Terms

On the Interplay between Data Overlay and Real-World Context using See-through Displays
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design

Recommendations

Colorimetric and Photometric Compensation for Optical See-Through Displays
UAHCI '09: Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments

Optical see-through displays are an established technology within augmented reality. Wearing such a display the users eyes automatically adapt to the luminance of the real world environment, while the virtual part is displayed using a steadybrightness. ...
Eye-Perspective View Management for Optical See-Through Head-Mounted Displays
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Optical see-through (OST) head-mounted displays (HMDs) enable users to experience Augmented Reality (AR) support in the form of helpful real-world annotations. Unfortunately, the blend of the environment with virtual augmentations due to semitransparent ...
Real-Time Composition of Stereo Images for Video See-Through Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

This paper describes a method of stereo image composition for video see-through augmented reality. In order to implement an augmented reality system, we must acquire the position and orientation of the user's viewpoint to display the composed image ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CHItaly '15: Proceedings of the 11th Biannual Conference of the Italian SIGCHI Chapter

September 2015

195 pages

ISBN:9781450336840

DOI:10.1145/2808435

General Chairs:
Paolo Bottoni,
Tiziana Catarci,
Program Chairs:
Maria De Marsico,
Daniela Fogli

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Sapienza: Sapienza University of Rome

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHItaly 2015

CHItaly 2015: 11th biannual Conference of the Italian SIGCHI Chapter

September 28 - 30, 2015

Rome, Italy

Acceptance Rates

CHItaly '15 Paper Acceptance Rate 31 of 59 submissions, 53%;

Overall Acceptance Rate 109 of 242 submissions, 45%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
204
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Woodward JSmith JWang ICuenca SRuiz J(2023)Designing Critical and Secondary Information in Augmented Reality Headsets for Situational AwarenessJournal of Engineering Research and Sciences10.55708/js02030012:3(1-15)Online publication date: Mar-2023
https://doi.org/10.55708/js0203001
Woodward JRuiz J(2023)Designing Textual Information in AR Headsets to Aid in Adults’ and Children's Task PerformanceProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3589373(27-39)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3589373
Woodward JRuiz J(2023)Analytic Review of Using Augmented Reality for Situational AwarenessIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314158529:4(2166-2183)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3141585
Baudin CMaillard L(2021)The bodily challenges of augmented vision applied to firefighting activityLes enjeux corporels d’une vision augmentée appliquée à l’activité des sapeurs‑pompiersActivites10.4000/activites.5931Online publication date: 15-Apr-2021
https://doi.org/10.4000/activites.5931
Baudin CMaillard L(2021)Les enjeux corporels d’une vision augmentée appliquée à l’activité des sapeurs‑pompiersThe bodily challenges of augmented vision applied to firefighting activityActivites10.4000/activites.5869Online publication date: 15-Apr-2021
https://doi.org/10.4000/activites.5869
Satkowski MDachselt RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Investigating the Impact of Real-World Environments on the Perception of 2D Visualizations in Augmented RealityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445330(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445330
Shin KKim HLee JJo D(2020)Exploring the Effects of Scale and Color Differences on Users’ Perception for Everyday Mixed Reality (MR) Experience: Toward Comparative Analysis Using MR DevicesElectronics10.3390/electronics91016239:10(1623)Online publication date: 2-Oct-2020
https://doi.org/10.3390/electronics9101623
Woodward JSmith JWang ICuenca SRuiz J(2020)Examining the Presentation of Information in Augmented Reality Headsets for Situational AwarenessProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399846(1-5)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3399715.3399846
Dima EBrunnström KSjöström MAndersson MEdlund JJohanson MQureshi T(2020)Joint effects of depth-aiding augmentations and viewing positions on the quality of experience in augmented telepresenceQuality and User Experience10.1007/s41233-020-0031-75:1Online publication date: 10-Feb-2020
https://doi.org/10.1007/s41233-020-0031-7
Baumeister JSsin SElSayed NDorrian JWebb DWalsh JSimon TIrlitti ASmith RKohler MThomas B(2017)Cognitive Cost of Using Augmented Reality DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.273509823:11(2378-2388)Online publication date: 28-Sep-2017
https://dl.acm.org/doi/10.1109/TVCG.2017.2735098

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents