research-article

Visualization of off-surface 3D viewpoint locations in spatial augmented reality

Authors:

Bruce ThomasAuthors Info & Claims

SUI '13: Proceedings of the 1st symposium on Spatial user interaction

Pages 1 - 8

https://doi.org/10.1145/2491367.2491378

Published: 20 July 2013 Publication History

Abstract

Spatial Augmented Reality (SAR) systems can be used to convey guidance in a physical task from a remote expert. Sometimes that remote expert is provided with a single camera view of the workspace but, if they are given a live captured 3D model and can freely control their point of view, the local worker needs to know what the remote expert can see. We present three new SAR techniques, Composite Wedge, Vector Boxes, and Eyelight, for visualizing off-surface 3D viewpoints and supporting the required workspace awareness. Our study showed that the Composite Wedge cue was best for providing location awareness, and the Eyelight cue was best for providing visibility map awareness.

Supplementary Material

JPG File (sui0129-file3.jpg)

Download
6.70 KB

suppl.mov (sui0129-file3.m4v)

Supplemental video

Download
29.54 MB

References

[1]

Adcock, M. and Gunn, C. 2010. Annotating with "sticky" light for remote guidance. ACM SIGGRAPH ASIA 2010 Posters (Seoul, South Korea, 2010).

Digital Library

[2]

Clark, H.H. and Brennan, S.E. 1991. Grounding in communication. Perspectives on socially shared cognition. American Psychological Association.

[3]

Dourish, P. and Bellotti, V. 1992. Awareness and coordination in shared workspaces. Proceedings of the 1992 ACM conference on Computer-supported cooperative work - CSCW '92 (Toronto, Canada, Dec. 1992), 107--114.

Digital Library

[4]

Fussell, S., Setlock, L., Yang, J., Ou, J., Mauer, E. and Kramer, A. 2004. Gestures Over Video Streams to Support Remote Collaboration on Physical Tasks. Human-Computer Interaction. 19, 3 (Sep. 2004), 273--309.

Digital Library

[5]

Genest, A. and Gutwin, C. 2012. Evaluating the effectiveness of height visualizations for improving gestural communication at distributed tabletops. Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW '12 (Seattle, USA, Feb. 2012), 519.

Digital Library

[6]

Gustafson, S., Baudisch, P., Gutwin, C. and Irani, P. 2008. Wedge: clutter-free visualization of off-screen locations. Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08 (Florence, Italy, Apr. 2008).

Digital Library

[7]

Gutwin, C., Greenberg, S. and Roseman, M. 1996. Workspace Awareness in Real-Time Distributed Groupware: Framework, Widgets, and Evaluation. (Jan. 1996), 281--298.

Digital Library

[8]

Hilliges, O., Kim, D., Izadi, S., Weiss, M. and Wilson, A. 2012. HoloDesk: Direct 3D Interactions with a Situated See-Through Display. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12 (Austin, USA, May. 2012), 2421.

Digital Library

[9]

Hindmarsh, J., Fraser, M., Heath, C., Benford, S. and Greenhalgh, C. 1998. Fragmented interaction: establishing mutual orientation in virtual environments. Proceedings of the 1998 ACM conference on Computer supported cooperative work - CSCW '98 (Seattle, USA, Nov. 1998), 217--226.

Digital Library

[10]

Hutchins, M., Adcock, M., Stevenson, D., Gunn, C. and Krumpholz, A. 2005. The Design of Perceptual Representations for Practical Networked Multimodal Virtual Training Environments. Proc. HCI International 2005: 11th International Conference on Human-Computer Interaction (2005).

[11]

Iyoda, T., Abe, T., Tokai, K., Sakamoto, S., Shingu, J., Onuki, H., Shi, M., Uchihashi, S., Satoh, S., Nack, F. and Etoh, M. 2008. LightCollabo: Distant Collaboration Support System for Manufacturers. Advances in Multimedia Modeling (Berlin, Heidelberg, 2008), 369--379.

Digital Library

[12]

Kainz, B., Schmalstieg, D., Hauswiesner, S., Reitmayr, G., Steinberger, M., Grasset, R., Gruber, L., Veas, E., Kalkofen, D. and Seichter, H. 2012. OmniKinect: real-time dense volumetric data acquisition and applications. Proceedings of the 18th ACM symposium on Virtual reality software and technology - VRST '12 (Toronto, Canada, Dec. 2012), 25.

Digital Library

[13]

Kirk, D. and Stanton Fraser, D. 2006. Comparing remote gesture technologies for supporting collaborative physical tasks. Proceedings of the SIGCHI conference on Human Factors in computing systems - CHI '06. (2006), 1191.

Digital Library

[14]

Kirk, D.S. 2006. Turn It This Way!: Remote Gesturing in VideoMediated Communication David Stanley Kirk, BSc ( Hons ), MSc Thesis submitted to the University of Nottingham for the degree of Doctor of Philosophy. University of Nottingham.

[15]

Robinson, P. and Tuddenham, P. 2007. Distributed Tabletops: Supporting Remote and Mixed-Presence Tabletop Collaboration. Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07) (Oct. 2007), 19--26.

[16]

Rosenthal, S., Kane, S.K., Wobbrock, J.O. and Avrahami, D. 2010. Augmenting on-screen instructions with micro-projected guides: When it Works, and When it Fails. Proceedings of the 12th ACM international conference on Ubiquitous computing Ubicomp '10 (Copenhagen, Denmark, Sep. 2010), 203.

Digital Library

[17]

Sodhi, R., Benko, H. and Wilson, A. 2012. LightGuide: projected visualizations for hand movement guidance. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12 (Austin, USA, May. 2012), 179.

Digital Library

[18]

Stevenson, D., Li, J., Smith, J. and Hutchins, M. 2008. A collaborative guidance case study. AUIC '08 (2008).

Digital Library

[19]

Sugano, N., Kato, H. and Tachibana, K. 2003. The effects of shadow representation of virtual objects in augmented reality. The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings. (2003), 76--83.

Digital Library

[20]

Söderholm, H.M., Sonnenwald, D.H., Cairns, B., Manning, J.E., Welch, G.F. and Fuchs, H. 2007. The potential impact of 3d telepresence technology on task performance in emergency trauma care. Proceedings of the 2007 international ACM conference on Conference on supporting group work - GROUP '07 (Sanibel Island, USA, Nov. 2007), 79.

Digital Library

[21]

TSIMERIS, J.A. 2010. Visual Cues for the Instructed Arrangement of Physical Objects Using Spatial Augmented Reality ( SAR ). University of South Australia.

[22]

Tang, A., Neustaedter, C. and Greenberg, S. 2006. VideoArms: Embodiments for Mixed Presence Groupware. The 20th BCS HCI Group Conference (London, 2006).

[23]

Tang, J.C. and Minneman, S. 1991. VideoWhiteboard: Video Shadows to Support Remote Collaboration. Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 (New Orleans, USA, Mar. 1991), 315--322.

Digital Library

[24]

Tecchia, F., Alem, L. and Huang, W. 2012. 3D helping hands: a gesture based MR system for remote collaboration. Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry VRCAI '12 (Singapore, Dec. 2012), 323.

Digital Library

[25]

Tsai, R.Y. and Lenz, R.K. 1989. A new technique for fully autonomous and efficient 3D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation. 5, 3 (Jun. 1989), 345--358.

[26]

Underkoffler, J. and Ishii, H. 1999. Urp: a luminous-tangible workbench for urban planning and design. Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 (Pittsburgh, USA, May. 1999), 386--393.

Digital Library

[27]

Wilson, A.D. and Benko, H. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. Proceedings of the 23nd annual ACM symposium on User interface software and technology - UIST '10 (New York, New York, USA, Oct. 2010), 273.

Digital Library

[28]

Zhou, J., Lee, I., Thomas, B., Menassa, R., Farrant, A. and Sansome, A. 2011. Applying spatial augmented reality to facilitate in-situ support for automotive spot welding inspection. Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry - VRCAI '11 (Hong Kong, Dec. 2011), 195.

Digital Library

Cited By

Suwadi NLam MAbd Majid N(2024)Evaluation on Different Object Selection Visual Feedback in Collaborative Augmented RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2389727(1-17)Online publication date: 15-Aug-2024
https://doi.org/10.1080/10447318.2024.2389727
Li YLuo GXu YHe YZhang FZhang S(2024)AdaPIP: Adaptive picture-in-picture guidance for 360° film watchingComputational Visual Media10.1007/s41095-023-0347-310:3(487-503)Online publication date: 2-May-2024
https://doi.org/10.1007/s41095-023-0347-3
González-Barbosa JFeregrino-Alegria MBárcenas-Reyes IHurtado-Ramos JOrnelas-Rodríguez F(2024)Projector-Camera Calibration Method Based on Pattern Geometric ConstraintsTrends and Challenges in Multidisciplinary Research for Global Sustainable Development10.1007/978-3-031-57620-1_3(28-40)Online publication date: 30-Apr-2024
https://doi.org/10.1007/978-3-031-57620-1_3
Show More Cited By

Index Terms

Visualization of off-surface 3D viewpoint locations in spatial augmented reality
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Virtual Replicas for Remote Assistance in Virtual and Augmented Reality
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

In many complex tasks, a remote subject-matter expert may need to assist a local user to guide actions on objects in the local user's environment. However, effective spatial referencing and action demonstration in a remote physical environment can be ...
reFrame: An Alternate Paradigm for Augmented Reality
SIGGRAPH '20: ACM SIGGRAPH 2020 Posters

“reFrame” is an optically see-through Augmented Reality (AR) platform capable of displaying parallax-free images superimposed over physical objects and the scenery behind it. It uses head-tracking technology and off-axis perspective projection to ...
Spatial augmented reality for physical drawing
UIST Adjunct Proceedings '12: Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology

Spatial augmented reality (SAR) makes possible the projection of virtual environments into the real world. In this demo, we propose to demonstrate our SAR tools dedicated to the creation of physical drawings. From the most simple tools: the projection ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '13: Proceedings of the 1st symposium on Spatial user interaction

July 2013

108 pages

ISBN:9781450321419

DOI:10.1145/2491367

General Chair:
Evan Suma
USC Institute for Creative Technologies USA
,
Program Chairs:
Wolfgang Stuerzlinger
York University, Canada
,
Frank Steinicke
University of Würzburg, Germany

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SUI '13

Sponsor:

SUI '13: Symposium on Spatial User Interaction

July 20 - 21, 2013

California, Los Angeles, USA

Acceptance Rates

SUI '13 Paper Acceptance Rate 12 of 31 submissions, 39%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
593
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Suwadi NLam MAbd Majid N(2024)Evaluation on Different Object Selection Visual Feedback in Collaborative Augmented RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2389727(1-17)Online publication date: 15-Aug-2024
https://doi.org/10.1080/10447318.2024.2389727
Li YLuo GXu YHe YZhang FZhang S(2024)AdaPIP: Adaptive picture-in-picture guidance for 360° film watchingComputational Visual Media10.1007/s41095-023-0347-310:3(487-503)Online publication date: 2-May-2024
https://doi.org/10.1007/s41095-023-0347-3
González-Barbosa JFeregrino-Alegria MBárcenas-Reyes IHurtado-Ramos JOrnelas-Rodríguez F(2024)Projector-Camera Calibration Method Based on Pattern Geometric ConstraintsTrends and Challenges in Multidisciplinary Research for Global Sustainable Development10.1007/978-3-031-57620-1_3(28-40)Online publication date: 30-Apr-2024
https://doi.org/10.1007/978-3-031-57620-1_3
Irlitti ALatifoglu MZhou QReinoso MHoang TVelloso EVetere F(2023)Volumetric Mixed Reality Telepresence for Real-time Cross Modality CollaborationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581277(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581277
Letter MGeorge CWolf K(2023)A Survey of Computer-Supported Remote Collaboration on Physical ObjectsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42286-7_19(346-368)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42286-7_19
Syed TSiddiqui MAbdullah HJan SNamoun AAlzahrani ANadeem AAlkhodre A(2022)In-Depth Review of Augmented Reality: Tracking Technologies, Development Tools, AR Displays, Collaborative AR, and Security ConcernsSensors10.3390/s2301014623:1(146)Online publication date: 23-Dec-2022
https://doi.org/10.3390/s23010146
Sereno MBesançon LIsenberg T(2022)Point specification in collaborative visualization for 3D scalar fields using augmented realityVirtual Reality10.1007/s10055-021-00614-226:4(1317-1334)Online publication date: 18-Feb-2022
https://doi.org/10.1007/s10055-021-00614-2
Sasikumar PChittajallu SRaj NBai HBillinghurst M(2021)Spatial Perception Enhancement in Assembly Training Using Augmented Volumetric PlaybackFrontiers in Virtual Reality10.3389/frvir.2021.6985232Online publication date: 16-Aug-2021
https://doi.org/10.3389/frvir.2021.698523
Walsh JThomas B(2020)Aligning Realities: Correlating Content between Projected and Head Worn DisplaysMultimodal Technologies and Interaction10.3390/mti40300674:3(67)Online publication date: 16-Sep-2020
https://doi.org/10.3390/mti4030067
Sereno MWang XBesancon LMcguffin MIsenberg T(2020)Collaborative Work in Augmented Reality: A SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.3032761(1-1)Online publication date: 2020
https://doi.org/10.1109/TVCG.2020.3032761
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten