short-paper

3D Tabletop AR: A Comparison of Mid-Air, Touch and Touch+Mid-Air Interaction

Authors:

Carole Plasson,

Dominique Cunin,

Yann Laurillau,

Laurence NigayAuthors Info & Claims

AVI '20: Proceedings of the 2020 International Conference on Advanced Visual Interfaces

Article No.: 40, Pages 1 - 5

https://doi.org/10.1145/3399715.3399836

Published: 02 October 2020 Publication History

Abstract

This paper contributes a first comparative study of three techniques for selecting 3D objects anchored to the table in tabletop Augmented Reality (AR). The impetus for this study is that touch interaction makes more sense when the targeted objects are anchored to the table. We experimentally compare touch and a mixed (touch+mid-air) techniques with the common direct mid-air technique. The touch and mixed techniques involve a decomposition of the 3D task into a 2D task by touch on the table followed by a 1D task by touch or mid-air interaction. Results show that: (1) The touch and mixed techniques present completion times similar to the mid-air technique and are more accurate than the mid-air technique; (2) The mixed technique defines a good compromise between accuracy of touch interaction and speed of mid-air interaction.

References

[1]

H. Benko and S. Feiner. 2007. Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection. In 2007 IEEE Symposium on 3D User Interfaces. https://doi.org/10.1109/3DUI.2007.340778

[2]

H. Benko, E. W. Ishak, and S. Feiner. 2005. Cross-dimensional gestural interaction techniques for hybrid immersive environments. In IEEE Proceedings. VR 2005. Virtual Reality, 2005. 209--216. https://doi.org/10.1109/VR.2005.1492776

[3]

Nicolas J. Dedual, Ohan Oda, and Steven K. Feiner. 2011. Creating Hybrid User Interfaces with a 2D Multi-touch Tabletop and a 3D See-through Head-worn Display. In Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR '11). IEEE Computer Society, Washington, DC, USA, 231--232. https://doi.org/10.1109/ISMAR.2011.6092391

Digital Library

[4]

Martin Hachet, Benoit Bossavit, Aurélie Cohé, and Jean-Baptiste de la Rivière. 2011. Toucheo: Multitouch and Stereo Combined in a Seamless Workspace. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). ACM, New York, NY, USA, 587--592. https://doi.org/10.1145/2047196.2047273

Digital Library

[5]

Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage publications Sage CA: Los Angeles, CA, 904--908.

[6]

Ernst Kruijff, J. Edward Swan, and Steven K. Feiner. 2010. Perceptual issues in augmented reality revisited. 2010 IEEE International Symposium on Mixed and Augmented Reality (2010), 3--12.

[7]

A. Martinet, G. Casiez, and L. Grisoni. 2010. The design and evaluation of 3D positioning techniques for multi-touch displays. In 2010 IEEE Symposium on 3D User Interfaces (3DUI). 115--118. https://doi.org/10.1109/3DUI.2010.5444709

Digital Library

[8]

Sven Mayer, Valentin Schwind, Robin Schweigert, and Niels Henze. 2018. The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI '18). ACM, New York, NY, USA, Article 653, 13 pages. https://doi.org/10.1145/3173574.3174227

Digital Library

[9]

Daniel Mendes, Fernando Fonseca, Bruno Araujo, Alfredo Ferreira, and Joaquim Jorge. 2014. Mid-Air Interactions Above Stereoscopic Interactive Tables. IEEE Symposium on 3D User Interfaces 2014, 3DUI 2014 - Proceedings. https://doi.org/10.1109/3DUI.2014.6798833

[10]

Microsoft. 2017. Microsoft HoloLens. https://www.microsoft.com/en-us/hololens

[11]

Choon Hong Peck. 2001. Useful Parameters for the Design of Laser Pointer Interaction Techniques. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (Seattle, Washington) (CHI EA '01). Association for Computing Machinery, New York, NY, USA, 461--462. https://doi.org/10.1145/634067.634333

Digital Library

[12]

Carole Plasson, Dominique Cunin, Yann Laurillau, and Laurence Nigay. 2019. Tabletop AR with HMD and Tablet: A Comparative Study for 3D Selection. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS '19). Association for Computing Machinery, New York, NY, USA, 409--414. https://doi.org/10.1145/3343055.3360760

Digital Library

[13]

Patrick Reipschläger and Raimund Dachselt. 2019. DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (Daejeon, Republic of Korea) (ISS '19). Association for Computing Machinery, New York, NY, USA, 29--41. https://doi.org/10.1145/3343055.3359718

Digital Library

[14]

Rebekka S. Renner, Boris M. Velichkovsky, and Jens R. Helmert. 2013. The Perception of Egocentric Distances in Virtual Environments - A Review. ACM Comput. Surv. 46, 2, Article 23 (Dec. 2013), 40 pages. https://doi.org/10.1145/2543581.2543590

Digital Library

[15]

Sven Strothoff, Dimitar Valkov, and Klaus Hinrichs. 2011. Triangle Cursor: Interactions with Objects Above the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS '11). ACM, New York, NY, USA, 111--119. https://doi.org/10.1145/2076354.2076377

Digital Library

[16]

M. Veit, A. Capobianco, and D. Bechmann. 2011. An experimental analysis of the impact of Touch Screen Interaction techniques for 3-D positioning tasks. In 2011 IEEE Virtual Reality Conference. 75--82. https://doi.org/10.1109/VR.2011.5759440

Digital Library

[17]

Peter Willemsen, Amy A. Gooch, William B. Thompson, and Sarah H. Creem-Regehr. 2008. Effects of Stereo Viewing Conditions on Distance Perception in Virtual Environments. Presence: Teleoper. Virtual Environ. 17, 1 (Feb. 2008), 91--101. https://doi.org/10.1162/pres.17.1.91

Digital Library

[18]

Andrew Wilson and Steven Shafer. 2003. XWand: UI for Intelligent Spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI '03). Association for Computing Machinery, New York, NY, USA, 545--552. https://doi.org/10.1145/642611.642706

Digital Library

[19]

Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI '11). ACM, New York, NY, USA, 143--146. https://doi.org/10.1145/1978942.1978963

Digital Library

[20]

R. Xiao, J. Schwarz, N. Throm, A. D. Wilson, and H. Benko. 2018. MRTouch: Adding Touch Input to Head-Mounted Mixed Reality. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1653--1660. https://doi.org/10.1109/TVCG.2018.2794222

Digital Library

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Yu LFeng HAlghofaili RByun BO’Neal TRampalli SChung YGenaro Motti VYu L(2024)HoloAAC: A Mixed Reality AAC Application for People with Expressive Language DifficultiesVirtual, Augmented and Mixed Reality10.1007/978-3-031-61047-9_20(304-324)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61047-9_20
Coutaz J(2024)At the Confluence of Software Engineeringand Human-Computer Interaction:A Personal AccountThe French School of Programming10.1007/978-3-031-34518-0_5(89-122)Online publication date: 30-Apr-2024
https://doi.org/10.1007/978-3-031-34518-0_5
Show More Cited By

Index Terms

3D Tabletop AR: A Comparison of Mid-Air, Touch and Touch+Mid-Air Interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Tabletop AR with HMD and Tablet: A Comparative Study for 3D Selection
ISS '19: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces

We experimentally compare the performance and usability of tablet-based and see-through head-mounted display (HMD)-based interaction techniques for selecting 3D virtual objects projected on a table. This study is a first step toward a better ...
Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

In this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

The proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '20: Proceedings of the 2020 International Conference on Advanced Visual Interfaces

September 2020

613 pages

ISBN:9781450375351

DOI:10.1145/3399715

Copyright © 2020 ACM.

© 2020 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

AVI '20

AVI '20: International Conference on Advanced Visual Interfaces

September 28 - October 2, 2020

Salerno, Italy

Acceptance Rates

AVI '20 Paper Acceptance Rate 36 of 123 submissions, 29%;

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
282
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)4

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bashar MBatmaz A(2024)Virtual Task Environments Factors Explored in 3D Selection StudiesProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670983(1-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670983
Yu LFeng HAlghofaili RByun BO’Neal TRampalli SChung YGenaro Motti VYu L(2024)HoloAAC: A Mixed Reality AAC Application for People with Expressive Language DifficultiesVirtual, Augmented and Mixed Reality10.1007/978-3-031-61047-9_20(304-324)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61047-9_20
Coutaz J(2024)At the Confluence of Software Engineeringand Human-Computer Interaction:A Personal AccountThe French School of Programming10.1007/978-3-031-34518-0_5(89-122)Online publication date: 30-Apr-2024
https://doi.org/10.1007/978-3-031-34518-0_5
Hafner LWutz FPöhn DHommel W(2023)TASEP: A Collaborative Social Engineering Tabletop Role-Playing Game to Prevent Successful Social Engineering AttacksProceedings of the 18th International Conference on Availability, Reliability and Security10.1145/3600160.3605005(1-10)Online publication date: 29-Aug-2023
https://dl.acm.org/doi/10.1145/3600160.3605005
Spittle BFrutos-Pascual MCreed CWilliams I(2023)A Review of Interaction Techniques for Immersive EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317480529:9(3900-3921)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3174805
Plasson CBlanch RNigay L(2022)Selection Techniques for 3D Extended Desktop Workstation with AR HMD2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00062(460-469)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00062
Plasson CCunin DLaurillau YNigay L(2021)A Lens-Based Extension of Raycasting for Accurate Selection in Dense 3D EnvironmentsHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85610-6_28(501-524)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-85610-6_28

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents