research-article

Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces

Authors:

Juan David Hincapié-Ramos,

Pourang IraniAuthors Info & Claims

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

Pages 99 - 102

https://doi.org/10.1145/2983310.2985757

Published: 15 October 2016 Publication History

Abstract

Current wearable interfaces are designed to support short-duration tasks known as micro-interactions. To support productive interfaces for everyday analytic tasks, designers can leverage natural input methods such as direct manipulation and pointing. Such natural methods are now available in virtual, mobile environments thanks to miniature depth cameras mounted on head-worn displays (HWDs). However, these techniques have drawbacks, such as fatigue and limited precision. To overcome these limitations, we explore combined input: hand tracking data from a head-mounted depth camera, and input from a small ring device. We demonstrate how a variety of input techniques can be implemented using this novel combination of devices. We harness these techniques for use with Spatial Analytic Interfaces: multi-application, spatial UIs for in-situ, analytic taskwork on wearable devices. This research demonstrates how combined input from multiple wearable devices holds promise for supporting high-precision, low-fatigue interaction techniques, to support Spatial Analytic Interfaces on HWDs.

Supplementary Material

suppl.mov (suifp0163-file3.mp4)

Supplemental video

Download
70.64 MB

MP4 File (p99-ens.mp4)

Download
176.36 MB

References

[1]

Bowman, D.A. and Hodges, L.F. 1997. An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. Proc. I3D '97, 35-ff.

Digital Library

[2]

Bowman, D.A., McMahan, R.P. and Ragan, E.D. 2012. Questioning naturalism in 3D user interfaces. Commun. ACM. 55, 9 (Sep. 2012), 78--88.

Digital Library

[3]

Chan, L., Liang, R.-H., Tsai, M.-C., Cheng, K.-Y., Su, C.-H., Chen, M.Y., Cheng, W.-H. and Chen, B.-Y. 2013. FingerPad: private and subtle interaction using fingertips. Proc. UIST '13, 255--260.

Digital Library

[4]

Ens, B. and Irani, P. 2016. Spatial Analytic Interfaces: Spatial user interfaces for in-situ visual analytics. IEEE Computer Graphics and Applications, PP, 99 (Mar. 2016), 1--1.

[5]

Ens, B.M., Finnegan, R. and Irani, P.P. 2014. The Personal Cockpit: A spatial interface for effective task switching on head-worn displays. Proc. CHI '14, 3171--3180.

Digital Library

[6]

Forlines, C., Vogel, D. and Balakrishnan, R. 2006. HybridPointing: fluid switching between absolute and relative pointing with a direct input device. Proc. UIST '06, 211--220.

Digital Library

[7]

Ha, T., Feiner, S. and Woo, W. 2014. WeARHand: Headworn, RGB-D camera-based, bare-hand user interface with visually enhanced depth perception. Proc. ISMAR '14, 219--228.

[8]

Hincapié-Ramos, J.D., Guo, X., Moghadasian, P. and Irani, P. 2014. Consumed Endurance: A metric to quantify arm fatigue of mid-air interactions. Proc. CHI '14, 1063--1072.

Digital Library

[9]

Kienzle, W. and Hinckley, K. 2014. LightRing: alwaysavailable 2D input on any surface. Proc. UIST '14, 157--160.

Digital Library

[10]

Lee, M., Billinghurst, M., Baek, W., Green, R. and Woo, W. 2013. A usability study of multimodal input in an augmented reality environment. Virtual Reality. 17, 4 (Nov. 2013), 293--305.

Digital Library

[11]

McCallum, D.C. and Irani, P. 2009. ARC-Pad: Absolute+relative cursor positioning for large displays with a mobile touchscreen. Proc. UIST '09, 153--156.

Digital Library

[12]

Mine, M.R. 1995. Virtual Environment Interaction Techniques. UNC Chapel Hill computer science technical report TR95-018 (1995), 507248-2.

Digital Library

[13]

Nancel, M., Chapuis, O., Pietriga, E., Yang, X.-D., Irani, P.P. and Beaudouin-Lafon, M. 2013. High-precision pointing on large wall displays using small handheld devices. Proc. CHI '13, 831--840.

Digital Library

[14]

Ogata, M., Sugiura, Y., Osawa, H. and Imai, M. 2012. iRing: intelligent ring using infrared reflection. Proc. UIST '12, 131--136.

Digital Library

[15]

Piumsomboon, T., Altimira, D., Kim, H., Clark, A., Lee, G. and Billinghurst, M. 2014. Grasp-Shell vs gesture-speech: A comparison of direct and indirect natural interaction techniques in augmented reality. Proc. ISMAR '14, 73--82.

[16]

Poupyrev, I., Billinghurst, M., Weghorst, S. and Ichikawa, T. 1996. The Go-go interaction technique: Non-linear mapping for direct manipulation in VR. Proc. UIST '96, 79--80.

Digital Library

[17]

Szalavári, Z. and Gervautz, M. 1997. The Personal Interaction Panel -- A two-handed interface for augmented reality. Computer Graphics Forum. 16, 3 (Sep. 1997), C335--C346.

[18]

Vanacken, L., Grossman, T. and Coninx, K. 2009. Multimodal selection techniques for dense and occluded 3D virtual environments. International Journal of HumanComputer Studies. 67, 3 (Mar. 2009), 237--255.

Digital Library

[19]

Vernier, F. and Nigay, L. 2000. A framework for the combination and characterization of output modalities. International Workshop on Design, Specification, and Verification of Interactive Systems (2000), 35--50.

Digital Library

[20]

Yang, X.-D., Grossman, T., Wigdor, D. and Fitzmaurice, G. 2012. Magic finger: always-available input through finger instrumentation. Proc. UIST '12, 147--156.

Digital Library

Cited By

Shen XYu CWang XLiang CChen HShi Y(2024)MouseRing: Always-available Touchpad Interaction with IMU RingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642225(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642225
Medeiros DDubus RWilliamson JWilson GPöhlmann KMcGill M(2023)Surveying the Social Comfort of Body, Device, and Environment-Based Augmented Reality Interactions in Confined Passenger Spaces Using Mixed Reality Composite VideosProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109237:3(1-25)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610923
Liang CHsia CYu CYan YWang YShi Y(2023)DRG-KeyboardProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694636:4(1-30)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569463
Show More Cited By

Index Terms

Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input
      2. Pointing

Recommendations

Exploring the use of hand-to-face input for interacting with head-worn displays
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We propose the use of Hand-to-Face input, a method to interact with head-worn displays (HWDs) that involves contact with the face. We explore Hand-to-Face interaction to find suitable techniques for common mobile tasks. We evaluate this form of ...
Moving Ahead with Peephole Pointing: Modelling Object Selection with Head-Worn Display Field of View Limitations
SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

Head-worn displays (HWDs) are now becoming widely available, which will allow researchers to explore sophisticated interface designs that support rich user productivity features. In a large virtual workspace, the limited available field of view (FoV) ...
Hand-based interaction for object manipulation with augmented reality glasses
VRCAI '14: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

An increase number of gesture sensors and AR(augmented reality) displays are emerging these years. There are more and more study working on spatial interaction. In this work, we focus on evaluating the feasibility of hand-based interaction designed for ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '16: Proceedings of the 2016 Symposium on Spatial User Interaction

October 2016

236 pages

ISBN:9781450340687

DOI:10.1145/2983310

General Chair:
Christian Sandor
Nara Institute of Science and Technology, Japan
,
Program Chairs:
Robert Teather
Carleton University, Canada
,
Evan Suma
University of Southern California, USA
,
Kyle Johnsen
University Of Georgia, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
VRSJ SIG-MR: Virtual Reality Society of Japan, Special Interest Group on Mixed Reality

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSERC

Conference

SUI '16

Sponsor:

SIGGRAPH
SIGCHI
VRSJ SIG-MR

SUI '16: Symposium on Spatial User Interaction

October 15 - 16, 2016

Tokyo, Japan

Acceptance Rates

SUI '16 Paper Acceptance Rate 20 of 77 submissions, 26%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
872
Total Downloads

Downloads (Last 12 months)63
Downloads (Last 6 weeks)9

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shen XYu CWang XLiang CChen HShi Y(2024)MouseRing: Always-available Touchpad Interaction with IMU RingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642225(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642225
Medeiros DDubus RWilliamson JWilson GPöhlmann KMcGill M(2023)Surveying the Social Comfort of Body, Device, and Environment-Based Augmented Reality Interactions in Confined Passenger Spaces Using Mixed Reality Composite VideosProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109237:3(1-25)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610923
Liang CHsia CYu CYan YWang YShi Y(2023)DRG-KeyboardProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694636:4(1-30)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569463
Lee LBraud THui P(2023)Embodied Interaction on Constrained Interfaces for Augmented RealitySpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_10(239-271)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_10
Kubo Y(2022)Ring-type Indirect Pointing Device for Large Displays using Three-axis Pressure SensorProceedings of the 2022 ACM Symposium on Spatial User Interaction10.1145/3565970.3568185(1-2)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1145/3565970.3568185
Bardot SRey BAudette LFan KHuang DLi JLi WIrani P(2022)One Ring to Rule Them AllProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503156:3(1-20)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550315
Paredes LIpsita AMesa JMartinez Garrido RRamani K(2022)StretchARProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503056:3(1-26)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550305
Hirsch LLi JMayer SButz A(2022)A Survey of Natural Design for InteractionProceedings of Mensch und Computer 202210.1145/3543758.3543773(240-254)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3543773
Herath ARey BBardot SRempel SAudette LZheng HLi JFan KHuang DLi WIrani P(2022)Expanding Touch Interaction Capabilities for Smart-rings: An Exploration of Continual Slide and Microroll GesturesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519714(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519714
Yu DZhou QDingler TVelloso EGoncalves J(2022)Blending On-Body and Mid-Air Interaction in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00081(637-646)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00081
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten