poster

Personal space: user defined gesture space for GUI interaction

Authors:

G. Michael Poor,

Darren GuinnessAuthors Info & Claims

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

Pages 1615 - 1620

https://doi.org/10.1145/2559206.2581242

Published: 26 April 2014 Publication History

Abstract

Reality-Based Interaction (RBI) [14] theorizes that realistic user interactions(UIs)are effective because they exploit users' pre-existing knowledge about their bodies and objects in the world. Gesture based interaction allows users to relay information to a computer through body movement without physical contact with additional hardware such as a mouse or trackball. However, this interaction style requires the users to interact in a manner that is tailored for the system to recognize with very strict rules for bodily interaction, not toward a gesture space that is more natural for the user. In this paper we propose a natural method of gestural input through a user-defined 3-dimensional space. We conducted two pilot studies to assess the performance and usability of these augmented gestural pointing methods for cursor manipulation as compared to a standard mouse interaction as well as the current standard approach used in gestural input.

Supplementary Material

ZIP File (wip0365-file3.zip)

Zip file containing a PDF of the Accompanying Poster

Download
1.73 MB

References

[1]

Von Hardenberg, Christian, and François Bérard. "Bare-hand human-computer interaction." Proceedings of the 2001 workshop on Perceptive user interfaces. ACM, 2001

Digital Library

[2]

Freeman, Dustin, Ramadevi Vennelakanti, and Sriganesh Madhvanath. "Freehand pose-based Gestural Interaction: Studies and implications for interface design." Intelligent Human Computer Interaction (IHCI), 2012 4th International Conference on. IEEE, 2012.

[3]

Vogel, Daniel, and Ravin Balakrishnan. "Distant freehand pointing and clicking on very large, high resolution displays." Proceedings of the 18th annual ACM symposium on User interface software and technology. ACM, 2005.

Digital Library

[4]

Bolt, Richard A. "Put-that-there": Voice and gesture at the graphics interface. Vol. 14. No. 3. ACM, 1980.

Digital Library

[5]

Segen, Jakub, and Senthil Kumar. "Look ma, no mouse!." Communications of the ACM 43.7 (2000): 102--109.

Digital Library

[6]

Lai, Kam, Janusz Konrad, and Prakash Ishwar. "A gesture-driven computer interface using Kinect." Image Analysis and Interpretation (SSIAI), 2012 IEEE Southwest Symposium on. IEEE, 2012.

[7]

Biswas, K. K., and Saurav Kumar Basu. "Gesture Recognition using Microsoft Kinect®." Automation, Robotics and Applications (ICARA), 2011 5th International Conference on. IEEE, 2011.

[8]

Triesch, Jochen, and Christoph Von Der Malsburg. "Robotic gesture recognition by cue combination." Informatik'98. Springer Berlin Heidelberg, 1998. 223232.

[9]

Yoo, Juwan, Seungyup Lee, and Chieteuk Ahn. "Air Hook: Data preloading user interface." ICT Convergence (ICTC), 2012 International Conference on. IEEE, 2012.

[10]

Carmody, T. "Why "Gorilla Arm Syndrome" Rules Out Multitouch Notebook Displays." (2011). {online} http://www.wired.com/gadgetlab/2010/10/gorilla-armmultitouch/

[11]

Teixeira, Vítor. Improving elderly access to audiovisual and social media, using a multimodal human-computer interface. Diss. Faculdade de Engenharia, Universidade do Porto, 2011.

[12]

Wachs, Juan Pablo, et al. "Vision-based handgesture applications." Communications of the ACM 54.2 (2011): 60--71.

Digital Library

[13]

Wang, Robert Y., and Jovan Popovi . "Real-time hand-tracking with a color glove." ACM Transactions on Graphics (TOG). Vol. 28. No. 3. ACM, 2009.

Digital Library

[14]

Jacob, Robert JK, et al. "Reality-based interaction: a framework for post-WIMP interfaces." Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 2008.

Digital Library

[15]

Zhai, Shumin. "Characterizing computer input with Fitts' law parameters--the information and noninformation aspects of pointing." International Journal of Human-Computer Studies 61.6 (2004): 791--809.

Digital Library

[16]

G.M. Poor, Brianna J. Tomlinson, Darren Guinness, Samuel D. Jaffee, Laura M. Leventhal, Guy Zimmerman, Dale S. Klopfer. "Tangible or Gestural: Comparing Tangible vs. Kinect Interactions with an Object Manipulation Task." 7th International Conference on Tangible, Embedded and Embodied Interaction, 2013.

Cited By

Veras RSingh GFarhadi-Niaki FUdhani RPatekar PZhou WIrani PLi WKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Elbow-Anchored Interaction: Designing Restful Mid-Air InputProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445546(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445546
Hewawalpita SPerera I(2019)Multimodal user interaction framework for e-commerce2019 International Research Conference on Smart Computing and Systems Engineering (SCSE)10.23919/SCSE.2019.8842815(9-16)Online publication date: Mar-2019
https://doi.org/10.23919/SCSE.2019.8842815
Poor GJude A(2019)Interaction can hurt - Exploring gesture-based interaction for users with Chronic PainSymposium on Spatial User Interaction10.1145/3357251.3357589(1-5)Online publication date: 19-Oct-2019
https://dl.acm.org/doi/10.1145/3357251.3357589
Show More Cited By

Index Terms

Personal space: user defined gesture space for GUI interaction
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Modality and Depth in Touchless Smartphone Augmented Reality Interactions
IMX '20: Proceedings of the 2020 ACM International Conference on Interactive Media Experiences

Augmented reality (AR) on smartphone devices allows people to interact with virtually placed objects anchored in the real world through the device’s viewport. Typically, smartphone AR interactions work with the device’s 2D touchscreen disconnected from ...
Visual touchpad: a two-handed gestural input device
ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

This paper presents the Visual Touchpad, a low-cost vision-based input device that allows for fluid two-handed interactions with desktop PCs, laptops, public kiosks, or large wall displays. Two downward-pointing cameras are attached above a planar ...
Interacting with a personal cubic 3D display
MM '09: Proceedings of the 17th ACM international conference on Multimedia

We describe a demonstration of four novel interaction techniques for a cubic head-coupled 3D display. The interactions illustrated include: viewing a static scene, navigating through a large landscape, playing with colliding objects inside a box, and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

April 2014

2620 pages

ISBN:9781450324748

DOI:10.1145/2559206

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI EA '14 Paper Acceptance Rate 1,000 of 3,200 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
472
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Veras RSingh GFarhadi-Niaki FUdhani RPatekar PZhou WIrani PLi WKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Elbow-Anchored Interaction: Designing Restful Mid-Air InputProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445546(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445546
Hewawalpita SPerera I(2019)Multimodal user interaction framework for e-commerce2019 International Research Conference on Smart Computing and Systems Engineering (SCSE)10.23919/SCSE.2019.8842815(9-16)Online publication date: Mar-2019
https://doi.org/10.23919/SCSE.2019.8842815
Poor GJude A(2019)Interaction can hurt - Exploring gesture-based interaction for users with Chronic PainSymposium on Spatial User Interaction10.1145/3357251.3357589(1-5)Online publication date: 19-Oct-2019
https://dl.acm.org/doi/10.1145/3357251.3357589
Li XHan FSun XLiu YLi YChen Y(2018)Bracelet: arms-down selection for Kinect mid-air gestureBehaviour & Information Technology10.1080/0144929X.2018.153616638:4(401-409)Online publication date: 24-Oct-2018
https://doi.org/10.1080/0144929X.2018.1536166
Xu WBao DWu QZhou YWu XYing FYao C(2018)Behavior Mapping of Sketching in VR Space with Physical Tablet InterfaceDistributed, Ambient and Pervasive Interactions: Technologies and Contexts10.1007/978-3-319-91131-1_19(240-252)Online publication date: 30-May-2018
https://doi.org/10.1007/978-3-319-91131-1_19
Clarke CGellersen HGajos KMankoff JHarrison C(2017)MatchPointProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126626(179-192)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126626
Benoit GPoor GJude AMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Bimanual Word Gesture Keyboards for Mid-air GesturesProceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/3027063.3053137(1500-1507)Online publication date: 6-May-2017
https://dl.acm.org/doi/10.1145/3027063.3053137
Erazo OBaloian NPino JOchoa S(2017)Designing hand gesture interfaces for easing students participation from their spot2017 IEEE 21st International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD.2017.8066683(133-138)Online publication date: Apr-2017
https://doi.org/10.1109/CSCWD.2017.8066683
Jude APoor GGuinness DSandor CTeather RSuma EJohnsen K(2016)Grasp, Grab or Pinch? Identifying User Preference for In-Air Gestural ManipulationProceedings of the 2016 Symposium on Spatial User Interaction10.1145/2983310.2989209(219-219)Online publication date: 15-Oct-2016
https://dl.acm.org/doi/10.1145/2983310.2989209
Lubos PBruder GAriza OSteinicke FSandor CTeather RSuma EJohnsen K(2016)Touching the SphereProceedings of the 2016 Symposium on Spatial User Interaction10.1145/2983310.2985753(13-22)Online publication date: 15-Oct-2016
https://dl.acm.org/doi/10.1145/2983310.2985753
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents