Article

Bare-hand human-computer interaction

Authors:

Christian von Hardenberg,

François BérardAuthors Info & Claims

PUI '01: Proceedings of the 2001 workshop on Perceptive user interfaces

Pages 1 - 8

https://doi.org/10.1145/971478.971513

Published: 15 November 2001 Publication History

Abstract

In this paper, we describe techniques for barehanded interaction between human and computer. Barehanded means that no device and no wires are attached to the user, who controls the computer directly with the movements of his/her hand.Our approach is centered on the needs of the user. We therefore define requirements for real-time barehanded interaction, derived from application scenarios and usability considerations. Based on those requirements a finger-finding and hand-posture recognition algorithm is developed and evaluated.To demonstrate the strength of the algorithm, we build three sample applications. Finger tracking and hand posture recognition are used to paint virtually onto the wall, to control a presentation with hand postures, and to move virtual items on the wall during a brainstorming session. We conclude the paper with user tests, which were conducted to prove the usability of bare-hand human computer interaction.

Supplementary Material

JPG File (p29-von_hardenberg.jpg)

Download
11.32 KB

von_hardenberg (p29-von_hardenberg.mpg)

This file contains a supplemental video to "Bare-hand human-computer interaction"

Download
12.32 MB

References

[1]

Bérard, F. Vision par ordinateur pour l'interaction homme-machine fortement couplée, Doctoral Theses, Université Joseph Fourier, Grenoble, 1999.]]

[2]

Blake, A., Isard, M., and Reynard, D. Learning to track the visual motion of contours, Artificial Intelligence, 78, 101--134, 1995.]]

Digital Library

[3]

Card, S. Moran, T. Newell, A. The Psychology of Human-Computer Interaction, Lawrence Erlbaum Associates, 1983.]]

Digital Library

[4]

Crowley, J., Bérard, F., and Coutaz, J. Finger tacking as an input device for augmented reality, Automatic Face and Gesture Recognition, Zürich, 195--200, 1995.]]

[5]

Freeman, W., Anderson, D. and Beardsley, P. Computer Vision for Interactive Computer Graphics, IEEE Computer Graphics and Applications, 42--53, Mai-June 1998.]]

Digital Library

[6]

Laptev, I. and Lindeberg, T. Tracking of Multi-State Hand Models Using Particle Filtering and a Hierarchy of Multi-Scale Image Features, Technical report ISRN KTH/NA/P-00/ 12-SE, September 2000.]]

[7]

Lee, J. and Kunii, T. Constraint-based hand animation, in Models and techniques in computer animation, 110--127, Springer Verlag, Tokyo, 1993.]]

[8]

Lien, C. and Huang, C. Model-Based Articulated Hand Motion Tracking For Gesture Recognition, Image and Vision Computing, vol. 16, no. 2, 121--134, February 1998.]]

[9]

MacCormick, J. M. and Isard, M. Partitioned sampling, articulated objects, and interface-quality hand tracking, European Conference on Computer Vision, Dublin, 2000.]]

Digital Library

[10]

MacKenzie, I. and Ware, C. Lag as a determinant of Human Performance in Interactive Systems. Conference on Human Factors in Computing Systems, 488--493, New York, 1993.]]

Digital Library

[11]

O'Hagan, R. and Zelinsky, A. Finger Track - A Robust and Real-Time Gesture Interface, Australian Joint Conference on Artificial Intelligence, Perth, 1997.]]

Digital Library

[12]

Quek, F., Mysliwiec, T. and Zhao, M. Finger mouse: A freehand pointing interface, International Workshop on Automatic Face- and Gesture-Recognition, Zürich, 1995.]]

[13]

Rehg, J. and Kanade, T. Digiteyes: Vision-based human hand tracking, Technical Report CMU-CS-93-220, School of Computer Science, Carnegie Mellon University, 1993.]]

Digital Library

[14]

Sato, Y., Kobayashi, Y. and Koike, H. Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface, International Conference on Automatic Face and Gesture Recognition, Grenoble, 2000.]]

Digital Library

[15]

Segen, J. GestureVR: Vision-Based 3D Hand Interface for Spatial Interaction, ACM Multimedia Conference, Bristol, 1998.]]

Digital Library

[16]

Stafford-Fraser, J. Video-Augmented Environments, PhD theses, Gonville & Caius College, University of Cambridge, 1996.]]

[17]

Triesch, J. and Malsburg, C. Robust Classification of Hand Postures Against Complex Background, International Conference On Automatic Face and Gesture Recognition, Killington, 1996.]]

Digital Library

[18]

Ware, C. and Balakrishnan, R. Researching for Objects in VR Displays: Lag and Frame Rate, ACM Transactions on Computer-Human Interaction, vol. 1, no. 4, 331--356, 1994.]]

Digital Library

[19]

Zhu, X., Yang, J. and Waibel, A. Segmenting Hands of Arbitrary Color, International Conference on Automatic Face and Gesture Recognition, Grenoble, 2000.]]

Digital Library

Cited By

Burnah TImtiaz MGuesgen HRudolph GBlagojevic R(2024)Passive Stylus Tracking: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36981448:ISS(427-461)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698144
Burnah T(2024)Monocular Tracking of Passive Stylus on Passive SurfaceCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698041(4-8)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698041
Wei YXu KLi YYu LLiang H(2024)Exploring and Modeling Directional Effects on Steering Behavior in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345616630:11(7107-7117)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456166
Show More Cited By

Index Terms

Bare-hand human-computer interaction
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interactive systems and tools

Recommendations

A Real Time Vision-Based Hand Gesture Interaction
AMS '10: Proceedings of the 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation

Moving beyond mouse and keyboard, the evolution of human-computer interaction (HCI) has been an interest research in recent years which witnessed the development from text-based like using a keyboard to graphic user interface (GUI) based on a mouse, ...
The 3d sensor table for bare hand tracking and posture recognition
MMM'07: Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I

The 3D Sensor Table system senses the movement of bare-hand and recognizes simple hand postures, such as stretched-hand, fist, and knife-shape hand. This system is designed for user interaction with real-time two- and three-dimensional graphics ...
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

The natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PUI '01: Proceedings of the 2001 workshop on Perceptive user interfaces

November 2001

241 pages

ISBN:9781450374736

DOI:10.1145/971478

Copyright © 2001 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

PUI01

PUI01: Workshop on Perceptive User Interfaces

November 15 - 16, 2001

Florida, Orlando, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

164
Total Citations
View Citations
3,616
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Burnah TImtiaz MGuesgen HRudolph GBlagojevic R(2024)Passive Stylus Tracking: A Systematic Literature ReviewProceedings of the ACM on Human-Computer Interaction10.1145/36981448:ISS(427-461)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698144
Burnah T(2024)Monocular Tracking of Passive Stylus on Passive SurfaceCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698041(4-8)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698041
Wei YXu KLi YYu LLiang H(2024)Exploring and Modeling Directional Effects on Steering Behavior in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345616630:11(7107-7117)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456166
Liu ROhkawa TZhang MSato Y(2024)Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00071(677-686)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00071
Gong YFan Z(2023)Portable non-battery pressure monitoring gloves for basketball sport analysisIEICE Electronics Express10.1587/elex.20.2023034320:18(20230343-20230343)Online publication date: 25-Sep-2023
https://doi.org/10.1587/elex.20.20230343
Fu QLiu XXu RNiebles JKitani K(2023)Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.02157(23543-23554)Online publication date: 1-Oct-2023
https://doi.org/10.1109/ICCV51070.2023.02157
Sachdeva KSachdeva R(2023)A Novel Technique for Hand Gesture Recognition2023 International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT)10.1109/ICAICCIT60255.2023.10466087(556-560)Online publication date: 23-Nov-2023
https://doi.org/10.1109/ICAICCIT60255.2023.10466087
Karsh BLaskar RKarsh R(2023)mIV3Net: modified inception V3 network for hand gesture recognitionMultimedia Tools and Applications10.1007/s11042-023-15865-183:4(10587-10613)Online publication date: 23-Jun-2023
https://doi.org/10.1007/s11042-023-15865-1
Staretu IMoldovan C(2023)Comparative Analysis of Four Solutions for Command and Control Applied to Anthropomorphic Grippers for RobotsProceedings of SYROM 2022 & ROBOTICS 202210.1007/978-3-031-25655-4_17(157-165)Online publication date: 14-Apr-2023
https://doi.org/10.1007/978-3-031-25655-4_17
Zhang YLiang BChen BTorrens PAtashzar SLin DSun Q(2022)Force-Aware Interface via Electromyography for Natural VR/AR InteractionACM Transactions on Graphics10.1145/3550454.355546141:6(1-18)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555461
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents