Cited By
View all- Zhou HGao YSong XLiu WDong W(2020)LimbMotionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33698363:4(1-24)Online publication date: 14-Sep-2020
Real-time 3D finger pointing for an augmented desk
Pages 99 - 108
Abstract
The augmented desk is gaining popularity in recent HCI research. Its layout of a large horizontal screen on the desk enhances immersive and intense collaborative experiences. A responsive and unimpeded input interface is important for an efficient interaction in such an environment. In this paper, we developed a real-time stereo vision-based finger pointing interface for our augmented desk that supports drag-and-drop operation by the tap-and-move of the index finger. The core of our system is a 3D fingertip tracking system, which requires both careful calibration and efficient fingertip localization algorithm. To meet these requirements, we have designed a two-step calibration method that strikes a good balance between accuracy and convenience. Furthermore, based on the chain code representation of the contour, we propose the direction cancellation vector as a tool for fingertip localization. Our algorithm works efficiently with a time complexity of O(n) in term of the length of the chain code. Currently our system allows a user to select and move the displayed contents on the screen directly using his fingertip, and it is applied to the interactive graph drawing paradigm proposed by do Nascimento and Eades (2001). In this application, our real-time pointing interface enables the user to interact with a graph drawing program dynamically, which results in optimal layouts of graphs with maximum symmetry. In the last section, the strength and weakness of our system are discussed, and further suggestions to improve the system are also given.
References
[1]
Adcock, M., Hutchins, M., and Gunn, C. (2003): Augmented Reality Haptics: Using ARToolKit for Display of Haptic Application. In 2nd International Augmented Reality Toolkit Workshop, Tokyo, Japan.
[2]
Albinsson, P. A., and Zhai S. (2003): High precision touch screen interaction. In Conference on Human factors in computing systems, pp. 105--112.
[3]
Coquillart, S., and Wesche, G. (1999): The Virtual Palette and the Virtual Remote Control Panel: A Device and an Interaction Paradigm for the Responsive Workbench. In IEEE Virtual Reality '99 Conference (VR99), Houston, USA.
[4]
Dietz, P. H., Leigh, D. L. (2001): DiamondTouch: A Multi-User Touch Technology. In 14th ACM Symposium on User Interface Software and Technology (UIST), pp. 219--226.
[5]
do Nascimento, H. A. D., and Eades, P. (2002): User Hints for Directed Graph Drawing. in Proceedings of the 9th Graph Drawing Conference (GD 2001), Lectures Notes on Computer Science, 2265:205--219.
[6]
do Nascimento, H. A. D. (2003): User Hints for Optimization Processes. Ph.D. Thesis. School of Information Technology, the University of Sydney, Sydney.
[7]
Eades, P. (1984): A heuristic for graph drawing. Congressus Numerantium, 42:149--160.
[8]
Ebert, D., Bedwell, E., Maher, S., Smoliar, L., and Downing, E. (1999): Realizing 3D visualization using crossed-beam volumetric displays. In Communications of the ACM, 42(8):101--107.
[9]
Grossman, T., Wigdor, D., and Balakrishnan, R. (2004): Multi-finger gestural interaction with 3D volumetric displays. In 17th ACM Symposium on User Interface Software and Technology (UIST), pp. 61--70.
[10]
Hardenberg, C. V., and Bérard, F. (2001): Bare-Hand Human-Computer Interaction. In Proceedings of the ACM Workshop on Perceptive User Interfaces, Orlando, Florida, USA.
[11]
Hartley, R., and Zisserman, A. (2000): Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, UK.
[12]
Kobourov, S. G., and Pitta, C. (2004): An interactive multi-user system for simultaneous graph drawing. In -12th Symposium on Graph Drawing (GD04).
[13]
Krahnstoever, N., Kettebekov, S., Yeasin, M. and Sharma, R. (2002): A Real-Time Framework for Natural Multimodal Inter-action with Large Screen Displays. in Fourth IEEE International Conference on Multimodal Interfaces (ICMI 2002), Pittsburgh, USA.
[14]
Leibe, B., Stanner, T., Ribarsky, W., Wartell, Z., Krum, D., Singletary, B., and Hodges, L. (2000): The Perspecitve Workbench: Towards Spontaneous and Natural Interaction in Semi-Immersive Virtual Environments. In IEEE Virtual Reality 2000 Conference (VR'2000), pp. 13->20, New Brunswick, NJ, USA.
[15]
MacEachren, A. M., Brewer, I., Cai, G., and Chen, J. (2003): Visual-Enabled Geocollaboration to Support Data Exploration and Decision-Making. In Proceeding of the 21st International Cartography Conference, Durban, South Africa.
[16]
May, R. (1999): HI-SPACE: A Next Generation Workspace Environment. Master's Thesis. EECS, Washington State University.
[17]
Oka, K., Sato, Y., and Koike, H. (2002): Real-Time Fingertip Tracking and Gesture Recognition. In IEEE Computer Graphics and Applications, 22(6):64--71.
[18]
Pavlovic, V. I., Sharma, R., Huang, T. S. (1997): Visual Interpretation of Hand Gestures for Human-Computer Interaction: a Review. In IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):677--695.
[19]
Rauschert, I., Agrawal, P., Fuhrmann, S., Brewer, I., Wang, H., Sharma, R., Cai, G., and MacEachren, A. (2002): Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management. In 10th ACM Symposium on Advances in Geographic Information Systems (ACM GIS'02), Washington, DC, USA.
[20]
Seay, A. F., Krum, D., Ribarsky, W., and Hodges, L. (1999): Multimodal Interaction Techniques for the Virtual Workbench. In Proceeding of CHI'99.
[21]
Schmalstieg, P. L., Encarnacao, L. M., and Szalavar, Z. (1999): Using Transparent Props for Interaction with Virtual Table. In Syposium on Interactive 3D Graphics (13DG'99), Atlanta, USA.
[22]
Takatsuka, M., West, G. A., Venkatesh, V., and Caelli, T. M. (1998): Low Cost Interactive Binocular Range Finder. Technical Report No. 5, Curtin University of Technology, School of Computing, Perth, WA, Australia.
[23]
Ullmer, B., and Ishii, H. (1997): The metaDESK: Models and Prototypes for Tangible User Interfaces. In Proceedings of User Interface Software and Technology (UIST'97).
[24]
Welch, G., and Bishop, G. (1995): An Introduction to the Kalman Filter. Technical Report TR95--041, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Index Terms
- Real-time 3D finger pointing for an augmented desk
Recommendations
Interactive Manipulation of Augmented Objects in Marker-Less AR Using Vision-Based Hand Interaction
ITNG '10: Proceedings of the 2010 Seventh International Conference on Information Technology: New GenerationsIn this paper, we present a vision-based framework to manipulate the augmented reality (AR) objects robustly in a marker-less AR system. It is known that one of the promising ways to develop a marker-less AR system is using human’s body such as hand or ...
Real-time Hand Tracking Using Kinect
ICDSP '18: Proceedings of the 2nd International Conference on Digital Signal ProcessingReal-time hand tracking is fundamental to human gesture recognition. However, due to the huge computation, previous studies are either off-line or limited to given poses. In order to satisfy the requirement of real-time hand tracking, in this paper we ...
A robust 3D eye gaze tracking system using noise reduction
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applicationsThis paper describes a novel real-time 3D gaze estimation system. The system consists of two cameras and two IR light sources. There are three novelties in this method. First, in our system, two IR lights are mounted near the centers of the stereo ...
Comments
Information & Contributors
Information
Published In
Publisher
Australian Computer Society, Inc.
Australia
Publication History
Published: 30 January 2005
Author Tags
Qualifiers
- Article
Conference
AUIC '05
Acceptance Rates
Overall Acceptance Rate 40 of 100 submissions, 40%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 626Total Downloads
- Downloads (Last 12 months)26
- Downloads (Last 6 weeks)8
Reflects downloads up to 03 Sep 2024
Other Metrics
Citations
Cited By
View all- Zhou HGao YSong XLiu WDong W(2020)LimbMotionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33698363:4(1-24)Online publication date: 14-Sep-2020
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in