HCMG: Human-Capacitance based Micro Gesture for VR/AR
Authors: 
Yu Lu, Dian Ding, Ran Wang, Guangtao XueAuthors Info & Claims
Yu Lu, Dian Ding, Ran Wang, Guangtao XueAuthors Info & ClaimsPages 766 - 770
Abstract
Hand-tracking technology is a pivotal input method in augmented and virtual reality environments, providing enhanced interaction accuracy through micro-gesture recognition. This allows users to control devices with minimal knuckle movements, ensuring privacy and accessibility for individuals with mobility impairments. Building on the foundation of human capacitance, this paper introduces a novel approach termed human capacitance-based micro gesture (HCMG) recognition. This system employs capacitive sensors integrated within the inner lining of a wrist guard, capable of detecting subtle changes in skin-to-electrode contact caused by finger joint movements. Our approach leverages the inherent properties of human capacitance to facilitate accurate and efficient micro-gesture recognition. HCMG achieves recognition of five common micro gestures with an accuracy of 95.0%, providing a promising solution to address the limitations of existing techniques.
References
[1]
Htc. hand tracking. https://www.vive.com/cn/, 2023.
[2]
Meta. getting started with hand tracking on meta quest headsets. https: //www.meta.com/help/quest/articles/headsets-and-accessories/controllers and-hand-tracking/hand-tracking/, 2023.
[3]
A. Ahlbom, U. Bergqvist, J. Bernhardt, J. Cesarini, M. Grandolfo, M. Hietanen, A. Mckinlay, M. Repacholi, D. H. Sliney, J. A. Stolwijk, et al. Guidelines for limiting exposure to time-varying electric, magnetic, and electromagnetic fields (up to 300 ghz). Health physics, 74(4):494--521, 1998.
[4]
D.Ding,Y.-C.Chen,X.Ji,andG.Xue. Leakthief:Stealingthebehaviorinformation of laptop via leakage current. In 2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), pages 186--194, 2023.
[5]
D. Ding, L. Yang, Y.-C. Chen, and G. Xue. Leakage or identification: Behavior irrelevant user identification leveraging leakage current on laptops. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 5(4), dec 2022.
[6]
T. FDC2214, 2022.
[7]
A. Gupta, M. Anwar, and R. Balakrishnan. Porous interfaces for small screen multitasking using finger identification. UIST '16, page 145--156, New York, NY, USA, 2016.
[8]
A. Gupta and R. Balakrishnan. Dualkey: Miniature screen text entry via finger identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, page 59--70, New York, NY, USA, 2016. Association for Computing Machinery.
[9]
Z. Huang, W. Xu, and K. Yu. Bidirectional lstm-crf models for sequence tagging. arXiv preprint arXiv:1508.01991, 2015.
[10]
K. Ikematsu and S. Yamanaka. Scratouch: Extending interaction technique using f ingernail on unmodified capacitive touch surfaces. PACM IMWUT., 4(3), sep 2020.
[11]
Y. Jiang, X. Ji, K. Wang, C. Yan, R. Mitev, A.-R. Sadeghi, and W. Xu. Wight: Wired ghost touch attack on capacitive touchscreens. In 2022 IEEE Symposium on Security and Privacy (SP), pages 984--1001, 2022.
[12]
K. Kin, C. Wan, K. Koh, A. Marin, N. C. Camgöz, Y. Zhang, Y. Cai, F. Kovalev, M. Ben-Zacharia, S. Hoople, M. Nunes-Ueno, M. Sanchez-Rodriguez, A. Bhar gava, R. Wang, E. Sauser, and S. Ma. Stmg: A machine learning microgesture recognition system for supporting thumb-based vr/ar input. In Proceedings of the CHI Conference on Human Factors in Computing Systems, CHI '24, New York, NY, USA, 2024. Association for Computing Machinery.
[13]
H. V. Le, S. Mayer, and N. Henze. Investigating the feasibility of finger identifica tion on capacitive touchscreens using deep learning. IUI '19, page 637--649, New York, NY, USA, 2019. Association for Computing Machinery.
[14]
S. Mayer, H. V. Le, and N. Henze. Estimating the finger orientation on capacitive touchscreens using convolutional neural networks. ISS '17, page 220--229, 2017.
[15]
I. Oakley, C. Lindahl, K. Le, D. Lee, and M. R. Islam. The flat finger: Exploring area touches on smartwatches. CHI '16, page 4238--4249, New York, NY, USA, 2016.
[16]
V. V. Pande, N. S. Ubale, D. P. Masurkar, N. R. Ingole, and P. P. Mane. Hand gesture based wheelchair movement control for disabled person using mems. International Journal of Engineering Research and Applications, 4(4):152--158, 2014.
[17]
M.D.Pereira, G. A. Alvarez-Botero, and F. Rangel de Sousa. Characterization and modeling of the capacitive hbc channel. IEEE Transactions on Instrumentation and Measurement, 64(10):2626--2635, 2015.
[18]
J.-Y. Ruan, P. C.-P. Chao, and W.-D. Chen. A multi-touch interface circuit for a large-sized capacitive touch panel. In SENSORS, 2010 IEEE, pages 309--314, 2010.
[19]
A.Sharma, J. S. Roo, and J. Steimle. Grasping microgestures: Eliciting single-hand microgestures for handheld objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI '19, page 1--13, New York, NY, USA, 2019. Association for Computing Machinery.
[20]
Y. Tan, S. H. Yoon, and K. Ramani. Bikegesture: User elicitation and perfor mance of micro hand gesture as input for cycling. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA'17, page 2147--2154, New York, NY, USA, 2017. Association for Computing Machinery.
[21]
K. ?opi? Pucihar, C. Sandor, M. Kljun, W. Huerst, A. Plopski, T. Taketomi, H. Kato, and L. A. Leiva. The missing interface: Micro-gestures on augmented objects. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Comput ing Systems, CHI EA '19, page 1--6, New York, NY, USA, 2019. Association for Computing Machinery.
[22]
R. Xiao, J. Schwarz, and C. Harrison. Estimating 3d finger angle on commodity touchscreens. ITS '15, page 47--50, 2015.
[23]
Z. Yan, Q. Song, R. Tan, Y. Li, and A. W. K. Kong. Towards touch-to-access device authentication using induced body electric potentials. In The 25th Annual International Conference on Mobile Computing and Networking, MobiCom '19, NewYork, NY, USA, 2019. Association for Computing Machinery.
[24]
H. Zhou, T. Lu, Y. Liu, S. Zhang, R. Liu, and M. Gowda. One ring to rule them all: Anopen source smartring platform for finger motion analytics and healthcare applications. In Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation, IoTDI '23, page 27--38, New York, NY, USA, 2023. Association for Computing Machinery.
[25]
H. Zhou, T. Lu, K. Mckinnie, J. Palagano, K. Dehaan, and M. Gowda. SignQuery: A Natural User Interface and Search Engine for Sign Languages with Wearable Sensors. Association for Computing Machinery, New York, NY, USA, 2023.
Index Terms
- HCMG: Human-Capacitance based Micro Gesture for VR/AR
Recommendations
Human-virtual human interaction by upper body gesture understanding
VRST '13: Proceedings of the 19th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, a novel human-virtual human interaction system is proposed. This system supports a real human to communicate with a virtual human using natural body language. Meanwhile, the virtual human is capable of understanding the meaning of human ...
Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor
ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information TechnologyThe hand gesture provides a natural and intuitive communication medium for the human and machine interaction. Because, it can use in virtual reality, language detection, computer games, and other human-computer or human-machine instruction applications. ...
Depth-based hand gesture recognition
In this article, a dynamic gesture recognition system with the depth information is proposed. The proposed system consists of three main components: preprocessing, static posture recognition and dynamic gesture recognition. In the first component, the ...
Comments
Information & Contributors
Information
Published In
October 2024
1032 pages
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- NSFC
Conference
UbiComp '24: The 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing
October 5 - 9, 2024
Melbourne VIC, Australia
Acceptance Rates
Overall Acceptance Rate 764 of 2,912 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 76Total Downloads
- Downloads (Last 12 months)76
- Downloads (Last 6 weeks)9
Reflects downloads up to 01 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in