3D Hand Pose Estimation for Guqin Performance
Authors: 
Lanlan Lyu, Yi Chen, Li Chen, HP YuanAuthors Info & Claims
Lanlan Lyu, Yi Chen, Li Chen, HP YuanAuthors Info & ClaimsArticle No.: 109, Pages 1 - 5
Abstract
3D Hand Pose Estimations an important research content in the field of human-computer interaction, virtual reality, augmented reality and other gesture interaction. In this paper, 3D hand pose surface estimation based on personalized hand features is proposed and applied to guqin performance. We constructed the database of basic finger-pointing for guqin performance,and based on the Mask R-CNN and FPN network structure, a new MMFPN structure is proposed, which can not only realize the three-dimensional surface estimation of basic finger-pointing, but also effectively solve the problem of self-occlusion.
References
[1]
Rui Li, ZhengyuLiu,Jianrong Tan. A survey on 3D hand pose estimation: Cameras, methods, and datasets. Pattern Reconition.2019,93:251-272
[2]
L.Dipietro, A.M.Sabatini, P.Dario, A survey of glove-based systems and theirapplications, IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 2018,38 (4):461-482.
[3]
J.M.Rehg, T.Kanade, Visual tracking of high DOF articulated structures: anapplication to human hand tracking, Eur. Conf. Comput. Vis. 1994,801: 35-46.
[4]
AmmarAhmad,CyrilleMiniot,AlberDipanda. Hand pose estimation and tracking in real and virtual interaction:Areview.Image and Vision Computing .2019,89:35-49
[5]
A.Erol, G. Bebis, M., Vision-based hand poseestimation: a review, Comput. Vis. Image Underst. 2017,108 (1-2): 52-73.
[6]
Yiming He, Wei Hu, GraphPoseGAN: 3D Hand Pose Estimation from aMonocular RGB Image via Adversarial Learning onGraphs.Computer Vision and Pattern Recognition .2019
[7]
SHARP T, KESKIN C, ROBERTSON D, Accurate,robust, and flexible real-time hand tracking[C]//Proceedingsof the 33th Annual ACM Conference on Human Factors inComputing Systems. Seoul, Republic of Korea: ACM, 2015:3633-3642.
[8]
L.Ge, H.Liang,J.Yuan, D.Thalmann, 3D convolutional neural networks for efficient and robust hand pose estimation from single depth images, in: IEEE Computer Vision and Pattern Recognition, 2017:5679–5688 .
[9]
Kuang Y.Q.,Cheng H.,Cui F.,Semi-supervised hand pose estimation algorithm based on multi-view projection, Journal of University of Electronic Science and Technology of China.2019,48(5):747-753
[10]
LiuhaoGe, Zhou Ren, 3D Hand Shape and Pose Estimation from a Single RGB Image.in CVPR2019.
[11]
Xiong Zhang, Qiang Li, End-to-end Hand Mesh Recovery from a Monocular RGB Image. Computer Vision and Pattern Recognition.2019
[12]
L. Ge, H.Liang, Real-time 3D hand pose estimation with 3D convolutional neural networks, IEEE Trans. Pattern Anal. Mach. Intell. 2019,41 (4) :956–970.
[13]
Varol G, Ceylan D, Bodynet:Volumetric inference of 3D human body shapes[C]//Proceedings of the European Conference on Computer Vision, 2018:20-36.
[14]
Pavllo D, Feichtenhofer C, 3D human pose estimation in video with temporal convolutions andsemi-supervised training[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019:7753-7762.
[15]
Zeng Z. C.,Li G. Q.,Posture and shape reconstruction of 3d mannequin. Journal of Computer Aided Design and Graphics.2019,32(9):1485-1493。
[16]
Franziska Mueller, Micah Davis, Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera. ACM Trans. Graph.38, 4, Article 49 (July 2019), 13 pages. https://doi.org/10.1145/3306346.3322958]
[17]
Jameel Malik, Ahmed Elhayek, DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning fromSynthetic Depth. Computer Vision and Pattern Recognition.2018]
[18]
L.Ge, H.Liang,J.Yuan,D.Thalmann, 3D convolutional neural networks for efficient and robust hand pose estimation from single depth images, in: IEEE Computer Vision and Pattern Recognition, 2017:5679–5688 .
Recommendations
Enhancing 3D hand pose estimation using SHaF: synthetic hand dataset including a forearm
AbstractCurrently, there is an increased need for training images in 3D hand pose estimation and a higher reliance on computationally intensive 3D mesh annotations for 3D coordinate estimations. Considering this, this study introduces a new hand image ...
Simultaneous 3D hand detection and pose estimation using single depth images
Highlights- We proposed to estimate 3D hand pose by simultaneously detecting the hand location.
AbstractIn this paper, we investigate 3D hand pose estimation using single depth images. On the one hand, accurate hand localization is a crucial factor for pose estimation. On the other hand, multi-task learning methods have achieved great ...
3D Hand Pose Estimation via Regularized Graph Representation Learning
Artificial IntelligenceAbstractThis paper addresses the problem of 3D hand pose estimation from a monocular RGB image. While previous methods have shown great success, the structure of hands has not been fully exploited, which is critical in pose estimation. To this end, we ...
Comments
Information & Contributors
Information
Published In
December 2021
699 pages
ISBN:9781450385053
DOI:10.1145/3508546
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 February 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ACAI'21
ACAI'21: 2021 4th International Conference on Algorithms, Computing and Artificial Intelligence
December 22 - 24, 2021
Sanya, China
Acceptance Rates
Overall Acceptance Rate 173 of 395 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 54Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)1
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format