Finger movement recognition during ballistic movements using electromyography
Pages 302 - 311
Abstract
Individuals who perform repetitive and spontaneous movements with their fingers such as typing on a keyboard or playing instruments are susceptible to repetitive stress injuries. We denote such movements as "ballistic gestures". The most common injury due to ballistic gestures is carpal tunnel syndrome, which occurs when typing on a keyboard using an improper typing style or hand posture. It then becomes important to pro-actively analyze an individual's finger movements and recommend changes according to their habits to prevent such injuries. In this work, we present a Gaussian mixture Hidden Markov Model classification method to classify finger movement during typing activities with an accuracy above 97%. Indeed, the model maintains such accuracy across typing speeds and different individuals. Further, we show the effects that sampling rate, electrode placement, typing speed, and movement epenthesis have on classification accuracy in ballistic gestures.
References
[1]
G. S. Phalen, "The carpal-tunnel syndrome," The Journal of Bone & Joint Surgery, vol. 48, no. 2, pp. 211--228, 1966.
[2]
G. Robertson, G. Caldwell, J. Hamill, G. Kamen, and S. Whittlesey, Research methods in biomechanics, 2E. Human Kinetics, 2013.
[3]
"Myo gesture control armband - wearable technology by thalmic labs," https://www.myo.com, accessed: 2016-03-30.
[4]
"Leo: Fitness intelligence," http://leohelps.com/, accessed: 2016-03-30.
[5]
"Athos muscle activity measurement fitness apparel," https://www.liveathos.com, accessed: 2017-04-28.
[6]
"Hexoskin smart monitor," https://www.liveathos.com, accessed: 2017-04-28.
[7]
T. Starner, J. Weaver, and A. Pentland, "Real-time american sign language recognition using desk and wearable computer based video," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 12, pp. 1371--1375, 1998.
[8]
S. Mitra and T. Acharya, "Gesture recognition: A survey," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 37, no. 3, pp. 311--324, 2007.
[9]
W. Putnam and R. B. Knapp, "Real-time computer control using pattern recognition of the electromyogram," in Engineering in Medicine and Biology Society, 1993. Proceedings of the 15th Annual International Conference of the IEEE, 1993, pp. 1236--1237.
[10]
Y.-H. Tarng, G.-C. Chang, J.-S. Lai, and T.-S. Kuo, "Design of the human/computer interface for human with disability using myoelectric signal control," in Engineering in Medicine and Biology Society, 1997. Proceedings of the 19th Annual International Conference of the IEEE, vol. 5. IEEE, 1997, pp. 1909--1910.
[11]
G. Kondo, R. Kato, H. Yokoi, and T. Arai, "Classification of individual finger motions hybridizing electromyogram in transient and converged states," in Robotics and Automation (ICRA), 2010 IEEE International Conference on, May 2010, pp. 2909--2915.
[12]
X. Chen and Z. J. Wang, "Pattern recognition of number gestures based on a wireless surface emg system," Biomedical Signal Processing and Control, vol. 8, no. 2, pp. 184--192, 2013.
[13]
E. Kutafina, D. Laukamp, and S. M. Jonas, "Wearable sensors in medical education: Supporting hand hygiene training with a forearm emg," in PHealth 2015: Proceedings of the 12th International Conference on Wearable Micro and Nano Technologies for Personalized Health 2--4 June 2015 Västerås, Sweden, vol. 211. IOS Press, 2015, p. 286.
[14]
J. Liu, D. Ying, W. Z. Rymer, and P. Zhou, "Robust muscle activity onset detection using an unsupervised electromyogram learning framework," PloS one, vol. 10, no. 6, p. e0127990, 2015.
[15]
A. Attenberger and K. Buchenrieder, "Remotehand: A wireless myoelectric interface," in Human-Computer Interaction. Advanced Interaction Modalities and Techniques. Springer, 2014, pp. 3--11.
[16]
H. G. Stack, "Muscle function in the fingers," Journal of Bone & Joint Surgery, British Volume, vol. 44, no. 4, pp. 899--909, 1962.
[17]
H. Gray and C. M. Goss, Anatomy of the human body. Lea & Febiger, 1878, vol. 8.
[18]
R. Merletti, ISEK Standards of Reporting EMG Data, 1999.
[19]
K. R. Wheeler, "Device control using gestures sensed from emg," in Soft Computing in Industrial Applications, 2003. SMCia/03. Proceedings of the 2003 IEEE International Workshop on. IEEE, 2003, pp. 21--26.
[20]
G. Kaur, A. S. Arora, and V. Jain, "Comparison of the techniques used for segmentation of emg signals," in Proceedings of the 11th WSEAS international conference on Mathematical and computational methods in science and engineering. World Scientific and Engineering Academy and Society (WSEAS), 2009, pp. 124--129.
[21]
X. Zhang, X. Chen, W.-h. Wang, J.-h. Yang, V. Lantz, and K.-q. Wang, "Hand gesture recognition and virtual game control based on 3d accelerometer and emg sensors," in Proceedings of the 14th international conference on Intelligent user interfaces. ACM, 2009, pp. 401--406.
[22]
B. Hudgins, P. Parker, and R. N. Scott, "A new strategy for multifunction myoelectric control," Biomedical Engineering, IEEE Transactions on, vol. 40, no. 1, pp. 82--94, 1993.
[23]
M. Reaz, M. Hussain, and F. Mohd-Yasin, "Techniques of emg signal analysis: detection, processing, classification and applications," Biological procedures online, vol. 8, no. 1, pp. 11--35, 2006.
[24]
M. P. Mobarak, M. J. G. Salgado, R. M. Guerrero, and V. L. Dorr, "Transient state analysis of the multichannel emg signal using hjorth's parameters for identication of hand movements," in International Multi-Conference on Computing in the Global Information Technology, ICCGI 2014, 2014.
[25]
E. Wit, E. v. d. Heuvel, and J.-W. Romeijn, "all models are wrong...: an introduction to model uncertainty," Statistica Neerlandica, vol. 66, no. 3, pp. 217--236, 2012.
[26]
Y. Itoh, H. Uematsu, F. Nogata, T. Nemoto, A. Inamori, K. Koide, and H. Matsuura, "Finger curvature movement recognition interface technique using semg signals," Journal of Achievements in Materials and Manufacturing Engineering, vol. 23, no. 2, pp. 43--46, 2007.
[27]
A. H. Al-Timemy, G. Bugmann, J. Escudero, and N. Outram, "Classification of finger movements for the dexterous hand prosthesis control with surface electromyography," Biomedical and Health Informatics, IEEE Journal of, vol. 17, no. 3, pp. 608--618, 2013.
[28]
A. J. Young, L. H. Smith, E. J. Rouse, and L. J. Hargrove, "Classification of simultaneous movements using surface emg pattern recognition," Biomedical Engineering, IEEE Transactions on, vol. 60, no. 5, pp. 1250--1258, 2013.
Recommendations
Pilot study on fine finger movement regression, using FMG
2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC)Predicting hand gestures and finger movements include a wide range of applications in different fields such as human computer interaction, rehabilitation, and prosthesis control. Research in this area, mainly focuses on hand gesture classification which ...
A proposal for wearable controller device and finger gesture recognition using surface electromyography
SA '17: SIGGRAPH Asia 2017 PostersHand and finger motion is very complicated and achieved by intertwining forearm part (extrinsic) and finger part (intrinsic) muscles. We created a wearable finger-less glove controller using dry electrodes of sEMG(surface Electromyography) and only ...
Hierarchical approach for fusion of electroencephalography and electromyography for predicting finger movements and kinematics using deep learning
AbstractThe brain is a unique organ that performs multiple processes simultaneously, such as sensory, motor, and cognitive function. However, several neurological diseases (ataxia, dystonia, Huntington’s disease) or trauma affect the limb ...
Comments
Information & Contributors
Information
Published In
Sponsors
Publisher
IEEE Press
Publication History
Published: 17 July 2017
Check for updates
Qualifiers
- Research-article
Conference
CHASE '17
Sponsor:
CHASE '17: ACM/IEEE International Conference on Connected Health: Applications, Systems and Engineering Technologies
July 17 - 19, 2017
Pennsylvania, Philadelphia
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 57Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in