research-article

Open access

MyoSpring: 3D Printing Mechanomyographic Sensors for Subtle Finger Gesture Recognition

Authors:

Stephen Shiao-ru Lin,

Nisal Menuka Gamage,

Kithmini Herath, and

Anusha WithanaAuthors Info & Claims

TEI '22: Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2022

Article No.: 15, Pages 1 - 13

https://doi.org/10.1145/3490149.3501321

Published: 13 February 2022 Publication History

All formats PDF

Abstract

We introduce MyoSpring, a novel technique to fabricate customised mechanomyographic sensors with 3D printed springs. MyoSpring averts from a traditional ‘one-size-fits-all’ approach and facilitates the development of functionally customisable wrist-worn sensors, which can be used to recognise subtle finger gestures with high accuracy. We automate the design process of MyoSpring sensors with an intuitive Graphical User Interface enabling novices to quickly design and fabricate customised sensors. We conducted a user study with 15 participants and 12 gestures, including partial and full flexion finger gestures, to verify the functionality of MyoSpring. Through the evaluation, we show that 1) MyoSpring can achieve high average accuracy of finger gesture sensing of 94.11% (SD = 9.73%), 2) mechanical customisation allows MyoSpring to significantly improve the average accuracy of overall gesture sensing and 3) MyoSpring better supports partial finger flexion gesture sensing, achieving an accuracy of 91.44% (SD = 11.76%) for partial gestures.

Supplementary Material

MP4 File (tei22_15.mp4)

Supplemental video

Download
100.29 MB

References

[1]

Efthimios Alepis and Constantinos Patsakis. 2017. Monkey says, monkey does: security and privacy on voice assistants. IEEE Access 5(2017), 17841–17851. https://doi.org/10.1109/ACCESS.2017.2747626

[2]

Ana Alves-Pinto, Varvara Turova, Tobias Blumenstein, and Renée Lampe. 2016. The case for musical instrument training in cerebral palsy for neurorehabilitation. Neural plasticity 2016(2016). https://doi.org/10.1155/2016/1072301

[3]

Brian Amento, Will Hill, and Loren Terveen. 2002. The sound of one hand: A wrist-mounted bio-acoustic fingertip gesture interface. Conference on Human Factors in Computing Systems - Proceedings (2002), 724–725.

Digital Library

[4]

Ewout A Arkenbout, Joost C F De Winter, and Paul Breedveld. 2015. Robust hand motion tracking through data fusion of 5DT data glove and nimble VR Kinect camera measurements. Sensors 15, 12 (2015), 31644–31671. https://doi.org/10.3390/s151229868

[5]

Riley Booth and Peter Goldsmith. 2018. A wrist-worn piezoelectric sensor array for gesture input. Journal of Medical and Biological Engineering 38, 2(2018), 284–295.

[6]

Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using body-worn inertial sensors. Comput. Surveys 46, 3 (2014), 1–33. https://doi.org/10.1145/2499621

Digital Library

[7]

Ilaria Carpinella, Johanna Jonsdottir, and Maurizio Ferrarin. 2011. Multi-finger coordination in healthy subjects and stroke patients: a mathematical modelling approach. Journal of neuroengineering and rehabilitation 8, 1(2011), 1–20.

[8]

Girma Gebre Chassie, L E Becker, and W L Cleghorn. 1997. On the buckling of helical springs under combined compression and torsion. International Journal of Mechanical Sciences 39, 6 (1997), 697–704. https://doi.org/10.1016/S0020-7403(96)00070-7

[9]

Hyun Ju Chong, Sung-Rae Cho, Eunju Jeong, and Soo Ji Kim. 2013. Finger exercise with keyboard playing in adults with cerebral palsy: A preliminary study. Journal of exercise rehabilitation 9, 4 (2013), 420. https://doi.org/10.12965%2Fjer.130050

[10]

Hyun Ju Chong, Soo Jeong Han, Yong Jae Kim, Hye Young Park, and Soo Ji Kim. 2014. Relationship between output from MIDI-keyboard playing and hand function assessments on affected hand after stroke. NeuroRehabilitation 35, 4 (2014), 673–680. https://doi.org/10.3233/nre-141166

[11]

Maximilian Christ, Nils Braun, Julius Neuffer, and Andreas W Kempa-Liehr. 2018. Time series feature extraction on basis of scalable hypothesis tests (tsfresh–a python package). Neurocomputing 307(2018), 72–77.

Digital Library

[12]

James Connolly, Joan Condell, Brendan O’Flynn, Javier Torres Sanchez, and Philip Gardiner. 2017. IMU sensor-based electronic goniometric glove for clinical finger movement analysis. IEEE Sensors Journal 18, 3 (2017), 1273–1281. https://doi.org/10.1109/JSEN.2017.2776262

[13]

Ana Grasielle Dionísio Corrêa, Irene Karaguilla Ficheman, Marilena do Nascimento, and Roseli de Deus Lopes. 2009. Computer assisted music therapy: A case study of an augmented reality musical system for children with cerebral palsy rehabilitation. In 2009 Ninth IEEE International Conference on Advanced Learning Technologies. IEEE, 218–220. https://doi.org/10.1109/ICALT.2009.111

Digital Library

[14]

Marta Sylvia Del Rio Guerra, Jorge Martin-Gutierrez, Renata Acevedo, and Sofía Salinas. 2019. Hand gestures in virtual and augmented 3D environments for down syndrome users. Applied Sciences (Switzerland) 9, 13 (2019), 1–16. https://doi.org/10.3390/app9132641

[15]

Mona Lisa Delva, Kim Lajoie, Mahta Khoshnam, and Carlo Menon. 2020. Wrist-worn wearables based on force myography: on the significance of user anthropometry. BioMedical Engineering OnLine 19, 1 (2020), 1–18. https://doi.org/10.1186/s12938-020-00789-w

[16]

Artem Dementyev and Joseph A Paradiso. 2014. WristFlex: low-power gesture input with wrist-worn pressure sensors. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 161–166. https://doi.org/10.1145/2642918.2647396

Digital Library

[17]

Huijun Ding, Qing He, Yongjin Zhou, Guo Dan, and Song Cui. 2017. An individual finger gesture recognition system based on motion-intent analysis using mechanomyogram signal. Frontiers in neurology 8(2017), 573.

[18]

K. Dorfmüller-Ulhaas and D. Schmalstieg. 2001. Finger tracking for interaction in augmented environments. Proceedings - IEEE and ACM International Symposium on Augmented Reality, ISAR 2001 (2001), 55–64. https://doi.org/10.1109/ISAR.2001.970515

[19]

Aarthi Easwara Moorthy and Kim-Phuong L Vu. 2015. Privacy concerns for use of voice activated personal assistant in the public space. International Journal of Human-Computer Interaction 31, 4(2015), 307–335. https://doi.org/10.1080/10447318.2014.986642

[20]

KERSTIN B EBERHARDT, B Svensson, and U Moritz. 1988. Functional assessment of early rheumatoid arthritis. Rheumatology 27, 5 (1988), 364–371.

[21]

Kristian Ehlers and Konstantin Brama. 2016. A human-robot interaction interface for mobile and stationary robots based on real-time 3D human body and hand-finger pose estimation. IEEE International Conference on Emerging Technologies and Factory Automation, ETFA 2016-November(2016). https://doi.org/10.1109/ETFA.2016.7733719

Digital Library

[22]

Valentino Frati and Domenico Prattichizzo. 2011. Using Kinect for hand tracking and rendering in wearable haptics. 2011 IEEE World Haptics Conference, WHC 2011 (2011), 317–321. https://doi.org/10.1109/WHC.2011.5945505

[23]

Eoghan Furey and Juanita Blue. 2018. She knows too much–voice command devices and privacy. In 2018 29th Irish Signals and Systems Conference (ISSC). IEEE, 1–6. https://doi.org/10.1109/ISSC.2018.8585380

[24]

Roberto Gatti, Andrea Tettamanti, Simone Lambiase, Paolo Rossi, and Mauro Comola. 2015. Improving hand functional use in subjects with multiple sclerosis using a musical keyboard: a randomized controlled trial. Physiotherapy Research International 20, 2 (2015), 100–107. https://doi.org/10.1002/pri.1600

[25]

L-C Gerhardt, Alexander Lenz, Nicholas D Spencer, Thomas Münzer, and Stephan Derler. 2009. Skin–textile friction and skin elasticity in young and aged persons. Skin Research and Technology 15, 3 (2009), 288–298. https://doi.org/10.1111/j.1600-0846.2009.00363.x

[26]

Jun Gong, Zheer Xu, Qifan Guo, Teddy Seyed, Xiang Anthony Chen, Xiaojun Bi, and Xing Dong Yang. 2018. WrisText: One-handed text entry on smartwatch using WrisT gestures. Conference on Human Factors in Computing Systems - Proceedings 2018-April (2018), 1–14. https://doi.org/10.1145/3173574.3173755

Digital Library

[27]

Mark A Hall. 1999. Correlation-based Feature Selection for Machine Learning. April (1999).

[28]

Nur Al-huda Hamdan, Adrian Wagner, Simon Voelker, Jürgen Steimle, and Jan Borchers. 2019. Springlets: Expressive, flexible and silent on-skin tactile interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14. https://doi.org/10.1145/3290605.3300718

Digital Library

[29]

Liang He, Huaishu Peng, Michelle Lin, Ravikanth Konjeti, François Guimbretière, and Jon E Froehlich. 2019. Ondulé: Designing and Controlling 3D Printable Springs. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 739–750. https://doi.org/10.1145/3332165.3347951

Digital Library

[30]

Daniel Herren. [n.d.]. The Proximal Interphalangeal Joint: Arthritis and Deformity. 4, 6 ([n. d.]), 254–262. https://doi.org/10.1302/2058-5241.4.180042 31312517

[31]

Fang Hu, Peng He, Songlin Xu, Yin Li, and Cheng Zhang. 2020. FingerTrak: Continuous 3D hand pose tracking by deep learning hand silhouettes captured by miniature thermal cameras on wrist. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1–24.

Digital Library

[32]

Wolfgang Hürst and Casper Van Wezel. 2013. Gesture-based interaction via finger tracking for mobile augmented reality. Multimedia Tools and Applications 62, 1 (2013), 233–258. https://doi.org/10.1007/s11042-011-0983-y

[33]

Alexandra Ion, Johannes Frohnhofen, Ludwig Wall, Robert Kovacs, Mirela Alistar, Jack Lindsay, Pedro Lopes, Hsiang Ting Chen, and Patrick Baudisch. 2016. Metamaterial mechanisms. UIST 2016 - Proceedings of the 29th Annual Symposium on User Interface Software and Technology (2016), 529–539. https://doi.org/10.1145/2984511.2984540

Digital Library

[34]

Yasha Iravantchi, Mayank Goel, and Chris Harrison. 2019. BeamBand: Hand gesture sensing with ultrasonic beamforming. Conference on Human Factors in Computing Systems - Proceedings (2019), 1–10. https://doi.org/10.1145/3290605.3300245

Digital Library

[35]

David Jack, Rares Boian, Alma S Merians, Marilyn Tremaine, Grigore C Burdea, Sergei V Adamovich, Michael Recce, and Howard Poizner. 2001. Virtual reality-enhanced stroke rehabilitation. IEEE transactions on neural systems and rehabilitation engineering 9, 3(2001), 308–318. https://doi.org/10.1109/7333.948460

[36]

Godwin Ponraj Joseph Vedhagiri, Xin Zhi Wang, Kirthika Senthil Kumar, and Hongliang Ren. 2020. Comparative Study of Machine Learning Algorithms to Classify Hand Gestures from Deployable and Breathable Kirigami-Based Electrical Impedance Bracelet. Multimodal Technologies and Interaction 4, 3 (2020), 47. https://doi.org/10.3390/mti4030047

[37]

Pyeong-Gook Jung, Gukchan Lim, Seonghyok Kim, and Kyoungchul Kong. 2015. A wearable gesture recognition device for detecting muscular activities based on air-pressure sensors. IEEE Transactions on Industrial Informatics 11, 2 (2015), 485–494.

[38]

Hsin-Liu (Cindy) Kao, Artem Dementyev, Joseph A. Paradiso, and Chris Schmandt. 2015. NailO: Fingernails as an Input Surface. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15 (2015), 3015–3018. https://doi.org/10.1145/2702123.2702572

Digital Library

[39]

Yoshihiro Kawahara, Steve Hodges, Benjamin S. Cook, Cheng Zhang, and Gregory D. Abowd. 2013. Instant inkjet circuits: Lab-based inkjet printing to support rapid prototyping of ubicomp devices. UbiComp 2013 - Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing(2013), 363–372. https://doi.org/10.1145/2493432.2493486

Digital Library

[40]

David Kim, Otmar Hilliges, Shahram Izadi, Alex Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor. UIST’12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (2012), 167–176. https://doi.org/10.1145/2380116.2380139

Digital Library

[41]

Gierad Laput, Robert Xiao, and Chris Harrison. 2016. Viband: High-fidelity bio-acoustic sensing using commodity smartwatch accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. Tokyo, Japan, 321–333. https://doi.org/10.1145/2984511.2984582

Digital Library

[42]

Xiangpeng Liang, Rami Ghannam, and Hadi Heidari. 2018. Wrist-worn gesture sensing with wearable intelligence. IEEE Sensors Journal 19, 3 (2018), 1082–1090. https://doi.org/10.1109/TII.2017.2779814

[43]

Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous gesture sensing with millimeter wave radar. ACM Transactions on Graphics 35, 4 (2016). https://doi.org/10.1145/2897824.2925953

Digital Library

[44]

Meng-Kun Liu, Yu-Ting Lin, Zhao-Wei Qiu, Chao-Kuang Kuo, and Chi-Kang Wu. 2020. Hand Gesture Recognition by a MMG-based Wearable Device. IEEE Sensors Journal(2020). https://doi.org/10.1109/JSEN.2020.3011825

[45]

Jess McIntosh, Asier Marzo, and Mike Fraser. 2017. Sensir: Detecting hand gestures with a wearable bracelet using infrared transmission and reflection. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 593–597. https://doi.org/10.1145/3126594.3126604

Digital Library

[46]

Jess McIntosh, Asier Marzo, Mike Fraser, and Carol Phillips. 2017. Echoflex: Hand gesture recognition using ultrasound imaging. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1923–1934. https://doi.org/10.1145/3025453.3025807

Digital Library

[47]

Jess McIntosh, Charlie McNeill, Mike Fraser, Frederic Kerber, Markus Löchtefeld, and Antonio Krüger. 2016. EMPress: Practical hand gesture classification with wrist-mounted EMG and pressure sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 2332–2342. https://doi.org/10.1145/2858036.2858093

Digital Library

[48]

Dickson Neoh, Khairul Salleh Mohamed Sahari, and Wan Zul Fahmi Wan Ibrahim. 2018. A Dataglove Hardware Design and Real-Time Sign Gesture Interpretation. In 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS) and 19th International Symposium on Advanced Intelligent Systems (ISIS). IEEE, 946–949. https://doi.org/10.1109/SCIS-ISIS.2018.00157

[49]

Aditya Shekhar Nittala, Anusha Withana, Narjes Pourjafarian, and Jürgen Steimle. [n.d.]. Multi-touch skin: A thin and flexible multi-touch sensor for on-skin input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.

[50]

Hyunjoo Oh, Tung D. Ta, Ryo Suzuki, Mark D. Gross, Yoshihiro Kawahara, and Lining Yao. 2018. PEP (3D Printed Electronic Papercrafts): An Integrated Approach for 3D Sculpting Paper-Based Electronic Devices. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, New York, New York, USA, 1–12. https://doi.org/10.1145/3173574.3174015

Digital Library

[51]

Simon Olberding, Sergio Soto Ortega, Klaus Hildebrandt, and Jürgen Steimle. 2015. Foldio: Digital Fabrication of Interactive and Shape Changing Objects With Foldable Printed Electronics. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST ’15(2015), 223–232. https://doi.org/10.1145/2807442.2807494

Digital Library

[52]

Claudio Orizio. 1993. Muscle sound: Bases for the introduction of a mechanomyographic signal in muscle studies. Journal of Critical Reviews in Biomedical Engineering 21, 3(1993), 201–243.

[53]

Narjes Pourjafarian, Anusha Withana, Joe Paradiso, and Jürgen Steimle. 2019. Multi-Touch Kit: A Do-It-Yourself Technique for Capacitive Multi-Touch Sensing using a Commodity Microcontroller. The 32nd Annual ACM Symposium on User Interface Software and Technology - UIST ’19 (to appear)(2019).

Digital Library

[54]

Celestine Preetham, Girish Ramakrishnan, Sujan Kumar, Anish Tamse, and Nagendra Krishnapura. 2013. Hand talk-implementation of a gesture recognizing glove. In 2013 Texas Instruments India Educators’ Conference. IEEE, 328–331. https://doi.org/10.1109/TIIEC.2013.65

Digital Library

[55]

Jun Rekimoto. 2001. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Proceedings Fifth International Symposium on Wearable Computers. IEEE, 21–27.

[56]

David Rempel, Matt J. Camilleri, and David L. Lee. 2014. The design of hand gestures for human–computer interaction: Lessons from sign language interpreters. International Journal of Human-Computer Studies 72, 10 (2014), 728–735. https://doi.org/10.1016/j.ijhcs.2014.05.003

Digital Library

[57]

Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST ’15. ACM Press, New York, New York, USA, 253–258. https://doi.org/10.1145/2807442.2807503

Digital Library

[58]

Martin Schmitz, Martin Stitz, Florian Müller, Markus Funk, and Max Mühlhäuser. 2019. ./trilaterate: A Fabrication Pipeline to Design and 3D Print Hover-, Touch-, and Force-Sensitive Objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–13. https://doi.org/10.1145/3290605.3300684

Digital Library

[59]

Fereshteh Shahmiri and Paul H. Dietz. 2020. ShArc: A Geometric Technique for Multi-Bend/Shape Sensing. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376269

Digital Library

[60]

Peter B Shull, Shuo Jiang, Yuhui Zhu, and Xiangyang Zhu. 2019. Hand gesture recognition and finger angle estimation via wrist-worn modified barometric pressure sensing. IEEE Transactions on Neural Systems and Rehabilitation Engineering 27, 4(2019), 724–732. https://doi.org/10.1109/TNSRE.2019.2905658

[61]

Nabeel Siddiqui and Rosa H M Chan. 2017. A wearable hand gesture recognition device based on acoustic measurements at wrist. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 4443–4446. https://doi.org/10.1109/EMBC.2017.8037842

[62]

Philip T Smith, R Ryan Vallance, and Eric R Marsh. 2005. Correcting capacitive displacement measurements in metrology applications with cylindrical artifacts. Precision engineering 29, 3 (2005), 324–335. https://doi.org/10.1016/j.precisioneng.2004.11.010

[63]

Mihai T Tarata. 2003. Mechanomyography versus electromyography, in monitoring the muscular fatigue. Biomedical engineering online 2, 1 (2003), 1–10.

[64]

Shigeyuki Tateno, Yiwei Zhu, and Fanxing Meng. 2019. Hand Gesture Recognition System for In-car Device Control Based on Infrared Array Sensor. 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019(2019), 701–706. https://doi.org/10.23919/SICE.2019.8859832

[65]

Hoang Truong, Shuo Zhang, Ufuk Muncuk, Phuc Nguyen, Nam Bui, Anh Nguyen, Qin Lv, Kaushik Chowdhury, Thang Dinh, and Tam Vu. 2018. CapBand: Baery-free successive capacitance sensing wristband for hand gesture recognition. SenSys 2018 - Proceedings of the 16th Conference on Embedded Networked Sensor Systems (2018), 54–67. https://doi.org/10.1145/3274783.3274854

Digital Library

[66]

Hsin-Ruey Tsai, Min-Chieh Hsiu, Jui-Chun Hsiao, Lee-Ting Huang, Mike Chen, and Yi-Ping Hung. 2016. TouchRing: subtle and always-available input using a multi-touch ring. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. 891–898.

Digital Library

[67]

U Chris Ugbolue, Wei-Hsiu Hsu, Robert J Goitz, and Zong-Ming Li. 2005. Tendon and nerve displacement at the wrist during finger movements. Clinical Biomechanics 20, 1 (2005), 50–56. https://doi.org/10.1016/j.clinbiomech.2004.08.006

[68]

Dau-Chung Wang, Jung-Chuan Chou, Shih-Ming Wang, Po-Lun Lu, and Lan-Pin Liao. 2003. Application of a Fringe Capacitive Sensor to Small-Distance Measurement. Japanese Journal of Applied Physics 42, Part 1, No. 9A (sep 2003), 5816–5820. https://doi.org/10.1143/jjap.42.5816

[69]

Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. Iskin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2991–3000.

Digital Library

[70]

Hongyi Wen, Julian Ramos Rojas, and Anind K. Dey. 2016. Serendipity: Finger gesture recognition using an off-the-shelf smartwatch. Conference on Human Factors in Computing Systems - Proceedings (2016), 3847–3851. https://doi.org/10.1145/2858036.2858466

Digital Library

[71]

Mathias Wilhelm, Daniel Krakowczyk, Frank Trollmann, and Sahin Albayrak. 2015. eRing: Multiple finger gesture recognition with one ring using an electric field. ACM International Conference Proceeding Series 25-26-June-2015 (2015), 1–6. https://doi.org/10.1145/2790044.2790047

Digital Library

[72]

Anusha Withana, Roshan Peiris, Nipuna Samarasekara, and Suranga Nanayakkara. 2015. ZSense: Enabling shallow depth gesture recognition for greater input expressivity on smart wearables. Conference on Human Factors in Computing Systems - Proceedings 2015-April (2015), 3661–3670. https://doi.org/10.1145/2702123.2702371

Digital Library

[73]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). Association for Computing Machinery, New York, NY, USA, 1083–1092. https://doi.org/10.1145/1518701.1518866

Digital Library

[74]

Richard B Woodward, Maria J Stokes, Sandra J Shefelbine, and Ravi Vaidyanathan. 2019. Segmenting mechanomyography measures of muscle activity phases using inertial data. Scientific reports 9, 1 (2019), 1–10. https://doi.org/10.1038/s41598-019-41860-4

[75]

Jiahui Wu, Gang Pan, Daqing Zhang, Guande Qi, and Shijian Li. 2009. Gesture recognition with a 3-d accelerometer. In International Conference on Ubiquitous Intelligence and Computing. Springer, 25–38. https://doi.org/10.1007/978-3-642-02830-4_4

Digital Library

[76]

M H Wu and W Y Hsu. 1998. Modelling the static and dynamic behavior of a conical spring by considering the coil close and damping effects. Journal of Sound and Vibration 214, 1 (1998), 17–28. https://doi.org/10.1006/jsvi.1997.1511

[77]

Junichi Yamaoka, Mustafa Doga Dogan, Katarina Bulovic, Kazuya Saito, Yoshihiro Kawahara, Yasuaki Kakehi, and Stefanie Mueller. 2019. FoldTronics: Creating 3D Objects with Integrated Electronics Using Foldable Honeycomb Structures. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19. ACM Press, New York, New York, USA, 1–14. https://doi.org/10.1145/3290605.3300858

Digital Library

[78]

Xiaoming Yin and Ming Xie. 2007. Finger identification and hand posture recognition for human-robot interaction. Image and Vision Computing 25, 8 (2007), 1291–1300. https://doi.org/10.1016/j.imavis.2006.08.003

Digital Library

[79]

Colleen M Zelazny. 2001. Therapeutic instrumental music playing in hand rehabilitation for older adults with osteoarthritis: Four case studies. Journal of Music Therapy 38, 2 (2001), 97–113. https://doi.org/10.1093/jmt/38.2.97

[80]

Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Ruichen Meng, Sumeet Jain, Yizeng Han, Xinyu Li, Kenneth Cunefare, Thomas Ploetz, Thad Starner, Omer Inan, and Gregory D. Abowd. 2018. FingerPing: Recognizing fine-grained hand poses using active acoustic on-body sensing. Conference on Human Factors in Computing Systems - Proceedings 2018-April (2018), 1–10. https://doi.org/10.1145/3173574.3174011

Digital Library

[81]

Xu Zhang, Xiang Chen, Yun Li, Vuokko Lantz, Kongqiao Wang, and Jihai Yang. 2011. A framework for hand gesture recognition based on accelerometer and EMG sensors. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 41, 6 (2011), 1064–1076. https://doi.org/10.1109/TSMCA.2011.2116004

Digital Library

[82]

Yang Zhang and Chris Harrison. 2015. Tomo: Wearable, low-cost electrical impedance tomography for hand gesture recognition. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 167–173. https://doi.org/10.1145/2807442.2807480

Digital Library

[83]

Yuhui Zhu, Shuo Jiang, and Peter B Shull. 2018. Wrist-worn hand gesture recognition based on barometric pressure sensing. In 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, 181–184. https://doi.org/10.1109/BSN.2018.8329688

Cited By

Ruston OSharma AFraser M(2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660726
Lee CYang DKu PKao H(2024)SweatSkinProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314257:4(1-30)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631425
Cho SZaffir MYoshikawa MTakamatsu JWada T(2024)Influence of Forearm Postures on Hand-Wrist Gesture Recognition With Forearm Deformation MeasurementsIEEE Transactions on Medical Robotics and Bionics10.1109/TMRB.2024.33773646:2(652-661)Online publication date: May-2024
https://doi.org/10.1109/TMRB.2024.3377364
Show More Cited By

Index Terms

MyoSpring: 3D Printing Mechanomyographic Sensors for Subtle Finger Gesture Recognition
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Index terms have been assigned to the content through auto-classification.

Recommendations

Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

The natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Read More
TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors
ISWC '23: Proceedings of the 2023 ACM International Symposium on Wearable Computers

Fingertip input allows for interactions that are natural, easy to perform, and socially acceptable. It also has advantages in terms of low physical demand, confidentiality, and haptic feedback. In this study, we propose TouchLog, a fingernail-type ...
Read More
Finger gesture recognition through sweep sensor
IMCE '09: Proceedings of the 1st international workshop on Interactive multimedia for consumer electronics

Fingerprint sensor becomes more and more popular, and has been installed in many electronic devices, ranging from portable mobile devices to high-end personal computers. With the high penetration power of fingerprint sensor, this paper proposes to make ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '22: Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2022

758 pages

ISBN:9781450391474

DOI:10.1145/3490149

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 February 2022

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Australian Research Council

Conference

TEI '22

Sponsor:

SIGCHI

TEI '22: Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 13 - 16, 2022

Daejeon, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
1,131
Total Downloads

Downloads (Last 12 months)410
Downloads (Last 6 weeks)39

Other Metrics

View Author Metrics

Citations

Cited By

Ruston OSharma AFraser M(2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660726
Lee CYang DKu PKao H(2024)SweatSkinProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314257:4(1-30)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631425
Cho SZaffir MYoshikawa MTakamatsu JWada T(2024)Influence of Forearm Postures on Hand-Wrist Gesture Recognition With Forearm Deformation MeasurementsIEEE Transactions on Medical Robotics and Bionics10.1109/TMRB.2024.33773646:2(652-661)Online publication date: May-2024
https://doi.org/10.1109/TMRB.2024.3377364
Yu JPerera PPerera RValashani MWithana A(2024)Fabricating Customizable 3-D Printed Pressure Sensors by Tuning Infill CharacteristicsIEEE Sensors Journal10.1109/JSEN.2024.335833024:6(7604-7613)Online publication date: 15-Mar-2024
https://doi.org/10.1109/JSEN.2024.3358330
Ku PHuang KWang NNg BChu AKao H(2023)SkinLinkProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962417:2(1-27)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596241
Withana A(2023)Co-Designing Personalized Assistive Devices Using Personal FabricationCommunications of the ACM10.1145/358915066:7(89-90)Online publication date: 22-Jun-2023
https://dl.acm.org/doi/10.1145/3589150
Yamamoto TMasai KWithana ASugiura Y(2023)Masktrap: Designing and Identifying Gestures to Transform Mask Strap into an Input InterfaceProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584062(762-775)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584062
Sharma ASalchow-Hömmen CMollyn VNittala AHedderich MKoelle MSeel TSteimle J(2023)SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-grained Finger MicrogesturesACM Transactions on Computer-Human Interaction10.1145/356989430:3(1-40)Online publication date: 10-Jun-2023
https://dl.acm.org/doi/10.1145/3569894
Tsuchida TFujita KIkematsu KSarcar STakashima KKitamura Y(2022)TetraForce: A Magnetic-Based Interface Enabling Pressure Force and Shear Force Input Applied to Front and Back of a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677176:ISS(185-206)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567717

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents