poster

Assisting with Voluntary Pinch Force Control by Using Electrical Muscle Stimulation and Active Bio-Acoustic Sensing

Authors:

Arinobu Niijima,

Yuki KuboAuthors Info & Claims

UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology

Pages 11 - 13

https://doi.org/10.1145/3474349.3480214

Published: 10 October 2021 Publication History

Abstract

We present a novel wearable system for assisting with voluntary pinch force control that requires no devices on the fingers. We use active bio-acoustic sensing to estimate voluntary pinch force with piezo elements attached to the back of the hand and electrical muscle stimulation to the forearm to control involuntary pinch force in a closed-loop system. We conducted a user study with eight participants to investigate whether the system could assist with pinch force control under target forces of 3 N, 6 N, or 9 N. When they tried to get pinch force closer to each target force with our system, the medians of the absolute errors were 0.8 N, 1.0 N, and 2.8 N, respectively. When they tried to do it without our system, they were 0.9 N, 1.4 N, and 2.4 N, respectively.

References

[1]

Vincent Becker, Pietro Oldrati, Liliana Barrios, and Gabor Soros. 2018. TouchSense: classifying finger touches and measuring their force with an electromyography armband. In Proceedings of the 2018 ACM International Symposium on Wearable Computers(ISWC ’18). 1–8. https://doi.org/10.1145/3267242.3267250

Digital Library

[2]

Delphine Chadefaux, Guillaume Rao, Jean-Loïc Le Carrou, Eric Berton, and Laurent Vigouroux. 2017. The effects of player grip on the dynamic behaviour of a tennis racket. Journal of Sports Sciences 35, 12 (2017), 1155–1164. https://doi.org/10.1080/02640414.2016.1213411

[3]

Jacob Cohen. 1992. A power primer. Psychological Bulletin 112, 1 (1992), 155. https://doi.org/10.1037//0033-2909.112.1.155

[4]

Bachar Dreibati, Cedric Lavet, Antonio Pinti, and Georges Poumarat. 2010. Influence of electrical stimulation frequency on skeletal muscle force and fatigue. Annals of Physical and Rehabilitation Medicine 53, 4 (2010), 266–277. https://doi.org/10.1016/j.rehab.2010.03.004

[5]

Tim Duente, Justin Schulte, Max Pfeiffer, and Michael Rohs. 2018. Muscleio: muscle-based input and output for casual notifications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1–21. https://doi.org/10.1145/3214267

Digital Library

[6]

Yinfeng Fang, Zhaojie Ju, Xiangyang Zhu, and Honghai Liu. 2014. Finger pinch force estimation through muscle activations using a surface EMG sleeve on the forearm. In 2014 IEEE International Conference on Fuzzy Systems(FUZZ-IEEE ’14). 1449–1455. https://doi.org/10.1109/FUZZ-IEEE.2014.6891790

[7]

Mahmoud Hassan, Florian Daiber, Frederik Wiehr, Felix Kosmalla, and Antonio Krüger. 2017. FootStriker: an EMS-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1–18. https://doi.org/10.1145/3053332

Digital Library

[8]

Erin R. Komi, Jonathan R. Roberts, and Steve J. Rothberg. 2008. Measurement and analysis of grip force during a golf shot. Proceedings of the Institution of Mechanical Engineers, Part P: Journal of Sports Engineering and Technology 222, 1 (2008), 23–35. https://doi.org/10.1243/17543371JSET9

[9]

Yuki Kubo, Yuto Koguchi, Buntarou Shizuki, Shin Takahashi, and Otmar Hilliges. 2019. AudioTouch: minimally invasive sensing of micro-gestures via active bio-acoustic sensing. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’19). 1–13. https://doi.org/10.1145/3338286.3340147

Digital Library

[10]

Stephen A. Mascaro and H. Harry Asada. 2004. Measurement of finger posture and three-axis fingertip touch force using fingernail sensors. IEEE Transactions on Robotics and Automation 20, 1(2004), 26–35. https://doi.org/10.1109/TRA.2003.820931

[11]

Jun Nishida and Kenji Suzuki. 2017. BioSync: a paired wearable device for blending kinesthetic experience. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). 3316–3327. https://doi.org/10.1145/3025453.3025829

Digital Library

[12]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & Activate: adding interactivity to existing objects using active acoustic sensing. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology(UIST ’13). 31–40. https://doi.org/10.1145/2501988.2501989

Digital Library

[13]

Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE Transactions on Haptics 10, 4 (2017), 580–600. https://doi.org/10.1109/TOH.2017.2689006

Digital Library

[14]

Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’11). 543–552. https://doi.org/10.1145/1978942.1979018

Digital Library

[15]

Joseph D. Towles, Vincent R. Hentz, and Wendy M. Murray. 2008. Use of intrinsic thumb muscles may help to improve lateral pinch function restored by tendon transfer. Clinical Biomechanics 23, 4 (2008), 387–394. https://doi.org/10.1016/j.clinbiomech.2007.11.008

Cited By

Faltaous SWilliamson JKoelle MPfeiffer MKeppel JSchneegass S(2024)Understanding User Acceptance of Electrical Muscle Stimulation in Human-Computer InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642585(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642585
Faltaous SKoelle MSchneegass S(2022)From Perception to Action: A Review and Taxonomy on Electrical Muscle Stimulation in HCIProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568460(159-171)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568460

Index Terms

Assisting with Voluntary Pinch Force Control by Using Electrical Muscle Stimulation and Active Bio-Acoustic Sensing
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Tactile and hand-based interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques
      1. Gestural input

Index terms have been assigned to the content through auto-classification.

Recommendations

Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle Stimulation
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Fingertip force control plays an important role in learning motor skills. Exoskeleton gloves have been developed to assist with fingertip force control, but having the equipment on the fingers interferes with finger motion control and tactile sensation. ...
Demonstrating How to Increase the Dexterity of Electrical Muscle Stimulation using Back of the Hand Actuation
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

We demonstrate a technique that allows an unprecedented level of dexterity in electrical muscle stimulation (EMS), i.e., it allows interactive EMS-based devices to flex the user's fingers independently of each other. EMS is a promising technique for ...
Increasing Electrical Muscle Stimulation's Dexterity by means of Back of the Hand Actuation
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

We propose a technique that allows an unprecedented level of dexterity in electrical muscle stimulation (EMS), i.e., it allows interactive EMS-based devices to flex the user's fingers independently of each other. EMS is a promising technique for force ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology

October 2021

182 pages

ISBN:9781450386555

DOI:10.1145/3474349

Editors:
Jeffrey Nichols
Apple, USA
,
Ranjitha Kumar
UIUC, USA
,
Michael Nebeling
University of Michigan, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

UIST '21

Sponsor:

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

October 10 - 14, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
313
Total Downloads

Downloads (Last 12 months)103
Downloads (Last 6 weeks)9

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Faltaous SWilliamson JKoelle MPfeiffer MKeppel JSchneegass S(2024)Understanding User Acceptance of Electrical Muscle Stimulation in Human-Computer InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642585(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642585
Faltaous SKoelle MSchneegass S(2022)From Perception to Action: A Review and Taxonomy on Electrical Muscle Stimulation in HCIProceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia10.1145/3568444.3568460(159-171)Online publication date: 27-Nov-2022
https://dl.acm.org/doi/10.1145/3568444.3568460

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents