short-paper

Stimulated percussions: method to control human for learning music by using electrical muscle stimulation

Authors:

Yoichi OchiaiAuthors Info & Claims

AH '17: Proceedings of the 8th Augmented Human International Conference

Article No.: 33, Pages 1 - 5

https://doi.org/10.1145/3041164.3041202

Published: 16 March 2017 Publication History

Get Access

Abstract

In musical performances, it is important to produce rhythms correctly. However, when beginners play musical instruments, it can be difficult for them to understand rhythms using only visual and auditory rhythm information. To solve this problem, we propose the Stimulated Percussions (SP) system, which generates rhythms on a computer and transfers them to a user's muscles. In this study, we control the user's arms and legs using electrical muscle stimulation (EMS). We attach electrodes near certain arm and leg muscles, and provide stimulation in a manner that allows users to reproduce the correct movement when they play instruments. Our system enables a single player or multiple players to correctly reproduce generated rhythms. Experimental results show that our system is useful for beginners learning musical instruments, because it allows accurate rhythms to be mastered through bodily sensations.

References

[1]

A. Ebisu, S. Hashizume, K. Suzuki, A. Ishii, M. Sakashita, and Y. Ochiai. Stimulated percussions: Techniques for controlling human as percussive musical instrument by using electrical muscle stimulation. In SIGGRAPH ASIA 2016 Posters, SA '16, pages 37:1--37:2, New York, NY, USA, 2016. ACM.

Digital Library

Google Scholar

[2]

S. Holland, A. J. Bouwer, M. Dalgelish, and T. M. Hurtig. Feeling the beat where it counts: Fostering multi-limb rhythm skills with the haptic drum kit. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction, TEI '10, pages 21--28, New York, NY, USA, 2010. ACM.

Digital Library

Google Scholar

[3]

H. Kanke, T. Terada, and M. Tsukamoto. A percussion learning system by rhythm internalization using haptic indication. In Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology, ACE '15, pages 14:1--14:5, New York, NY, USA, 2015. ACM.

Digital Library

Google Scholar

[4]

P. Lopes, P. Jonell, and P. Baudisch. Affordance++: Allowing objects to communicate dynamic use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, pages 2515--2524, New York, NY, USA, 2015. ACM.

Digital Library

Google Scholar

[5]

P. Marian. Electronic muscle stimulation. http://www.electroschematics.com/2083/electronic-muscle-stimulator/.

Google Scholar

[6]

S. Miura and M. Sugimoto. T-rhythm: a system for supporting rhythm learning by using tactile devices. In IEEE International Workshop on Wireless and Mobile Technologies in Education (WMTE'05), pages 5 pp.--, Nov 2005.

Digital Library

Google Scholar

[7]

Y. Nagashima. Bio-sensing systems and bio-feedback systems for interactive media arts. In Proceedings of the 2003 Conference on New Interfaces for Musical Expression, NIME '03, pages 48--53, Singapore, Singapore, 2003. National University of Singapore.

Digital Library

Google Scholar

[8]

Y. Saijo, K. Suzuki, N. Ito, A. Koike, and Y. Ochiai. Human coded orchestra: A system for extemporary group singing performance. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology, ACE2016, pages 42:1--42:6, New York, NY, USA, 2016. ACM.

Digital Library

Google Scholar

[9]

E. Tamaki, T. Miyaki, and J. Rekimoto. Possessedhand: Techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '11, pages 543--552, New York, NY, USA, 2011. ACM.

Digital Library

Google Scholar

[10]

M. Weing, A. Röhlig, K. Rogers, J. Gugenheimer, F. Schaub, B. Könings, E. Rukzio, and M. Weber. P.i.a.n.o.: Enhancing instrument learning via interactive projected augmentation. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, UbiComp '13 Adjunct, pages 75--78, New York, NY, USA, 2013. ACM.

Digital Library

Google Scholar

Cited By

View all

Vrontos ANitsch VBrandl C(2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
https://doi.org/10.3390/mti8020007
Niijima AKoike YIshikawa HKostakos VKay JHoang T(2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3681942
Faltaous SWilliamson JKoelle MPfeiffer MKeppel JSchneegass S(2024)Understanding User Acceptance of Electrical Muscle Stimulation in Human-Computer InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642585(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642585
Show More Cited By

Index Terms

Stimulated percussions: method to control human for learning music by using electrical muscle stimulation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Building a feedback loop between electrical stimulation and percussion learning
SIGGRAPH '18: ACM SIGGRAPH 2018 Studio

A sense of rhythm is essential for playing instruments. However, many beginners learning how to play musical instruments have difficulty with rhythm. We have proposed "Stimulated Percussions," which is a musical instrument performance system using ...
Stimulated percussions: techniques for controlling human as percussive musical instrument by using electrical muscle stimulation
SA '16: SIGGRAPH ASIA 2016 Posters

We propose Stimulated Percussions, a new method designed to beat out rhythm by controlling human bodies with percussions using electrical muscle stimulation (EMS). Numerous studies in the fields of both science and art have been carried out to expand ...
A New Interactive Music System by Fusion of Melody Morphing and Body Movements
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

The fusion of music-information processing and human physical functions will enable new musical experiences to be created. We developed an interactive music system, which provides users with the experience of conducting a musical performance. This ...

Comments

Information & Contributors

Information

Published In

AH '17: Proceedings of the 8th Augmented Human International Conference

March 2017

264 pages

ISBN:9781450348355

DOI:10.1145/3041164

General Chairs:
Pranav Mistry
Samsung Research America
,
Pattie Maes
MIT Media Lab
,
Program Chairs:
Jean-Marc Seigneur
University of Geneva, Switzerland
,
Suranga Nanayakkara
Singapore University of Technology and Design
,
Joe Paradiso
MIT Media Lab

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

AH '17

Sponsor:

SAMSUNG

AH '17: 8th Augmented Human International Conference

March 16 - 18, 2017

California, Silicon Valley, USA

Acceptance Rates

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
532
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)7

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Vrontos ANitsch VBrandl C(2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
https://doi.org/10.3390/mti8020007
Niijima AKoike YIshikawa HKostakos VKay JHoang T(2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3681942
Faltaous SWilliamson JKoelle MPfeiffer MKeppel JSchneegass S(2024)Understanding User Acceptance of Electrical Muscle Stimulation in Human-Computer InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642585(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642585
Molina-Padilla XMartinez-Fuerte SHernandez-Rios EPeñaloza C(2024)Electromyography Acquisition System Via Conductive Fabric For Wearable Skill Transfer Device Focused On Drum-Oriented Activities2024 IEEE/SICE International Symposium on System Integration (SII)10.1109/SII58957.2024.10417562(190-195)Online publication date: 8-Jan-2024
https://doi.org/10.1109/SII58957.2024.10417562
Fang LPescara EReiter PBeigl M(2023)How Could I Learn Rhythm Better? Investigating Three Learning Signals for Passive Haptic Learning in Different ContextProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3594807(279-283)Online publication date: 5-Jul-2023
https://dl.acm.org/doi/10.1145/3594806.3594807
Niijima A(2023)Learning Effects and Retention of Electrical Muscle Stimulation in Piano PlayingProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611373(104-108)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611373
Niijima AKubo Y(2023)Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle StimulationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581192(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581192
Suzuki YSakamoto DOno T(2023)Gino .Aiki: Mixed Reality-based Physical Motor Skill Training in Aikido2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00112(519-524)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00112
Maruyama AKurihara K(2023)Mutually Imperceptible Skill Adjustment in VR for Making Hyakunin Isshu Karuta InclusiveEntertainment Computing – ICEC 202310.1007/978-981-99-8248-6_18(217-230)Online publication date: 14-Nov-2023
https://doi.org/10.1007/978-981-99-8248-6_18
Cornelio PHaggard PHornbaek KGeorgiou OBergström JSubramanian SObrist M(2022)The sense of agency in emerging technologies for human–computer integration: A reviewFrontiers in Neuroscience10.3389/fnins.2022.94913816Online publication date: 12-Sep-2022
https://doi.org/10.3389/fnins.2022.949138
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Building a feedback loop between electrical stimulation and percussion learning

Stimulated percussions: techniques for controlling human as percussive musical instrument by using electrical muscle stimulation

A New Interactive Music System by Fusion of Melody Morphing and Body Movements

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations