Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3411763.3451556acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
demonstration

EMPiano: Electromyographic Pitch Control on the Piano Keyboard

Published: 08 May 2021 Publication History

Abstract

The piano keyboard offers a significant range and polyphony for well-trained pianists. Yet, apart from dynamics, the piano is incapable of translating expressive movements such as vibrato onto the played note. Adding sound effects requires additional modalities. A pitch wheel can be found on the side of most electric pianos. To add a vibrato or pitch bend, the pianist needs to actively operate the pitch wheel with their hand, which requires cognitive effort and may disrupt play. In this work, we present EMPiano, a system that allows pianists to incorporate a soft pitch vibrato into their play seamlessly. Vibrato can be triggered through muscle activity and is recognized via electromyography. This allows EMPiano to integrate into piano play. Our system offers new interaction opportunities with the piano to increase the player’s potential for expressive play. In this paper, we contribute the open-source implementation and the workflow behind EMPiano.

Supplemental Material

MP4 File
Supplemental video
Transcript for: Supplemental video

References

[1]
Baptiste Caramiaux, Marco Donnarumma, and Atau Tanaka. 2015. Understanding Gesture Expressivity Through Muscle Sensing. ACM Trans. Comput.-Hum. Interact. 21, 6 (Jan. 2015), 31:1–31:26. https://doi.org/10.1145/2687922
[2]
Marco Donnarumma. 2011. XTH SENSE: a study of muscle sounds for an experimental paradigm of musical performance. In Proceedings of the 2011 International Computer Music Conference (ICMC). Michigan Publishing, Michigan, US, 6 pages.
[3]
Marco Donnarumma, Baptiste Caramiaux, and Atau Tanaka. 2013. Muscular Interactions Combining EMG and MMG sensing for musical practice. In Proceedings of the Conference on New Interfaces for Musical Expression(NIME ’13). nime.org, online, 128–131.
[4]
Aristotelis Hadjakos and Simon Waloschek. 2014. ViP: Controlling the Sound of a Piano with Wrist-Worn Inertial Sensors. In Proceedings of the Conference on New Interfaces for Musical Expression(NIME ’14). nime.org, online, 2 pages.
[5]
Jakob Karolus, Annika Kilian, Thomas Kosch, Albrecht Schmidt, and Paweł W. Woźniak. 2020. Hit the Thumb Jack! Using Electromyography to Augment the Piano Keyboard. In Proceedings of the 2020 ACM on Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 429–440. https://doi.org/10.1145/3357236.3395500
[6]
Jakob Karolus, Francisco Kiss, Caroline Eckerth, Nicolas Viot, Felix Bachmann, Albrecht Schmidt, and Paweł W. Woźniak. 2021. EMBody: A Data-Centric Toolkit for EMG-Based Interface Prototyping and Experimentation. Proc. ACM Hum.-Comput. Interact. TBD, EICS (2021), 29 pages.
[7]
Jakob Karolus, Hendrik Schuff, Thomas Kosch, Paweł W. Wozniak, and Albrecht Schmidt. 2018. EMGuitar: Assisting Guitar Playing with Electromyography. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). ACM, New York, NY, USA, 651–655. https://doi.org/10.1145/3196709.3196803
[8]
Andrew Mcpherson and Youngmoo Kim. 2010. Augmenting the acoustic piano with electromagnetic string actuation and continuous key position sensing. In In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME). nime.org, online, 217–222.
[9]
Andrew P. McPherson, Adrian Gierakowski, and Adam M. Stark. 2013. The Space Between the Notes: Adding Expressive Pitch Control to the Piano Keyboard. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). ACM, New York, NY, USA, 2195–2204. https://doi.org/10.1145/2470654.2481302
[10]
Van Alejandro Zandt-Escobar, Baptiste Caramiaux, and Atau Tanaka. 2014. PiaF: A Tool for Augmented Piano Performance Using Gesture Variation Following. In Proceedings of the International Conference on New Interfaces for Musical Expression(NIME ’14). nime.org, online, 4.

Cited By

View all
  • (2024)Processing piano audio: research on an automatic transcription model for sound signalsJournal of Measurements in Engineering10.21595/jme.2024.24345Online publication date: 15-Dec-2024
  • (2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
  • (2024)Improving Electromyographic Muscle Response Times through Visual and Tactile Prior Stimulation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642091(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems
May 2021
2965 pages
ISBN:9781450380959
DOI:10.1145/3411763
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Check for updates

Author Tags

  1. Electromyography
  2. expressive piano play
  3. piano interaction.
  4. seamless integration

Qualifiers

  • Demonstration
  • Research
  • Refereed limited

Funding Sources

Conference

CHI '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025
ACM CHI Conference on Human Factors in Computing Systems
April 26 - May 1, 2025
Yokohama , Japan

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Processing piano audio: research on an automatic transcription model for sound signalsJournal of Measurements in Engineering10.21595/jme.2024.24345Online publication date: 15-Dec-2024
  • (2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
  • (2024)Improving Electromyographic Muscle Response Times through Visual and Tactile Prior Stimulation in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642091(1-17)Online publication date: 11-May-2024
  • (2023)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582731(379-383)Online publication date: 12-Mar-2023
  • (2023)The Body as Sound: Unpacking Vocal Embodiment through Auditory BiofeedbackProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572738(1-15)Online publication date: 26-Feb-2023
  • (2022)A Survey of Augmented Piano Prototypes: Has Augmentation Improved Learning Experiences?Proceedings of the ACM on Human-Computer Interaction10.1145/35677196:ISS(226-253)Online publication date: 14-Nov-2022
  • (2022)Singing Knit: Soft Knit Biosensing for Augmenting Vocal PerformancesProceedings of the Augmented Humans International Conference 202210.1145/3519391.3519412(170-183)Online publication date: 13-Mar-2022
  • (2022)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503743(1-4)Online publication date: 27-Apr-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media