research-article

Open access

Singing Knit: Soft Knit Biosensing for Augmenting Vocal Performances

Authors:

Courtney N. Reed,

Paul Strohmeier,

Andrew P. McPhersonAuthors Info & Claims

AHs '22: Proceedings of the Augmented Humans International Conference 2022

Pages 170 - 183

https://doi.org/10.1145/3519391.3519412

Published: 18 April 2022 Publication History

All formats PDF

Abstract

This paper discusses the design of the Singing Knit, a wearable knit collar for measuring a singer’s vocal interactions through surface electromyography. We improve the ease and comfort of multi-electrode bio-sensing systems by adapting knit e-textile methods. The goal of the design was to preserve the capabilities of rigid electrode sensing while addressing its shortcomings, focusing on comfort and reliability during extended wear, practicality and convenience for performance settings, and aesthetic value. We use conductive, silver-plated nylon jersey fabric electrodes in a full rib knit accessory for sensing laryngeal muscular activation. We discuss the iterative design and the material decision-making process as a method for building integrated soft-sensing wearable systems for similar settings. Additionally, we discuss how the design choices through the construction process reflect its use in a musical performance context.

References

[1]

Gizem Acar, Ozberk Ozturk, Ata Jedari Golparvar, Tamador Alkhidir Elboshra, Karl Böhringer, and Murat Kaya Yapici. 2019. Wearable and flexible textile electrodes for biopotential signal monitoring: A review. Electronics 8, 5 (2019), 479. https://doi.org/10.3390/electronics8050479

[2]

Ozgur Atalay, Asli Tuncay, Muhammad D. Husain, and William R. Kennon. 2017. Comparative study of the weft-knitted strain sensors. Journal of Industrial Textiles 46, 5 (2017), 1212–1240. https://doi.org/10.1177/1528083715619948

[3]

Vincent Becker, Pietro Oldrat, Liliana Barrios, and Gabor Sörös. 2018. TouchSense: Classifying and Measuring the Force of Finger Touches with an Electromyography Armband. In Proceedings of the Augmented Human International Conference (AH 18). ACM, New York, NY, USA. https://doi.org/10.1145/3174910.3174947

Digital Library

[4]

Enrico Costanza, Samuel A. Inverso, and Rebecca Allen. 2005. Toward subtle intimate interfaces for mobile devices using an EMG controller. In Proceedings of CHI’05: SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 481–489. https://doi.org/10.1145/1054972.1055039

Digital Library

[5]

Kelsey Cotton, Ozgun Kilic Afsar, Yoav Luft, Priyanka Syal, and Fehmi Ben Abdesslem. 2021. SymbioSinging: Robotically Transposing Singing Experience across Singing and Non-Singing Bodies. In Creativity and Cognition (Virtual Event, Italy) (C&C ’21). Association for Computing Machinery, New York, NY, USA, Article 52, 5 pages. https://doi.org/10.1145/3450741.3466718

Digital Library

[6]

Kelsey Cotton, Pedro Sanches, Vasiliki Tsaknaki, and Pavel Karpashevich. 2021. The Body Electric: A NIME designed through and with the somatic experience of singing. Proc. New Interfaces for Musical Expression (NIME). https://doi.org/10.21428/92fbeb44.ec9f8fdd https://nime.pubpub.org/pub/ntm5kbux.

[7]

Marco Donnarumma, Baptiste Caramiaux, and Atau Tanaka. 2013. Combining EMG and MMG sensing for musical practice. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2018), Graduate School of Culture Technology, KAIST, Daejeon, Korea. 128–131. https://doi.org/10.5281/zenodo.1178504

[8]

Maurin Donneaud, Cedric Honnet, and Paul Strohmeier. 2017. Designing a multi-touch etextile for music performances. In NIME. 7–12.

[9]

Tim Duente, Max Pfeiffer, and Michael Rohs. 2017. Zap++ a 20-channel electrical muscle stimulation system for fine-grained wearable force feedback. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–13.

Digital Library

[10]

Cagri Erdem and Alexander Refsum Jensenius. 2020. RAW: Exploring Control Structures for Muscle-based Interaction in Collective Improvisation. In Proceedings of the International Conference on New Interfaces for Musical Expression, Birmingham City University, Birmingham, UK. 477–482. https://doi.org/10.5281/zenodo.4813485

[11]

Adrian Freed. 2008. Application of new Fiber and Malleable Materials for Agile Development of Augmented Instruments and Controllers. In NIME, Vol. 8. 107–112.

[12]

Limor Fried. 2012. Lady Ada. https://www.ladyada.net/ Accessed: 2022-01-14.

[13]

Berit Greinke, Giorgia Petri, Pauline Vierne, Paul Biessmann, Alexandra Börner, Kaspar Schleiser, Emmanuel Baccelli, Claas Krause, Christopher Verworner, and Felix Biessmann. 2021. An Interactive Garment for Orchestra Conducting: IoT-enabled Textile & Machine Learning to Direct Musical Performance. In Proceedings of the Fifteenth International Conference on Tangible Embedded, and Embodied Interaction (TEI 15). 1–6. https://doi.org/10.1145/3430524.3442451

Digital Library

[14]

Berit Greinke, Emma Wood, Sophie Skach, Arantza Vilas, and Pauline Vierne. 2021. Folded Electronic Textiles: Weaving, Knitting, Pleating and Coating Three-dimensional Sensor Structures. Leonardo (Dec. 2021), 1–9. https://doi.org/10.1162/leon_a_02183

[15]

William J. Hardcastle. 1976. Physiology of Speech Production: An Introduction for Speech Scientists. Academic Press Inc., London. ISBN.

[16]

Kate Hartman, Boris Kourtoukov, and Erin Lewis. 2018. Kinetic Body Extensions for Social Interactions. In Proceedings of the International Conference on Tangible Embedded, and Embodied Interaction (TEI 18).ACM, New York, NY, USA, 736–739. https://doi.org/10.1145/3173225.3173333

Digital Library

[17]

Kate Hartman, Jackson McConnell, Boris Kourtoukov, Hillary Predko, and Izzie Colpitts-Campbell. 2015. Monarch: Self-Expression Through Wearable Kinetic Textiles. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction(Stanford, California, USA) (TEI ’15). Association for Computing Machinery, New York, NY, USA, 413–414. https://doi.org/10.1145/2677199.2690875

Digital Library

[18]

Mariam Hassib, Max Pfeiffer, Stefan Schneegass, Michael Rohs, and Florian Alt. 2017. Emotion Actuator: Embodied Emotional Feedback through Electroencephalography and Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6133–6146. https://doi.org/10.1145/3025453.3025953

Digital Library

[19]

Megan Hofmann, Lea Albaugh, Ticha Sethapakadi, Jessica Hodgins, Scott E. Hudson, James McCann, and Jennifer Mankoff. 2019. KnitPicking Textures: Programming and Modifying Complex Knitted Textures for Machine and Hand Knitting. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 5–16. https://doi.org/10.1145/3332165.3347886

Digital Library

[20]

Megan Hofmann, Jennifer Mankoff, and Scott E. Hudson. 2020. KnitGIST: A Programming Synthesis Toolkit for Generating Functional Machine-Knitting Textures. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 1234–1247. https://doi.org/10.1145/3379337.3415590

Digital Library

[21]

Cedric Honnet, Hannah Perner-Wilson, Marc Teyssier, Bruno Fruchard, Jürgen Steimle, Ana C. Baptista, and Paul Strohmeier. 2020. PolySense: Augmenting Textiles with Electrical Functionality Using In-Situ Polymerization. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376841

Digital Library

[22]

Ching-Tang Huang, Chien-Fa Tang, Ming-Chen Lee, and Shuo-Hung Chang. 2008. Parametric design of yarn-based piezoresistive sensors for smart textiles. Sensors and Actuators A: Physical 148, 1 (2008), 10–15. https://doi.org/10.1016/j.sna.2008.06.029

[23]

Kunpeng Huang, Md. Tahmidul Islam Molla, Kat Roberts, Pin-Sung Ku, Aditi Galada, and Cindy Hsin-Liu Kao. 2021. Delocalizing Strain in Interconnected Joints of On-Skin Interfaces. In 2021 International Symposium on Wearable Computers (Virtual, USA) (ISWC ’21). Association for Computing Machinery, New York, NY, USA, 91–96. https://doi.org/10.1145/3460421.3478812

Digital Library

[24]

Kunpeng Huang, Ruojia Sun, Ximeng Zhang, Md. Tahmidul Islam Molla, Margaret Dunne, Francois Guimbretiere, and Cindy Hsin-Liu Kao. 2021. WovenProbe: Probing Possibilities for Weaving Fully-Integrated On-Skin Systems Deployable in the Field. In Designing Interactive Systems Conference 2021(Virtual Event, USA) (DIS ’21). Association for Computing Machinery, New York, NY, USA, 1143–1158. https://doi.org/10.1145/3461778.3462105

Digital Library

[25]

Naoto Igarashi, Kenji Suzuki, Hiroaki Kawamoto, and Yoshiyuki Sankai. 2010. bioLights: Light emitting wear for visualizing lower-limb muscle activity. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology. Buenos Aires, Argentina. 6393–6396. https://doi.org/10.1109/IEMBS.2010.5627306

[26]

Alexander Refsum Jensenius, Victor Gonzales Sanchez, Agata Zelechowska, and Kari Anne Vadstensvik Bjerkestrand. 2017. Exploring the Myo Controller for Sonic Microinteraction. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2017), Aalborg University, Copenhagen, Denmark. 442–445. https://doi.org/10.5281/zenodo.1176308

[27]

Gerald Jonas. 1967. Aglow (An Interview with Diana Dew). The New Yorker (January 28, 1967). https://www.newyorker.com/magazine/1967/01/28/aglow-2

[28]

Benjamin Jones, Yuxuan Mei, Haisen Zhao, Taylor Gotfrid, Jennifer Mankoff, and Adriana Schulz. 2021. Computational Design of Knit Templates. ACM Trans. Graph. 41, 2, Article 16 (dec 2021), 16 pages. https://doi.org/10.1145/3488006

Digital Library

[29]

Arnav Kapur, Shreyas Kapur, and Pattie Maes. 2018. AlterEgo: A Personalized Wearable Silent Speech Interface. In Proceedings of the International Conference on Human Information Interaction & Retrieval, Mar 7-11, 2018, Tokyo, Japan. 43–53. https://doi.org/10.1145/3172944.3172977

Digital Library

[30]

Jakob Karolus, Felix Bachmann, Thomas Kosch, Albrecht Schmidt, and Paweł W. Woźniak. 2021. Facilitating Bodily Insights Using Electromyography-Based Biofeedback during Physical Activity. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3447526.3472027

Digital Library

[31]

Jakob Karolus, Annika Kilian, Thomas Kosch, Albrecht Schmidt, and Paweł W. Wozniak. 2020. Hit the Thumb Jack! Using Electromyography to Augment the Piano Keyboard. In Proceedings of the ACM Designing Interactive Systems Conference (DIS ’20). https://doi.org/10.1145/3357236.3395500

Digital Library

[32]

Jakob Karolus, Francisco Kiss, Caroline Eckerth, Nicolas Viot, Felix Bachmann, Albrecht Schmidt, and Pawel W. Wozniak. 2021. EMBody: A Data-Centric Toolkit for EMG-Based Interface Prototyping and Experimentation. Proc. ACM Hum.-Comput. Interact. 5, EICS, Article 195 (may 2021), 29 pages. https://doi.org/10.1145/3457142

Digital Library

[33]

Jakob Karolus, Hendrik Schuff, Thomas Kosch, Paweł W. Wozniak, and Albrecht Schmidt. 2018. EMGuitar: Assisting Guitar Playing with Electromyography. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 651–655. https://doi.org/10.1145/3196709.3196803

Digital Library

[34]

Alexandre Kaspar, Liane Makatura, and Wojciech Matusik. 2019. Knitting Skeletons: A Computer-Aided Design Tool for Shaping and Patterning of Knitted Garments. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 53–65. https://doi.org/10.1145/3332165.3347879

Digital Library

[35]

Zeeshan O. Khokhar, Zhen G. Xiao, and Carlo Menon. 2010. Surface EMG pattern recognition for real-time control of a wrist exoskeleton. BioMedical Engineering OnLine 9, 41 (2010), 2010. 10.1186/1475-925X-9-41

[36]

Annika Kilian, Jakob Karolus, Thomas Kosch, Albrecht Schmidt, and Paweł W. Paweł. 2021. EMPiano: Electromyographic Pitch Control on the Piano Keyboard. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411763.3451556

Digital Library

[37]

Su Jeong Kim, So Yeon Jeong, and Tae Lim Yoon. 2018. The Effect of Visual Feedback of Head Angles With Using a Mobile Posture-Aware System on Craniocervical Angle and Neck and Shoulder Muscles Fatigue During Watching the Smartphone. The Journal of Korean Physical Therapy 30 (2018). Issue 2. https://doi.org/10.18857/jkpt.2018.30.2.47

[38]

Jarrod Knibbe, Rachel Freire, Marion Koelle, and Paul Strohmeier. 2021. Skill-Sleeves: Designing Electrode Garments for Wearability. In Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 21), February 14-17, 2021, Salzburg, Austria. ACM, New York, NY, USA. 2021, pp. 1–16. ACM, New York, NY, USA, 1–16. https://doi.org/10.1145/3430524.3440652

Digital Library

[39]

Jarrod Knibbe, Paul Strohmeier, Sebastian Boring, and Kasper Hornbæk. 2017. Automatic Calibration of High Density Electric Muscle Stimulation. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 68 (sep 2017), 17 pages. https://doi.org/10.1145/3130933

Digital Library

[40]

Marion Koelle, Thomas Olsson, Robb Mitchell, Julie Williamson, and Susanne Boll. 2019. What is (Un)Acceptable? Thoughts on Social Acceptability in HCI Research. Interactions 26, 3 (apr 2019), 36–40. https://doi.org/10.1145/3319073

Digital Library

[41]

Marion Koelle, Torben Wallbaum, Wilko Heuten, and Susanne Boll. 2019. Evaluating a Wearable Camera’s Social Acceptability In-the-Wild. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312837

Digital Library

[42]

Y. Koike, K. Nakakoji, and Y. Yamamoto. 2006. Tele-kinesthetic interaction: using hand muscles to interact with a tangible 3D object. In Proc. SIGGRAPH ’06: ACM SIGGRAPH 2006 Emerging Technologies. ACM, New York, NY, USA, 33–es. https://doi.org/10.1145/1179133.1179167

Digital Library

[43]

LessEMF. 2020. Shielding and Conductive Fabrics. https://www.lessemf.com/fabric.html Accessed: 2022-01-14.

[44]

An Liang, Rebecca Stewart, Rachel Freire, and Nick Bryan-Kinns. 2021. Knit Stretch Sensor Placement for Body Movement Sensing. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3430524.3440629

Digital Library

[45]

Chin Guan Lim, Chin Yi Tsai, and Mike Y. Chen. 2020. MuscleSense: Exploring Weight Sensing using Wearable Surface Electromyography (sEMG). In Proc. Tangible Embedded, and Embodied Interaction (TEI 20), February, 2020, Sydney, NSW, Australia.ACM, New York, NY, USA, 9–12. https://doi.org/10.1145/3374920.3374943

Digital Library

[46]

Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 939–948. https://doi.org/10.1145/2702123.2702461

Digital Library

[47]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1471–1482. https://doi.org/10.1145/3025453.3025600

Digital Library

[48]

Yiyue Luo, Kui Wu, Tomás Palacios, and Wojciech Matusik. 2021. KnitUI: Fabricating Interactive and Sensing Textiles with Machine Knitting. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445780

Digital Library

[49]

Andrea Martelloni and Courtney N. Reed. 2021. Music From the Augmented Instruments Lab: 23 November 2021. https://www.youtube.com/watch?v=axn_wQM_I_c&t=3426s Accessed: 2022-01-14.

[50]

Charles P. Martin, Alexander Refsum Jensenius, and Jim Torresen. 2018. Composing an Ensemble Standstill Work for Myo and Bela. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2018), Virginia Tech, Blacksburg, VA, USA. 196–197. https://doi.org/10.5281/zenodo.1302543

[51]

HITEK Electronic Materials. 2021. Technical Textiles. https://www.hitek-ltd.co.uk/technical-textiles Accessed: 2022-01-14.

[52]

Denisa Qori McDonald, Richard Vallett, Erin Solovey, Geneviève Dion, and Ali Shokoufandeh. 2020. Knitted Sensors: Designs and Novel Approaches for Real-Time, Real-World Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 4, Article 145 (dec 2020), 25 pages. https://doi.org/10.1145/3432201

Digital Library

[53]

Jess McIntosh, Charlie McNeill, Mike Fraser, Frederic Kerber, Markus Löchtefeld, and Antonio Krüger. 2016. EMPress: Practical Hand Gesture Classification with Wrist-Mounted EMG and Pressure Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2332–2342. https://doi.org/10.1145/2858036.2858093

Digital Library

[54]

Jun Nishida, Kanako Takahashi, and Kenji Suzuki. 2015. A Wearable Stimulation Device for Sharing and Augmenting Kinesthetic Feedback. In Proceedings of the 6th Augmented Human International Conference (Singapore, Singapore) (AH ’15). Association for Computing Machinery, New York, NY, USA, 211–212. https://doi.org/10.1145/2735711.2735775

Digital Library

[55]

Aditya Shekhar Nittala, Andreas Karrenbauer, Arshad Khan, Tobias Kraus, and Jürgen Steimle. 2021. Computational design and optimization of electro-physiological sensors. Nature Communications 12, 1 (Nov. 2021). https://doi.org/10.1038/s41467-021-26442-1

[56]

Kristian Nymoen, Mari Romarheim Haugen, and Alexander Refsum Jensenius. 2015. MuMYO — Evaluating and Exploring the MYO Armband for Musical Interaction. In Proc. New Interfaces for Musical Expression (NIME 2015), Louisiana State University, Baton Rouge, LA, USA. 215–218. https://doi.org/10.5281/zenodo.1179150

[57]

Maggie Orth. 2009. Maggie Orth. http://www.maggieorth.com/art_Instruments.html Accessed: 2022-01-14.

[58]

Maggie Orth, J. R. Smith, E. Rehmi Post, J. A. Strickon, and Emily B. Cooper. 1998. Musical Jacket. In ACM SIGGRAPH 98 Electronic Art and Animation Catalog (Orlando, Florida, USA) (SIGGRAPH ’98). Association for Computing Machinery, New York, NY, USA, 38. https://doi.org/10.1145/281388.281456

Digital Library

[59]

Hannah Perner-Wilson, Leah Buechley, and Mika Satomi. 2010. Handcrafting Textile Interfaces from a Kit-of-No-Parts. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction(Funchal, Portugal) (TEI ’11). Association for Computing Machinery, New York, NY, USA, 61–68. https://doi.org/10.1145/1935701.1935715

Digital Library

[60]

Andreas Pointner, Thomas Preindl, Sara Mlakar, Roland Aigner, and Michael Haller. 2020. Knitted RESi: A Highly Flexible, Force-Sensitive Knitted Textile Based on Resistive Yarns. In ACM SIGGRAPH 2020 Emerging Technologies (Virtual Event, USA) (SIGGRAPH ’20). Association for Computing Machinery, New York, NY, USA, Article 21, 2 pages. https://doi.org/10.1145/3388534.3407292

Digital Library

[61]

Irene Posch. 2017. Crafting Tools. Interactions 24, 2 (feb 2017), 78–81. https://doi.org/10.1145/3038227

Digital Library

[62]

Irene Posch. 2017. Crafting Tools for Textile Electronic Making. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 409–412. https://doi.org/10.1145/3027063.3052972

Digital Library

[63]

Irene Posch. 2019. Tooling Textile Electronics. http://www.ireneposch.net/tooling/ Accessed: 2022-01-14.

[64]

E. Rehmi Post and Maggie Orth. 1997. Smart fabric, or ”wearable clothing”. In Digest of Papers. First International Symposium on Wearable Computers. 167–168. https://doi.org/10.1109/ISWC.1997.629937

[65]

Thomas Preindl, Cedric Honnet, Andreas Pointner, Roland Aigner, Joseph A. Paradiso, and Michael Haller. 2020. Sonoflex: Embroidered Speakers Without Permanent Magnets. Association for Computing Machinery, New York, NY, USA, 675–685. https://doi.org/10.1145/3379337.3415888

Digital Library

[66]

Courtney N. Reed and Andrew P. McPherson. 2020. Surface Electromyography for Direct Vocal Control. In Proc. New Interfaces for Musical Expression (NIME 2020), Royal Birmingham Conservatoire, Birmingham, UK. 447–482. https://doi.org/10.5281/zenodo.4813475

[67]

Courtney N. Reed and Andrew P. McPherson. 2021. Surface Electromyography for Sensing Performance Intention and Musical Imagery in Vocalists. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI’15). Article 22, 11 pages. https://doi.org/10.1145/3430524.3440641

Digital Library

[68]

Mika Satomi and Hannah Perner-Wilson. 2007. HOW TO GET WHAT YOU WANT. https://www.kobakant.at/DIY/?p=379 Accessed: 2022-01-14.

[69]

Ali Shafti, Roger B. Ribas Manero, Amanda M. Borg, Kaspar Althoefer, and Matthew J. Howard. 2017. Embroidered Electromyography: A Systematic Design Guide. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 9(2017), 1472–1480. https://doi.org/10.1109/TNSRE.2016.2633506

[70]

Sophie Skach, Rebecca Stewart, and Patrick G. T. Healey. 2019. Smarty Pants: Exploring Textile Pressure Sensors in Trousers for Posture and Behaviour Classification. Proceedings 32, 1 (Dec. 2019), 19. https://doi.org/10.3390/proceedings2019032019

[71]

Katta Spiel. 2021. The Bodies of TEI – Investigating Norms and Assumptions in the Design of Embodied Interaction. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3430524.3440651

Digital Library

[72]

Stelarc. 2020. Contemporary Chimeras – Creepy, Uncanny, and Contestable Bodies. Association for Computing Machinery, New York, NY, USA.

[73]

Becky Stern. 2009. Becky Stern. https://beckystern.com/ Accessed: 2022-01-14.

[74]

Rebecca Stewart. 2019. Cords and Chords: Exploring the Role of E-Textiles in Computational Audio. Front. ICT 6(2019), 2.

[75]

Rebecca Stewart. 2020. embelashed. http://embelashed.org/ Accessed: 2022-01-14.

[76]

Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2010. PossessedHand: A Hand Gesture Manipulation System Using Electrical Stimuli. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 2, 5 pages. https://doi.org/10.1145/1785455.1785457

Digital Library

[77]

Atau Tanaka. 2015. Intention, Effort, and Restraint: The EMG in Musical Performance. Transactions in Live Interfaces 43, 8 (2015), 298–299. https://doi.org/10.1162/LEON_a_01018

[78]

Atau Tanaka and R. Benjamin Knapp. 2017. Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing. In A NIME Reader: Fifteen Years of New Interfaces for Musical Expression. Springer.

[79]

Atau Tanaka and Miguel Ortiz. 2017. Gestural Musical Performance with Physiological Sensors, Focusing on the Electromyogram. The Routledge Companion to Embodied Music Interaction. In The Routledge Companion to Embodied Music Interaction, M. Lesaffre, P-J. Maes, and M. Leman (Eds.). Routledge: Oxon, 422–430.

[80]

Adán L. Benito Temprano and Rebecca Stewart. 2019. Bela E-textile Capelet. https://oshpark.com/shared_projects/y0oSowUt Accessed: 2022-01-14.

[81]

Marian Theiss, Philipp M. Scholl, and Kristof Van Laerhoven. 2016. Predicting Grasps with a Wearable Inertial and EMG Sensing Unit for Low-Power Detection of In-Hand Objects. In Proc. Augmented Human International (AH 16).ACM, New York, NY, USA, 1–8. https://doi.org/10.1145/2875194.2875207

Digital Library

[82]

Vasiliki Tsaknaki, Kelsey Cotton, Pavel Karpashevich, and Pedro Sanches. 2021. “Feeling the Sensor Feeling You”: A Soma Design Exploration on Sensing Non-Habitual Breathing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 266, 16 pages. https://doi.org/10.1145/3411764.3445628

Digital Library

[83]

Yasunori Tsubouchi and Kenji Suzuki. 2010. BioTones: A wearable device for EMG auditory biofeedback. In Proc. International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina. 6543–6546. https://doi.org/10.1109/IEMBS. 2010.5627097

[84]

Jinfeng Wang, Hairu Long, Saeid Soltanian, Peyman Servati, and Frank Ko. 2014. Electromechanical properties of knitted wearable sensors: part 1 – theory. Textile Research Journal 84, 1 (2014), 3–15. https://doi.org/10.1177/0040517513487789

[85]

Ravindra Wijesiriwardana, Tilak Dias, and S. Mukhopadhyay. 2003. Resistive fibre-meshed transducers. In Proceedings of the Seventh IEEE International Symposium on Wearable Computers (2003). 200–209. https://doi.org/10.1109/ISWC.2003.1241412

[86]

Pamela Z. 2020. Pamela Z. http://pamelaz.com/ Accessed: 2022-01-14.

Cited By

Reed CMorrison LMcPherson AFierro DTanaka A(2024)Sonic Entanglements with Electromyography: Between Bodies, Signals, and RepresentationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661572(2691-2707)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661572
Freire RMartinez-Missir VReed CStrohmeier PCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)RaveNET: Connecting People and Exploring Liminal Space through Wearable Networks in Music PerformanceProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3635270(1-8)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3635270
Chen KWu ESaito DPeng YLiao CKato AKoike HKunze K(2024)Novel Sensing Methods for Vocal Technique Analysis: Evaluation on Electromyography and Ultrasonography2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00034(121-125)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00034
Show More Cited By

Index Terms

Singing Knit: Soft Knit Biosensing for Augmenting Vocal Performances

Index terms have been assigned to the content through auto-classification.

Recommendations

The Quantification of Emotional Expressions and Perceptions of Vocal Vibrato in Basic Emotion: Commercial Operatic Singing Recordings
MMAsia '24: Proceedings of the 6th ACM International Conference on Multimedia in Asia
Opera, a dramatic art form, heavily depends on the emotive capacity of the voice to express character’s emotions. While vibrato is a characteristic feature of operatic singing, indicative of vocal skill, its specific role in emotional expression and ...
VOCAL: Vowel and Consonant Layering for Expressive Animator-Centric Singing Animation
SA '22: SIGGRAPH Asia 2022 Conference Papers

Singing and speaking are two fundamental forms of human communication. From a modeling perspective however, speaking can be seen as a subset of singing. We present VOCAL, a system that automatically generates expressive, animator-centric lower face ...
Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing
Automatic lyric transcription (ALT) refers to transcribing singing voices into lyrics, while automatic music transcription (AMT) refers to transcribing singing voices into note events, i.e., musical MIDI notes. Despite these two tasks having significant ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AHs '22: Proceedings of the Augmented Humans International Conference 2022

March 2022

350 pages

ISBN:9781450396325

DOI:10.1145/3519391

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2022

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

EPSRC

Conference

AHs 2022

AHs 2022: Augmented Humans 2022

March 13 - 15, 2022

Kashiwa, Chiba, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
1,019
Total Downloads

Downloads (Last 12 months)374
Downloads (Last 6 weeks)63

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Reed CMorrison LMcPherson AFierro DTanaka A(2024)Sonic Entanglements with Electromyography: Between Bodies, Signals, and RepresentationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661572(2691-2707)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661572
Freire RMartinez-Missir VReed CStrohmeier PCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)RaveNET: Connecting People and Exploring Liminal Space through Wearable Networks in Music PerformanceProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3635270(1-8)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3635270
Chen KWu ESaito DPeng YLiao CKato AKoike HKunze K(2024)Novel Sensing Methods for Vocal Technique Analysis: Evaluation on Electromyography and Ultrasonography2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00034(121-125)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00034
Reed CMcPherson A(2023)The Body as Sound: Unpacking Vocal Embodiment through Auditory BiofeedbackProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572738(1-15)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3572738
Haynes AReed CNordmoen CSkach S(2023)Being Meaningful: Weaving Soma-Reflective Technological Mediations into the Fabric of Daily LifeProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3571844(1-5)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3571844
Zheng JMcpherson ABryan-Kinns N(2023)When Materials Meet Sound: Discovering the Meaning of Deformable Materials in Musical InteractionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596010(312-325)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596010
Bryan-Kinns NReed C(2023)A Guide to Evaluating the Experience of Media and Arts TechnologyCreating Digitally10.1007/978-3-031-31360-8_10(267-300)Online publication date: 3-Dec-2023
https://doi.org/10.1007/978-3-031-31360-8_10
Takeuchi MUeha R(2022)Review of the Speech-aid Device発声支援デバイスの開発と今後の展望Koutou (THE LARYNX JAPAN)10.5426/larynx.34.5834:2(58-64)Online publication date: 1-Dec-2022
https://doi.org/10.5426/larynx.34.58

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents