Work in Progress

Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts

Authors:

Rebecca Stewart,

Mathieu BarthetAuthors Info & Claims

TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 80 - 87

https://doi.org/10.1145/3173225.3173272

Published: 18 March 2018 Publication History

Abstract

This paper presents initial steps towards the design of an embedded system for body-centric sonic performance. The proposed prototyping system allows performers to manipulate sounds through gestural interactions captured by textile wearable sensors. The e-textile sensor data control, in real-time, audio synthesis algorithms working with content from Audio Commons, a novel web-based ecosystem for re-purposing crowd-sourced audio. The system enables creative embodied music interactions by combining seamless physical e-textiles with web-based digital audio technologies.

References

[1]

Melvin L. Alexenberg. 2011. The Future of Art in a Postdigital Age: From Hellenistic to Hebraic Consciousness (2nd ed.). Intellect Books, Bristol, UK.

Digital Library

[2]

Luigi Atzori, Antonio Iera, and Giacomo Morabito. 2010. The Internet of Things: A Survey. Computer Networks 54, 15 (2010), 2787--2805.

Digital Library

[3]

Tapomayukh Bhattacharjee, Advait Jain, Sarvagya Vaish, Marc D. Killpack, and Charles C. Kemp. 2013. Tactile Sensing over Articulated Joints with Stretchable Sensors. In Proceedings of the World Haptics Conference (WHC 2013). IEEE, 103--108.

[4]

Baptiste Caramiaux, Frédéric Bevilacqua, and Norbert Schnell. 2011. Sound Selection by Gestures. In Proceedings of the New Interfaces for Musical Expression (NIME '11).

[5]

Lucy E. Dunne, Sarah Brady, Richard Tynan, Kim Lau, Barry Smyth, Dermot Diamond, and Gregory M.P. O'Hare. 2006. Garment-based Body Sensing Using Foam Sensors. In Proceedings of the 7th Australasian User Interface Conference - Volume 50 (AUIC '06). Australian Computer Society, Inc., 165--171.

Digital Library

[6]

Frederic Font, Tim Brookes, George Fazekas, Martin Guerber, Amaury La Burthe, David Plans, Mark D. Plumbley, Meir Shaashua, Wenwu Wang, and Xavier Serra. 2016. Audio Commons: Bringing Creative Commons Audio Content to the Creative Industries. In Proceedings of the 61st AES International Conference: Audio for Games. Audio Engineering Society.

[7]

Frederic Font, Gerard Roma, and Xavier Serra. 2013. Freesound Technical Demo. In Proceedings of the 2013 ACM Multimedia Conference. ACM, 411--412.

Digital Library

[8]

Asif Ghias, Jonathan Logan, David Chamberlin, and Brian C. Smith. 1995. Query by Humming: Musical Information Retrieval in an Audio Database. In Proceedings of the Third ACM International Conference on Multimedia. ACM, 231--236.

Digital Library

[9]

Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003. Technology Probes: Inspiring Design for and with Families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 17--24.

Digital Library

[10]

James McCartney. 2002. Rethinking the Computer Music Language: SuperCollider. Computer Music Journal 26, 4 (2002), 61--68.

Digital Library

[11]

Andrew McPherson and Victor Zappi. 2015. An Environment for Submillisecond-Latency Audio and Sensor Processing on BeagleBone Black. In Audio Engineering Society Convention 138. Audio Engineering Society.

[12]

Cheryl D. Metcalf, SRl Collie, A.W. Cranny, Georgie Hallett, Christopher James, Jo Adams, P.H. Chappell, N.M. White, and J.H. Burridge. 2009. Fabric-based Strain Sensors for Measuring Movement in Wearable Telemonitoring Applications. In Proceedings of the Assisted Living Conference. 1--4.

[13]

Eduardo Reck Miranda and Marcelo M. Wanderley. 2006. New Digital Musical Instruments: Control and Interaction Beyond the Keyboard. Vol. 21. AR Editions, Inc.

[14]

Tim Murray-Browne, Di Mainstone, Nick Bryan-Kinns, and Mark D. Plumbley. 2013. The Serendiptichord: Reflections on the Collaborative Design Process between Artist and Researcher. Leonardo 46, 1 (2013), 86--87.

[15]

Ivan Poupyrev, Rodney Berry, Jun Kurumisawa, Keiko Nakao, Mark Billinghurst, Chris Airola, Hirokazu Kato, Tomoko Yonezawa, and Lewis Baldwin. 2000. Augmented Groove: Collaborative Jamming in Augmented Reality. In Proceedings of the ACM SIGGRAPH 2000 Conference Abstracts and Applications. 77.

[16]

Miller Puckette and others. 1996. Pure Data: Another Integrated Computer Music Environment. In Proceedings of the Second Intercollege Computer Music Concerts. 37--41.

[17]

Gerard Roma and Xavier Serra. 2015. Querying Freesound with a Microphone. In Proceedings of the 1st Web Audio Conference (WAC '15).

[18]

Kate Sicchio, Camille Baker, Tara Baoth Mooney, and Rebecca Stewart. 2016. Hacking the Body 2.0: Flutter/Stutter. In Proceedings of the International Conference on Live Interfaces (ICLI '16). 37--42.

[19]

Sophie Skach, Patrick G.T. Healey, and Rebecca Stewart. 2017. Talking Through Your Arse: Sensing Conversation with Seat Covers. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society (CogSci 2017). 3186--3190.

[20]

Luca Turchet and Mathieu Barthet. 2017. Envisioning Smart Musical Haptic Wearables to Enhance Performers-Creative Communication. In Proceedings of International Symposium on Computer Music Multidisciplinary Research. 538--549.

[21]

Luca Turchet, Carlo Fischione, and Mathieu Barthet. 2017. Towards the Internet of Musical Things. In Proceedings of the Sound and Music Computing Conference (SMC 2017). 13--20.

[22]

Luca Turchet, Andrew McPherson, and Carlo Fischione. 2016. Smart Instruments: Towards an Ecosystem of Interoperable Devices Connecting Performers and Audiences. In Proceedings of the Sound and Music Computing Conference (SMC 2016). 498--505.

[23]

Qi Wang. 2016. Designing Posture Monitoring Garments to Support Rehabilitation. In Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, 709--712.

Digital Library

[24]

Anna Xambó. 2017. In Digital Bodies: Creativity and Technology in the Arts and Humanities, Susan Broadhurst and Sara Price (Eds.). Palgrave Macmillan UK, London, Chapter Embodied music interaction: creative design synergies between music performance and HCI, 207--220.

[25]

Anna Xambó, Carey Jewitt, and Sara Price. 2014. Towards an Integrated Methodological Framework for Understanding Embodiment in HCI. In Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI EA '14). ACM, 1411--1416.

Digital Library

Cited By

Buso AMcquillan HJansen KKarana E(2024)AnimaTo: Designing a Multimorphic Textile Artefact for PerformativityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660738(20-34)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660738
Sparrow LGalwey CLoveridge BGlasser SOsborne MKelly R(2024)Heart and Soul: The Ethics of Biometric Capture in Immersive Artistic PerformanceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642309(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642309
Balaji AMuthu Palaniyappan ODinesh ARavindran SSenthilnayaki B(2024)Air Piano Interaction via Flex Sensors and Computer Vision on Edge Devices2024 3rd International Conference on Artificial Intelligence For Internet of Things (AIIoT)10.1109/AIIoT58432.2024.10574644(1-6)Online publication date: 3-May-2024
https://doi.org/10.1109/AIIoT58432.2024.10574644
Show More Cited By

Index Terms

Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques
      1. Auditory feedback
      2. Gestural input

Recommendations

Jamming with a Smart Mandolin and Freesound-based Accompaniment
FRUCT'23: Proceedings of the 23rd Conference of Open Innovations Association FRUCT

This paper presents an Internet of Musical Things ecosystem involving musicians and audiences interacting with a smart mandolin, smartphones, and the Audio Commons online repository Freesound. The ecosystem has been devised to sup- port performer-...
Cloud-smart Musical Instrument Interactions: Querying a Large Music Collection with a Smart Guitar

Large online music databases under Creative Commons licenses are rarely recorded by well-known artists, therefore conventional metadata-based search is insufficient in their adaptation to instrument players’ needs. The emerging class of smart musical ...
SOURCE: a Freesound Community Music Sampler
AM '21: Proceedings of the 16th International Audio Mostly Conference

SOURCE is an open-source hardware music sampler powered by Freesound’s collection of near 500k Creative Commons sounds contributed by a community of thousands of people around the world. SOURCE provides a hardware interface with Freesound and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

March 2018

763 pages

ISBN:9781450355681

DOI:10.1145/3173225

General Chairs:
Ylva Fernaeus
KTH Royal Institute of Technology, Sweden
,
Donald McMillan
Stockholm University, Sweden
,
Martin Jonsson
Södertörn University, Sweden
,
Program Chairs:
Audrey Girouard
Carleton University, Canada
,
Jakob Tholander
Stockholm University, Sweden

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2018

Check for updates

Author Tags

Qualifiers

Work in progress

Funding Sources

EU H2020
EPSRC and AHRC Centre for Doctoral Training in Media and Arts Technology

Conference

TEI '18

Sponsor:

SIGCHI

TEI '18: Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

March 18 - 21, 2018

Stockholm, Sweden

Acceptance Rates

TEI '18 Paper Acceptance Rate 37 of 130 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
583
Total Downloads

Downloads (Last 12 months)40
Downloads (Last 6 weeks)7

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Buso AMcquillan HJansen KKarana E(2024)AnimaTo: Designing a Multimorphic Textile Artefact for PerformativityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660738(20-34)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660738
Sparrow LGalwey CLoveridge BGlasser SOsborne MKelly R(2024)Heart and Soul: The Ethics of Biometric Capture in Immersive Artistic PerformanceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642309(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642309
Balaji AMuthu Palaniyappan ODinesh ARavindran SSenthilnayaki B(2024)Air Piano Interaction via Flex Sensors and Computer Vision on Edge Devices2024 3rd International Conference on Artificial Intelligence For Internet of Things (AIIoT)10.1109/AIIoT58432.2024.10574644(1-6)Online publication date: 3-May-2024
https://doi.org/10.1109/AIIoT58432.2024.10574644
Visi FBasso TGreinke BWood EGschwendtner PHope CÖstersjö S(2024)Networking concert halls, musicians, and interactive textiles: Interwoven Sound SpacesDigital Creativity10.1080/14626268.2024.231190635:1(52-73)Online publication date: 20-Feb-2024
https://doi.org/10.1080/14626268.2024.2311906
Turchet LLagrange MRottondi CFazekas GPeters NØstergaard JFont FBäckström TFischione C(2023)The Internet of Sounds: Convergent Trends, Insights, and Future DirectionsIEEE Internet of Things Journal10.1109/JIOT.2023.325360210:13(11264-11292)Online publication date: 1-Jul-2023
https://doi.org/10.1109/JIOT.2023.3253602
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458
Elvitigala DBoldu RNanayakkara SMatthies D(2022)TickleFoot: Design, Development and Evaluation of a Novel Foot-Tickling Mechanism That Can Evoke LaughterACM Transactions on Computer-Human Interaction10.1145/349049629:3(1-23)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3490496
Tajima DNishida JLopes PKasahara S(2022)Whose Touch is This?: Understanding the Agency Trade-Off Between User-Driven Touch vs. Computer-Driven TouchACM Transactions on Computer-Human Interaction10.1145/348960829:3(1-27)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3489608
Neha BPanda SSahu PSahoo KGandomi A(2022)A Systematic Review on Osmotic ComputingACM Transactions on Internet of Things10.1145/34882473:2(1-30)Online publication date: 15-Feb-2022
https://dl.acm.org/doi/10.1145/3488247
Rüller SAal KTolmie PHartmann ARohde MWulf V(2022)Speculative Design as a Collaborative Practice: Ameliorating the Consequences of Illiteracy through Digital TouchACM Transactions on Computer-Human Interaction10.1145/348791729:3(1-58)Online publication date: 14-Jan-2022
https://dl.acm.org/doi/10.1145/3487917
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents