Work in Progress

RaveNET: Connecting People and Exploring Liminal Space through Wearable Networks in Music Performance

Authors:

Valentin Martinez-Missir,

Courtney N. Reed,

Paul StrohmeierAuthors Info & Claims

TEI '24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 89, Pages 1 - 8

https://doi.org/10.1145/3623509.3635270

Published: 11 February 2024 Publication History

Abstract

RaveNET connects people to music, enabling musicians to modulate sound using signals produced by their own bodies or the bodies of others. We present three wearable prototype nodes in an inaugural RaveNET performance: Bones, an anti-corset, uses capacitive sensing to detect stretch as the singer breathes. Tendons, a half-glove, measures galvanic skin response, pulse, and movement of the bass player’s hands. Veins, a cap with electrodes for surface electromyography, captures the facial expressions of the drum machine operator. These signals are filtered, normalized, and amplified to control voltage levels to modulate sound. Together, musicians and nodes form RaveNET and engage with shared liminal experiences. In designing these wearables and evaluating them in performance, we reflect on our creative processes, spaces between our different bodies, our presence and control within the network, and how this made us adapt our movements in order to be noticed and heard.

References

[1]

Álvaro Barbosa. 2003. Displaced Soundscapes: A Survey of Network Systems for Music and Sonic Art Creation. Leonardo Music Journal 13 (Dec. 2003), 53–59. https://doi.org/10.1162/096112104322750791

[2]

Bert Bongers and Sensorband. 1998. An Interview with Sensorband. Computer Music Journal 22, 1 (1998), 13–24.

[3]

Dominic Brown. 2020. End-user action-sound mapping design for mid-air music performance. Ph. D. Dissertation.

[4]

Sophia Brueckner and Rachel Freire. 2018. Embodisuit: A Wearable Platform for Embodied Knowledge. In Proceedings of the 2018 ACM International Symposium on Wearable Computers (Singapore, Singapore) (ISWC ’18). Association for Computing Machinery, New York, NY, USA, 242–247. https://doi.org/10.1145/3267242.3267297

Digital Library

[5]

Kelsey Cotton, Pedro Sanches, Vasiliki Tsaknaki, and Pavel Karpashevich. 2021. The Body Electric: A NIME designed through and with the somatic experience of singing. In Proceedings of the International Conference on New Interfaces for Musical Expression. Shanghai, China, Article 27. https://doi.org/10.21428/92fbeb44.ec9f8fdd

[6]

Kelsey Cotton, Pedro Sanches, Vasiliki Tsaknaki, and Pavel Karpashevich. 2021. The Body Electric: A NIME designed through and with the somatic experience of singing. In Proceedings of the International Conference on New Interfaces for Musical Expression. Shanghai, China, Article 27. https://doi.org/10.21428/92fbeb44.ec9f8fdd

[7]

Richie Cyngler. 2017. Music for Various Groups of Performers (After Lucier): An Improvised Electroencephalographic Group Performance. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition (Singapore, Singapore) (C&C ’17). Association for Computing Machinery, New York, NY, USA, 462–465. https://doi.org/10.1145/3059454.3073725

Digital Library

[8]

Ella Dagan, Elena Márquez Segura, Ferran Altarriba Bertran, Miguel Flores, Robb Mitchell, and Katherine Isbister. 2019. Design Framework for Social Wearables. In Proceedings of the 2019 on Designing Interactive Systems Conference(DIS ’19). ACM. https://doi.org/10.1145/3322276.3322291

Digital Library

[9]

Lorenzo D’Orsi and Fabio Dei. 2018. What is a rite? Émile Durkheim, a hundred years later. Open Information Science 2, 1 (2018), 115–126. https://doi.org/

[10]

Rachel Freire, Cedric Honnet, and Paul Strohmeier. 2017. Second Skin: An Exploration of ETextile Stretch Circuits on the Body. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (Yokohama, Japan) (TEI ’17). Association for Computing Machinery, New York, NY, USA, 653–658. https://doi.org/10.1145/3024969.3025054

Digital Library

[11]

William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a Resource for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 233–240. https://doi.org/10.1145/642611.642653

Digital Library

[12]

David R. Glowacki, Mark D. Wonnacott, Rachel Freire, Becca R. Glowacki, Ella M. Gale, James E. Pike, Tiu de Haan, Mike Chatziapostolou, and Oussama Metatla. 2020. Isness: Using Multi-Person VR to Design Peak Mystical Type Experiences Comparable to Psychedelics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376649

Digital Library

[13]

Ge Guo, Gilly Leshed, and Keith Evan Green. 2023. “I normally wouldn’t talk with strangers”: Introducing a Socio-Spatial Interface for Fostering Togetherness Between Strangers. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). ACM. https://doi.org/10.1145/3544548.3581325

Digital Library

[14]

Hannah Perner-Wilson. Accessed: 2023-11-23. The Gloves Project. https://theglovesproject.com/.

[15]

Kate Hartman, Boris Kourtoukov, Izzie Colpitts-Campbell, and Erin Lewis. 2020. Monarch V2: An Iterative Design Approach to Prototyping a Wearable Electronics Project. In Proceedings of the 2020 ACM Designing Interactive Systems Conference(DIS ’20). ACM. https://doi.org/10.1145/3357236.3395573

Digital Library

[16]

Kate Hartman, Jackson McConnell, Boris Kourtoukov, Hillary Predko, and Izzie Colpitts-Campbell. 2015. Monarch: Self-Expression Through Wearable Kinetic Textiles. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (Stanford, California, USA) (TEI ’15). Association for Computing Machinery, New York, NY, USA, 413–414. https://doi.org/10.1145/2677199.2690875

Digital Library

[17]

Kate Hartman, Nick Puckett, and Adam Tindale. 2023. Designing Wearable Technology for Opera. In Proceedings of the 2023 ACM Designing Interactive Systems Conference(DIS ’23). ACM. https://doi.org/10.1145/3563657.3596113

Digital Library

[18]

Noura Howell, Greg Niemeyer, and Kimiko Ryokai. 2019. Life-Affirming Biosensing in Public: Sounding Heartbeats on a Red Bench. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–16. https://doi.org/10.1145/3290605.3300910

Digital Library

[19]

Pavel Karpashevich, Eva Hornecker, Michaela Honauer, and Pedro Sanches. 2018. Reinterpreting Schlemmer’s Triadic Ballet: Interactive Costume for Unthinkable Movements. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal, QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173635

Digital Library

[20]

Ozgun Kilic Afsar, Yoav Luft, Kelsey Cotton, Ekaterina R. Stepanova, Claudia Núñez Pacheco, Rebecca Kleinberger, Fehmi Ben Abdesslem, Hiroshi Ishii, and Kristina Höök. 2023. Corsetto: A Kinesthetic Garment for Designing, Composing for, and Experiencing an Intersubjective Haptic Voice. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 181, 23 pages. https://doi.org/10.1145/3544548.3581294

Digital Library

[21]

Jarrod Knibbe, Rachel Freire, Marion Koelle, and Paul Strohmeier. 2021. Skill-Sleeves: Designing Electrode Garments for Wearability. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 33, 16 pages. https://doi.org/10.1145/3430524.3440652

Digital Library

[22]

Jarrod Knibbe, Paul Strohmeier, Sebastian Boring, and Kasper Hornbæk. 2017. Automatic Calibration of High Density Electric Muscle Stimulation. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 68 (sep 2017), 17 pages. https://doi.org/10.1145/3130933

Digital Library

[23]

Kobakant. Accessed: 2023-10-06. How To Get What You Want. https://www.kobakant.at/DIY/?cat=179.

[24]

Volker Krefeld and Michel Waisvisz. 1990. The Hand in the Web: An Interview with Michel Waisvisz. Computer Music Journal 14, 2 (1990), 28–33.

[25]

Johan Liedgren, Pieter Desmet, and Andrea Gaggioli. 2023. Liminal design: A conceptual framework and three-step approach for developing technology that delivers transcendence and deeper experiences. Frontiers in Psychology 14 (02 2023), 1043170. https://doi.org/10.3389/fpsyg.2023.1043170

[26]

Rickard Lindqvist. 2015. Kinetic garment construction: Remarks on the foundations of pattern cutting. Vol. 13. Rickard Lindqvist.

[27]

Mary Mainsbridge. 2022. Feeling Movement in Live Electronic Music: An Embodied Autoethnography. In Proceedings of the 8th International Conference on Movement and Computing (Chicago, IL, USA) (MOCO ’22). Association for Computing Machinery, New York, NY, USA, Article 13, 7 pages. https://doi.org/10.1145/3537972.3537989

Digital Library

[28]

Thomas J Mitchell, Sebastian Madgwick, and Imogen Heap. 2012. Musical interaction with hand posture and orientation: A toolbox of gestural control mechanisms. (2012).

[29]

Carman Neustaedter and Phoebe Sengers. 2012. Autobiographical Design in HCI Research: Designing and Learning through Use-It-Yourself. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS ’12). Association for Computing Machinery, New York, NY, USA, 514–523. https://doi.org/10.1145/2317956.2318034

Digital Library

[30]

Binh Vinh Duc Nguyen, Jihae Han, Maarten Houben, Yssmin Bayoumi, and Andrew Vande Moere. 2023. Engaging Passers-by with Rhythm: Applying Feedforward Learning to a Xylophonic Media Architecture Facade. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). ACM. https://doi.org/10.1145/3544548.3580761

Digital Library

[31]

Aura Pon, Eric Pattison, Lawrence Fyfe, Laurie Radford, and Sheelagh Carpendale. 2017. Torrent: Integrating Embodiment, Physicalization and Musification in Music-Making. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (Yokohama, Japan) (TEI ’17). Association for Computing Machinery, New York, NY, USA, 209–216. https://doi.org/10.1145/3024969.3024974

Digital Library

[32]

Courtney N. Reed and Andrew P. McPherson. 2021. Surface Electromyography for Sensing Performance Intention and Musical Imagery in Vocalists. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 22, 11 pages. https://doi.org/10.1145/3430524.3440641

Digital Library

[33]

Courtney N. Reed and Andrew P. McPherson. 2023. The Body as Sound: Unpacking Vocal Embodiment through Auditory Biofeedback. In Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction (Warsaw, Poland) (TEI ’23). Association for Computing Machinery, New York, NY, USA, Article 7, 15 pages. https://doi.org/10.1145/3569009.3572738

Digital Library

[34]

Courtney N. Reed, Sophie Skach, Paul Strohmeier, and Andrew P. McPherson. 2022. Singing Knit: Soft Knit Biosensing for Augmenting Vocal Performances. In Proceedings of the Augmented Humans International Conference 2022 (Kashiwa, Chiba, Japan) (AHs ’22). Association for Computing Machinery, New York, NY, USA, 170–183. https://doi.org/10.1145/3519391.3519412

Digital Library

[35]

Paul Strohmeier, Henning Pohl, Jess Mcintosh, Aske Mottelson, Jarrod Knibbe, Yvonne Jansen, Joanna Bergström, and Kasper Hornbæk. 2022. Body-Based User Interfaces (1 ed.). Vol. 1. Routledge, 478.

[36]

Melanie Takahashi and Tim Olaveson. 2003. MUSIC, DANCE AND RAVING BODIES: RAVING AS SPIRITUALITY IN THE CENTRAL CANADIAN RAVE SCENE. Journal of Ritual Studies 17, 2 (2003), 72–96. http://www.jstor.org/stable/44368995

[37]

Femke Vandenberg, Michaël Berghman, and Julian Schaap. 2020. The ‘lonely raver’: music livestreams during COVID-19 as a hotline to collective consciousness?European Societies 23, sup1 (Sept. 2020), S141–S152. https://doi.org/10.1080/14616696.2020.1818271

[38]

Ian Watts. 2009. Red ochre, body-painting, and language: interpreting the Blombos ochre. 62–92.

[39]

Gil Weinberg. 2005. Interconnected Musical Networks: Toward a Theoretical Framework. Computer Music Journal 29, 2 (June 2005), 23–39. https://doi.org/10.1162/0148926054094350

Digital Library

[40]

Rebekah Wilson. 2020. Aesthetic and technical strategies for networked music performance. AI & SOCIETY 38, 5 (Nov. 2020), 1871–1884. https://doi.org/10.1007/s00146-020-01099-4

Digital Library

[41]

Clint Zeagler. 2017. Where to wear it: functional, technical, and social considerations in on-body location for wearable technology 20 years of designing for wearability. In Proceedings of the 2017 ACM International Symposium on Wearable Computers(UbiComp ’17). ACM. https://doi.org/10.1145/3123021.3123042

Digital Library

Cited By

Figueira ICha YBranham S(2024)Intersecting Liminality: Acquiring a Smartphone as a Blind or Low Vision Older AdultProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675622(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675622

Index Terms

RaveNET: Connecting People and Exploring Liminal Space through Wearable Networks in Music Performance
1. Applied computing
  1. Arts and humanities
    1. Performing arts
    2. Sound and music computing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input
    2. Interactive systems and tools
  2. Interaction design
    1. Interaction design process and methods

Recommendations

Liminal Space: A Performance with RaveNET
TEI '24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction

We present our musical performance exploration of liminal spaces, which focuses on the interconnected physicality of bodies in music, using biosignals and gestural, movement-based interaction to shape live performances in novel ways. Physical movement is ...
A New Interactive Music System by Fusion of Melody Morphing and Body Movements
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

The fusion of music-information processing and human physical functions will enable new musical experiences to be created. We developed an interactive music system, which provides users with the experience of conducting a musical performance. This ...
Representing and Linking Music Performance Data with Score Information
DLfM '16: Proceedings of the 3rd International Workshop on Digital Libraries for Musicology

This paper argues for the need to develop a representation for music performance data that is linked with corresponding score information at the note, beat, and measure levels. Building on the results of a survey of music scholars about their music ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2024

1058 pages

ISBN:9798400704024

DOI:10.1145/3623509

General Chairs:
Luigina Ciolfi
University College Cork
,
Trevor Hogan
Munster Technological University
,
Program Chairs:
Tanja Döring
University of Bremen
,
Tom Jenkins
IT University of Copenhagen
,
Jelle van Dijk
University of Twente
,
Samuel Huron
Télécom Paris
,
Zhuying Li
Southeast University
,
Publications Chairs:
David Coyle
University College Dublin
,
Beat Signer
Vrije Universiteit Brussel

Copyright © 2024 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 February 2024

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

TEI '24

Sponsor:

SIGCHI

TEI '24: Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 11 - 14, 2024

Cork, Ireland

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
179
Total Downloads

Downloads (Last 12 months)179
Downloads (Last 6 weeks)4

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Figueira ICha YBranham S(2024)Intersecting Liminality: Acquiring a Smartphone as a Blind or Low Vision Older AdultProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675622(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675622

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents