research-article

Social Movements: A Case Study in Dramaturgically-Driven Sound Design for Contemporary Dance Performance to Mediate Human-Human Interaction

Authors:

Ryan Ingebritsen,

Christopher Knowlton,

Erica MottAuthors Info & Claims

TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 227 - 237

https://doi.org/10.1145/3374920.3374955

Published: 09 February 2020 Publication History

Abstract

We present the iterative design and final implementation of a real-time full-body control system of the sound score by performers in an immersive contemporary dance performance. Digital musical instruments for dance require different considerations than for music, particularly in contemporary, non-proscenium and participatory audience contexts. Arising from dramaturgical research around social movement and civic participation in the digital age, this case study presents a fusion of design choices that consider artistic themes, performer interaction and audience experience. Three generations of sound and technical design are presented, with intermittent performances, challenges and learnings at each stage. We believe that the collaborative evolution of compositional choices, computer vision techniques, sound mapping, performer interaction and staging reveals important insights into developing interaction systems for kinesthetic empathy. Rather than placing the focus on human-computer interaction, our final production employed technology as a bridge to encourage human-human interaction around themes of occupation, resistance and resilience.

References

[1]

Linda P. Acredolo and Susan W. Goodwyn. 2009. Symbolic Gesturing in Language Development. Human Development 28, 1 (2009), 40--49. https://doi.org/10.1159/000272934

[2]

Curtis Bahn, Tomie Hahn, and Dan Trueman. 2001. Physicality and Feedback: A Focus on the Body in the Performance of Electronic. In International Computer Music Conference, Vol. 2001. 44--51. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.130.4605

[3]

Elizabeth Bates and Frederic Dick. 2002. Language, Gesture, and the Developing Brain. Developmental Psychobiology 40, 3 (Apr 2002), 293-- 310. https://doi.org/10.1002/dev.10034

[4]

Dom Brown, Chris Nash, and Tom Mitchell. 2018. Understanding User-Defined Mapping Design in Mid-Air Musical Performance. In Proceedings of the 5th International Conference on Movement and Computing - MOCO '18. ACM Press, New York, New York, USA, 1--8. https://doi.org/10.1145/3212721.3212810

Digital Library

[5]

Edward T. Cone. 1968. Musical Form and Musical Performance (first ed.). 103 pages. https://www.worldcat.org/title/musical-form-andmusical-performance/oclc/436472

[6]

Jodi Dean. 2010. Affective Networks. Mediatropes 2, 2 (2010), 19--44. https://philpapers.org/rec/DEAAN

[7]

Nahed Eltantawy. 2008. Pots, Pans, & Protests: Women's Strategies for Resisting Globalization in Argentina. Communication and Critical/ Cultural Studies 5, 1 (Mar 2008), 46--63. https://doi.org/10.1080/14791420701821773

[8]

Maiken Hillerup Fogtmann, Jonas Fritsch, and Karen Johanne Kortbek. 2008. Kinesthetic Interaction: Revealing the Bodily Potential in Interaction Design. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction Designing for Habitus and Habitat - OZCHI '08. ACM Press, New York, New York, USA, 89. https://doi.org/10.1145/1517744.1517770

Digital Library

[9]

Jules Françoise and Jules. 2013. Gesture--sound mapping by demonstration in interactive music systems. In Proceedings of the 21st ACM international conference on Multimedia -MM'13. ACM Press, New York, New York, USA, 1051--1054. https://doi.org/10.1145/2502081.2502214

Digital Library

[10]

Mohandas Gandhi. 1954. Autobiography: The Story of My Experiments With Truth. Public Affairs Press, Washington, DC.

[11]

Summer Harlow and Thomas J. Johnson. 2011. Overthrowing the Protest Paradigm? How The New York Times, Global Voices and Twitter Covered the Egyptian Revolution. International Journal of Communication 5 (sep 2011), 1359--1374. https://ijoc.org/index.php/ijoc/article/view/1239

[12]

Andy Hunt and Ross Kirk. 2000. Mapping Strategies for Musical Performance. Trends in Gestural Control of Music 21 (2000), 231--258.

[13]

Andy Hunt, Marcelo M. Wanderley, and Matthew Paradis. 2003. The Importance of Parameter Mapping in Electronic Instrument Design. Journal of New Music Research 32, 4 (Dec 2003), 429--440. https://doi.org/10.1076/jnmr.32.4.429.18853

[14]

Marco Iacoboni, Istvan Molnar-Szakacs, Vittorio Gallese, Giovanni Buccino, John Mazziotta, and Giacomo Mazziotta. 2005. Grasping the Intentions of Others with One's Own Mirror Neuron System. PLoS Biology 3 (2005), e79.

[15]

Kanav Kahol, Priyamvada Tripathi, and Sethuraman Panchanathan. 2004. Automated gesture segmentation from dance sequences. In Proceedings - Sixth IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, 883--888. https://doi.org/10.1109/AFGR.2004.1301645

[16]

Tamir Klein, Rolf T W Siegwolf, and Christian Körner. 2016. Belowground Carbon Trade Among Tall Trees in a Temperate Forest. Science (New York, N.Y.) 352, 6283 (Apr 2016), 342--4. https://doi.org/10.1126/science.aad6188

[17]

Efthymios Kouloumpis, Theresa Wilson, and Johanna Moore. 2011. Twitter Sentiment Analysis: The Good the Bad and the OMG! Fifth International AAAI Conference on Weblogs and Social Media (Jul 2011). https://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/viewPaper/2857

[18]

Martha Mockus. 2008. Sounding Out: Pauline Oliveros and Lesbian Musicality. Routledge. 208 pages.

[19]

Zizi Papacharissi and Maria De Fatima Oliveira. 2012. Affective News and Networked Publics: The Rhythms of News Storytelling on #Egypt. Journal of Communication 62, 2 (Apr 2012), 266--282. https://doi.org/10.1111/j.1460--2466.2012.01630.x

[20]

Sarah Rashid. 2013. Egyptians are using pots and pans to make themselves heard - Quartz. https://qz.com/118620/egyptians-are-usingpots-and-pans-to-make-themselves-heard/

[21]

Matthew Reason and Dee Reynolds. 2010. Kinesthesia, Empathy, and Related Pleasures: An Inquiry into Audience Experiences of Watching Dance. Dance Research Journal 42 (2010), 49--75.

[22]

Brian Rotman. 2008. Becoming Beside Ourselves : The Alphabet, Ghosts, and Distributed Human Being. Duke University Press. 176 pages.

[23]

Disa A Sauter, Frank Eisner, Paul Ekman, and Sophie K Scott. 2010. Cross-cultural Recognition of Basic Emotions Through Nonverbal Emotional Vocalizations. Proceedings of the National Academy of Sciences 107, 6 (Feb 2010), 2408--2412. https://doi.org/10.1073/pnas.0908239106

[24]

Allucquere Rosanne Stone. 1995. The War of Desire and Technology at the Close of the Mechanical Age. MIT Press. 212 pages.

Cited By

Turmo Vidal LTajadura-Jiménez AVega-Cebrián JLey-Flores JDíaz-Durán JMárquez Segura ECiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Body Transformation: An Experiential Quality of Sensory Feedback Wearables for Altering Body PerceptionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633373(1-19)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633373
Ingebritsen RKnowlton C(2022)And She Will Sound The Alarm: Performance and Demo of the Body Sample PlayerProceedings of the 8th International Conference on Movement and Computing10.1145/3537972.3538019(1-4)Online publication date: 22-Jun-2022
https://dl.acm.org/doi/10.1145/3537972.3538019
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458
Show More Cited By

Index Terms

Social Movements: A Case Study in Dramaturgically-Driven Sound Design for Contemporary Dance Performance to Mediate Human-Human Interaction
1. Applied computing
  1. Arts and humanities
    1. Performing arts
    2. Sound and music computing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Auditory feedback
  2. Interaction design
    1. Interaction design process and methods
      1. Participatory design

Recommendations

And She Will Sound The Alarm: Performance and Demo of the Body Sample Player
MOCO '22: Proceedings of the 8th International Conference on Movement and Computing

Kinesthetic empathy, in the context of interactive design, is defined as the ability to encode and decode the input of other users of the system or to sense a shift in the system itself [7]. Achieving this between two players or between players and ...
MubuFunkScatShare: gestural energy and shared interactive music
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

We present a ludic interactive music performance that allows live recorded sounds to be re-rendered through the users' movements. The interaction design made the control similar to a shaker where the motion energy drives the energy of the played music ...
Embodied Cognition in Performers of Large Acoustic Instruments as a Method of Designing New Large Digital Musical Instruments
Perception, Representations, Image, Sound, Music
Abstract
We present The Large Instrument Performers Study, an interview-based exploration into how large scale acoustic instrument performers navigate the instrument’s size-related aesthetic features during the performance. Through the conceptual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2020

978 pages

ISBN:9781450361071

DOI:10.1145/3374920

General Chairs:
Elise van den Hoven
University of Technology Sydney (Australia) & Eindhoven University of Technology (the Netherlands)
,
Lian Loke
University of Sydney (Australia)
,
Program Chairs:
Orit Shaer
Wellesley College (USA)
,
Jelle van Dijk
University of Twente (Netherlands)
,
Andrew Kun
University of New Hampshire (USA)

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 February 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI '20

Sponsor:

SIGCHI

TEI '20: Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 9 - 12, 2020

Sydney NSW, Australia

Acceptance Rates

TEI '20 Paper Acceptance Rate 37 of 132 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
370
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Turmo Vidal LTajadura-Jiménez AVega-Cebrián JLey-Flores JDíaz-Durán JMárquez Segura ECiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Body Transformation: An Experiential Quality of Sensory Feedback Wearables for Altering Body PerceptionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633373(1-19)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633373
Ingebritsen RKnowlton C(2022)And She Will Sound The Alarm: Performance and Demo of the Body Sample PlayerProceedings of the 8th International Conference on Movement and Computing10.1145/3537972.3538019(1-4)Online publication date: 22-Jun-2022
https://dl.acm.org/doi/10.1145/3537972.3538019
Johansen Svan Berkel NFritsch J(2022)Characterising Soundscape Research in Human-Computer InteractionProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533458(1394-1417)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533458
Mendoza YDuarte Ede Queiroz MBaranauskas M(2022)Evaluation in scenarios of ubiquity of technology: a systematic literature review on interactive installationsPersonal and Ubiquitous Computing10.1007/s00779-022-01696-827:2(343-361)Online publication date: 11-Nov-2022
https://doi.org/10.1007/s00779-022-01696-8
Ingebritsen RKnowlton CToenjes JKaltenbrunner MMurer MWolf KOakley I(2021)Kinesthetic Empathy in Remote Interactive Performance: Research into Platforms and Strategies for Performing OnlineProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3442456(1-8)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3442456
Spiel KKaltenbrunner MMurer MWolf KOakley I(2021)The Bodies of TEI – Investigating Norms and Assumptions in the Design of Embodied InteractionProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440651(1-19)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440651

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten