research-article

The Role of Live Visuals in Audience Understanding of Electronic Music Performances

Authors:

Nuno N. Correia,

Deborah Castro, and

Atau TanakaAuthors Info & Claims

AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

August 2017

Article No.: 29, Pages 1 - 8

https://doi.org/10.1145/3123514.3123555

Published: 23 August 2017 Publication History

Abstract

There is an identified lack of visual feedback in electronic music performances. Live visuals have been used to fill in this gap. However, there is a scarcity of studies that analyze the effectiveness of live visuals in conveying feedback. In this paper, we aim to study the contribution of live visuals to the understanding of electronic music performances, from the perspective of the audience. We present related work in the fields of audience studies in performing arts, electronic music and audiovisuals. For this purpose, we organized two live events, where 10 audiovisual performances took place. We used questionnaires to conduct an audience study in these events. Results point to a better audience understanding in two of the four design patterns we used as analytical framework. In our discussion, we suggest best practices for the design of audiovisual performance systems that can lead to improved audience understanding.

References

[1]

Saul Albert. 2015. Rhythmical coordination of performers and audience in partner dance. Delineating improvised and choreographed interaction. Etnografia e ricerca qualitativa 3/2015 (2015).

[2]

Jerônimo Barbosa, Filipe Calegario, Veronica Teichrieb, Geber Ramalho, and Patrick McGlynn. 2012. Considering Audience's View Towards an Evaluation Methodology for Digital Musical Instruments. In Proc. NIME 2012. Ann Arbor. http://www.nime.org/proceedings/2012/nime2012_174.pdf

[3]

Florent Berthaut, Mark T. Marshall, Sriram Subramanian, and Martin Hachet. 2013. Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience. In Proc. NIME 2013. Daejeon, Seoul. http://nime.org/proceedings/2013/nime2013_51.pdf

[4]

S. Astrid Bin, Nick Bryan-Kinns, and Andrew P. Mcpherson. 2016. Skip the Pre-Concert Demo: How Technical Familiarity and Musical Style Affect Audience Response. In Proc. NIME 2016. 200--205. http://www.nime.org/proceedings/2016/nime2016_paper0041.pdf

[5]

Jay David Bolter and Richard Grusin. 2000. Remediation: Understanding New Media. The MIT Press, Massachusetts.

Digital Library

[6]

Ana Carvalho and Cornelia Lund (Eds.). 2015. The Audiovisual Breakthrough. Fluctuating Images, Berlin. http://www.ephemeral-expanded.net/audiovisualbreakthrough/

[7]

Pablo Cesar, Jack Jansen, Erik Geelhoed, Doug Williams, Ian Kegel, Marian F. Ursu, and Chen Wang. 2015. Distributed Theatre: Connecting (with) Remote Audiences. In Proceedings of the Workshop on Everyday Telepresence: Emerging Practices and Future Research Directions, in conjuncion with the ACM SIGCHI Conference on Human Factors in Computing Systems. Seoul.

[8]

Nick Collins, Alex McLean, Julian Rohrhuber, and Adrian Ward. 2003. Live Coding in Laptop Performance. Org. Sound 8, 3 (Dec. 2003), 321--330.

Digital Library

[9]

Nuno N. Correia and Atau Tanaka. 2014. User-Centered Design of a Tool for Interactive Computer-Generated Audiovisuals. In Proc. 2nd ICLI. Lisbon. http://www.liveinterfaces.org/proceedings2014.html

[10]

Nuno N. Correia and Atau Tanaka. 2015. Prototyping Audiovisual Performance Tools: A Hackathon Approach. In Proc. NIME 2015. Baton Rouge, Louisiana. http://www.nime.org/proceedings/2015/nime2015_230.pdf

Digital Library

[11]

Nuno N. Correia and Atau Tanaka. 2017. AVUI: Designing a Toolkit for Audiovisual Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1093--1104.

Digital Library

[12]

Bram Crevits. 2006. The Roots of VJing. In VJ: Audio-Visual Art and VJ Culture, Michael Faulkner (Ed.). Laurence King Publishing, London, 14--19.

[13]

Lucy K. Dearn and Stephanie E. Pitts. 2017. (Un) popular music and young audiences: Exploring the classical chamber music concert from the perspective of young adult listeners. Journal of Popular Music Education 1, 1 (2017), 43--62.

[14]

Umberto Eco. 1993. Lector in Fabula (2nd edition ed.). Fabbri, Milano.

[15]

William A. Evans. 1990. The interpretative turn in media research: innovation, iteration, or illusion? Critical Studies in Mass Communication 7 (1990), 147--168.

[16]

Sidney Fels, Ashley Gadd, and Axel Mulder. 2002. Mapping transparency through metaphor: towards more expressive musical instruments. Organised Sound 7, 02 (2002), 109--126.

Digital Library

[17]

Wendy Griswold, Elizabeth Lenaghan, and Michelle Naffziger. 2011. Readers as Audiences. In The Handbook of Media Audiences, Virginia Nightingale (Ed.). Wiley-Blackwell, 17--40. http://onlinelibrary.wiley.com/doi/10.1002/9781444340525.ch1/summary

[18]

Michael Gurevich and A. Cavan Fyans. 2011. Digital Musical Interactions: Performer-system relationships and their perception by spectators. Organised Sound 16, 2 (2011), 166--175.

Digital Library

[19]

Stuart Hall. 1999. Encoding, Decoding. In The Cultural Studies Reader. 507--517.

[20]

Javier Jaimovich, Miguel Ortiz, Niall Coghlan, and R Benjamin Knapp. 2012. The Emotion in Motion Experiment: Using an Interactive Installation as a Means for Understanding Emotional Response to Music. In Proc. NIME 2012. 457--458. http://www.nime.org/proceedings/2012/nime2012_254.pdf

[21]

Vitor Joaquim and Álvaro Barbosa. 2013. Are Luminous Devices Helping Musicians to Produce Better Aural Results, or Just Helping Audiences Not To Get Bored?. In xCoAx 2013: Proceedings of the first conference on Computation, Communication, Aesthetics and X. http://2013.xcoax.org/#p36

[22]

Sergi Jordà. 2005. Digital Lutherie - Crafting Musical Computers for New Musics' Performance and Improvisation. PhD thesis. UPF, Barcelona. http://mtg.upf.edu/node/449

[23]

Chi-Hsia Lai and Till Bovermann. 2013. Audience Experience in Sound Performance. In Proc. NIME 2013. 170--173. http://nime.org/proceedings/2013/nime2013_197.pdf

[24]

Golan Levin. 2000. Painterly Interfaces for Audiovisual Performance. Ph.D. Dissertation. M.Sc. Dissertation. Massachusetts Institute of Technology, Cambridge, MA. http://acg.media.mit.edu/people/golan/thesis/thesis300.pdf

[25]

William Moritz. 2004. Optical Poetry: The Life and Work of Oskar Fischinger. John Libbey Publishing, Eastleigh.

[26]

Glenn O'Brien. 2005. Tune In, Turn On, Light Up... Tate Etc. 4 (2005). http://www.tate.org.uk/tateetc/issue4/summeroflove.htm

[27]

Ireti Olowe, Giulio Moro, and Mathieu Barthet. 2016. residUUm: user mapping and performance strategies for multilayered live audiovisual generation. In Proc. NIME 2016. Brisbane. http://www.nime.org/proceedings/2016/nime2016_paper0053.pdf

[28]

Friedrich Platz and Reinhard Kopiez. 2012. When the eye listens: A meta-analysis of how audio-visual presentation enhances the appreciation of music performance. Music Perception 30, 1 (2012), 71--83.

[29]

Jennifer Radbourne, Katya Johanson, Hilary Glow, and Tabitha White. 2009. The Audience Experience: Measuring Quality in the Performing Arts. International Journal of Arts Management 11, 3 (2009), 16--29. http://www.jstor.org/stable/41064995http://about.jstor.org/terms

[30]

Matthew Reason. 2010. Asking the audience: audience research and the experience of theatre. About performance 10 (2010), 15--34. https://ray.yorksj.ac.uk/id/eprint/381/

[31]

Dee Reynolds. 2011. Watching Dance: Kinesthetic Empathy. (2011). http://www.watchingdance.org/

[32]

Luísa Ribas. 2011. The Nature of Sound-Image Relations in Digital Interactive Systems. PhD thesis. Universidade do Porto Faculdade de Belas Artes, Porto.

[33]

Chris Salter. 2010. Entangled: Technology and the Transformation of Performance. MIT Press, Massachusetts.

Digital Library

[34]

Jonna K. Vuoskoski, Marc R. Thompson, Charles Spence, and Eric F. Clarke. 2016. Interaction of Sight and Sound in the Perception and Experience of Musical Performance. Music Perception: An Interdisciplinary Journal 33, 4 (April 2016), 457--471.

[35]

Richard Wagner. 2001. Outlines of the Artwork of the Future. In Multimedia: From Wagner to Virtual Reality, Randall Packer and Ken Jordan (Eds.). W. W. Norton, New York, 3--9.

[36]

Brita B. Wheeler. 2004. The social construction of an art field: how audience informed the institutionalization of performance art. The Journal of Arts Management, Law, and Society 33, 4 (2004), 336--350.

Cited By

Masu RDal Rì F(2023)Visual Representations to Stimulate New Musicking Strategies in Live CodingOrganised Sound10.1017/S1355771823000389(1-13)Online publication date: 22-Aug-2023
https://doi.org/10.1017/S1355771823000389
Correia NMasu RPham AFeitsch JKaltenbrunner MMurer MWolf KOakley I(2021)Connected Layers: Evaluating Visualizations of Embodiment in Contemporary Dance PerformancesProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440621(1-12)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440621
Bauer VBouchara T(2021)First Steps Towards Augmented Reality Interactive Electronic Music Production2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00024(90-93)Online publication date: Mar-2021
https://doi.org/10.1109/VRW52623.2021.00024
Show More Cited By

Index Terms

The Role of Live Visuals in Audience Understanding of Electronic Music Performances
1. Applied computing
  1. Arts and humanities
    1. Performing arts
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Visualization
    1. Visualization application domains
      1. Information visualization

Recommendations

Enhancing Multimodal Interaction Between Performers and Audience Members During Live Music Performances
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Live performance provides a good example of enthusiastic interaction between people gathered together in a large group and one or more performers. In this research, we focused on elucidating the mechanism of such enthusiastic group interaction (...
Read More
Harmony across Music, Visuals and Movement in a New Audio-visual Gestural Performance
TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

This paper describes the technology, concepts and development of Computer Storm, a live audio-visual piece created for a gestural instrument, the 'AirSticks'. The AirSticks allow the composition, performance and improvisation of live electronic music ...
Read More
Haptification of performer's control gestures in live electronic music performance
AM '19: Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound

In this paper, we introduce musical haptic wearables for audiences (MHWAs) which provide sensing and haptic stimulation technologies for networked musical interaction using wireless connectivity. We report on a concert experiment during which audience ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

August 2017

337 pages

ISBN:9781450353731

DOI:10.1145/3123514

Conference Chair:
George Fazekas,
Program Chairs:
Mathieu Barthet,
Tony Stockman

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Queen Mary, University of London

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 August 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

FCT/MCTES LARSyS
EU Marie Curie fellowship FP7

Conference

AM '17

AM '17: Audio Mostly 2017

August 23 - 26, 2017

London, United Kingdom

Acceptance Rates

AM '17 Paper Acceptance Rate 54 of 77 submissions, 70%;

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
456
Total Downloads

Downloads (Last 12 months)96
Downloads (Last 6 weeks)10

Other Metrics

View Author Metrics

Citations

Cited By

Masu RDal Rì F(2023)Visual Representations to Stimulate New Musicking Strategies in Live CodingOrganised Sound10.1017/S1355771823000389(1-13)Online publication date: 22-Aug-2023
https://doi.org/10.1017/S1355771823000389
Correia NMasu RPham AFeitsch JKaltenbrunner MMurer MWolf KOakley I(2021)Connected Layers: Evaluating Visualizations of Embodiment in Contemporary Dance PerformancesProceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3430524.3440621(1-12)Online publication date: 14-Feb-2021
https://dl.acm.org/doi/10.1145/3430524.3440621
Bauer VBouchara T(2021)First Steps Towards Augmented Reality Interactive Electronic Music Production2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00024(90-93)Online publication date: Mar-2021
https://doi.org/10.1109/VRW52623.2021.00024
Capra OBerthaut FGrisoni LWakkary RAndersen KOdom WDesjardins APetersen M(2020)Have a SEAT on StageProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395492(695-707)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395492
Benford SGreenhalgh CHazzard AChamberlain AKallionpää MWeigl DPage KLin MMandryk RHancock MPerry MCox A(2018)Designing the Audience Journey through Repeated ExperiencesProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174142(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174142
Benford SKoleva BPreston WAngus AThorn EGlover KMandryk RHancock MPerry MCox A(2018)Customizing Hybrid ProductsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173604(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173604

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents