research-article

Designing the Audience Journey through Repeated Experiences

Authors:

Chris Greenhalgh,

Adrian Hazzard,

Alan Chamberlain,

Maria Kallionpää,

David M. Weigl,

Mengdie LinAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 568, Pages 1 - 12

https://doi.org/10.1145/3173574.3174142

Published: 21 April 2018 Publication History

Abstract

We report on the design, premiere and public evaluation of a multifaceted audience interface for a complex non-linear musical performance called Climb! which is particularly suited to being experienced more than once. This interface is designed to enable audiences to understand and appreciate the work, and integrates a physical instrument and staging, projected visuals, personal devices and an online archive. A public premiere concert comprising two performances of Climb! revealed how the audience reoriented to the second performance through growing understanding and comparison to the first. Using trajectories as an analytical framework for the audience 'journey' made apparent: how the trajectories of a single performance are embedded within the larger trajectories of a concert and the creative work as a whole; the distinctive demands of understanding and interpretation; and the potential of the archive in enabling appreciation across repeated performances.

Supplementary Material

suppl.mov (pn4458-file3.mp4)

Supplemental video

Download
11.73 MB

suppl.mov (pn4458-file5.mp4)

Supplemental video

Download
10.64 MB

MP4 File (pn4458.mp4)

Download
283.48 MB

References

[1]

Louise Barkhuus and Tobias Jørgensen. 2008. Engaging the crowd: studies of audience-performer interaction. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 2925--2930.

Digital Library

[2]

Steve Benford, Chris Greenhalgh, Andy Crabtree, Martin Flintham, Brendan Walker, Joe Marshall, Boriana Koleva, Stefan Rennick Egglestone, Gabriella Giannachi, Matt Adams, Nick Tandavanitj, and Ju Row Farr. 2013. Performance-Led Research in the Wild. ACM Trans. Comput.-Hum. Interact. 20, 3, Article 14 (July 2013).

Digital Library

[3]

Dawn Bennett and Jane Ginsborg. 2017. Audience Reactions to the Program Notes of Unfamiliar Music. Psychology of Music.

[4]

Florent Berthaut, Mark T. Marshall, Sriram Subramanian and Martin Hachet. 2013. Rouages: Revealing the mechanisms of digital musical instruments to the audience. In New Interfaces for Musical Expression, May 2013, Daejeon, South Korea.

[5]

S. Astrid Bin, Nick Bryan-Kinns, and Andrew P. McPherson. 2016. Skip the Pre-Concert Demo: How Technical Familiarity and Musical Style Affect Audience Response. In NIME'16, July 11-15, 2016, Griffith University, Brisbane, Australia.

[6]

Alan S. Brown and Jennifer L. Novak. 2007. Assessing the intrinsic impacts of a live performance. San Francisco, CA: WolfBrown.

[7]

Pablo Cesar, Dick C.A. Bulterman and A.J. Jansen. 2008. Usages of the secondary screen in an interactive television environment: Control, enrich, share, and transfer television content. In European Conference on Interactive Television (pp. 168--177). Springer, Berlin, Heidelberg.

Digital Library

[8]

Eric Clarke. 2005. Ways of listening: An ecological approach to the perception of musical meaning. Oxford University Press.

[9]

Nuno N. Correia, Deborah Castro, and Atau Tanaka. 2017. The Role of Live Visuals in Audience Understanding of Electronic Music Performances. In Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences (AM '17). ACM, New York, NY, USA, Article 29, 8 pages.

Digital Library

[10]

Roger B. Dannenberg. 2005. Interactive visual music: a personal perspective. Computer Music Journal, 29(4), 25--35.

[11]

John Dewey. 2005. Art as Experience. Penguin.

[12]

Abigail Durrant, Duncan Rowland, David S. Kirk, Steve Benford, Joel E. Fischer, and Derek McAuley. 2011. Automics: souvenir generating photoware for theme parks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 1767--1776.

Digital Library

[13]

Gyorgy Fazekas, Mathieu Barthet and Mark B. Sandler. 2013. Mood conductor: emotion-driven interactive music performance. In Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on (pp. 726--726). IEEE.

Digital Library

[14]

Martin D. Flintham, Raphael Velt, Max L. Wilson, Edward J. Anstead, Steve Benford, Anthony Brown, Timothy Pearce, Dominic Price, and James Sprinks. 2015. Run Spot Run: Capturing and Tagging Footage of a Race by Crowds of Spectators. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 747--756.

Digital Library

[15]

Lesley Fosh, Steve Benford, Stuart Reeves, Boriana Koleva, and Patrick Brundell. 2013. see me, feel me, touch me, hear me: trajectories and interpretation in a sculpture garden. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 149--158.

Digital Library

[16]

Jason Freeman. 2008. Extreme sight-reading, mediated expression, and audience participation: Real-time music notation in live performance. Computer Music Journal, 32(3), pp.25--41.

Digital Library

[17]

Danny Godin and Mithra Zahedi. 2014. Aspects of research through design: a literature review. Proceedings of DRS, 281.

[18]

Chris Greenhalgh, Steve Benford, and Adrian Hazzard. 2016. ^muzicode$: Composing and Performing Musical Codes. In Proceedings of the Audio Mostly 2016 (AM '16). ACM, New York, NY, USA, 47--54.

Digital Library

[19]

Chris Greenhalgh, Steve Benford, Adrian Hazzard, and Alan Chamberlain. 2017. Playing Fast and Loose with Music Recognition. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4302--4313.

Digital Library

[20]

Jonathan Grudin. 2001. Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 458--465.

Digital Library

[21]

Kate Hayes, Mathieu Barthet, Yongmeng Wu, Leshao Zhang, and Nick Bryan-Kinns. 2016. A Participatory Live Music Performance with the Open Symphony System. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 313--316.

Digital Library

[22]

Kristina Höök and Jonas Löwgren. 2012. Strong concepts: Intermediate-level knowledge in interaction design research. ACM Trans. Comput.-Hum. Interact. 19, 3, Article 23 (October 2012), 18 pages.

Digital Library

[23]

Kallionpää, Maria and Greenhalgh, Chris and Hazzard, Adrian and Weigl, David M. and Page, Kevin R. and Benford, Steve (2017) Composing and realising a game-like performance for disklavier and electronics. In: New Interfaces for Musical Expression (NIME'17), 15--18 May 2017, Copenhagen, Denmark.

[24]

Kimihiro Noguchi, Yulia R. Gel, Edgar Brunner and Frank Konietschke. 2012. nparLD: an R software package for the nonparametric analysis of longitudinal data in factorial experiments. Journal of Statistical Software, 50(12), 1--23. 2012

[25]

Michael Kruppa and Antonio Krüger. 2003. Concepts for a combined use of Personal Digital Assistants and large remote displays. Proceedings of SimVis 2003, Pages 349--361, Magdeburg

[26]

Fred Lerdahl and Ray Jackendoff. 1985. A Generative Theory of Tonal Music. MIT press.

[27]

Lars Olov Lundqvist, Fredrik Carlsson, Per Hilmersson and Patrik N. Juslin. 2009. Emotional responses to music: experience, expression, and physiology. Psychology of music, 37(1), pp.61--90.

[28]

Leonard B. Meyer.1956. Emotion and Meaning in Music. University of Chicago Press.

[29]

Simon Penny, Jeffrey Smith, Phoebe Sengers, André Bernhardt and Jamieson Schulte. 2001. Traces: Embodied Immersive Interaction with SemiAutonomous Avatars. Convergence, 7(2), pp.47--65.

[30]

Jennifer Radbourne, Katya Johanson and Hilary Glow. 2010. Empowering audiences to measure quality. Participations: Journal of audience&reception studies, 7(2), pp.360--379.

[31]

Matthew Reason. 2010. Asking the audience: audience research and the experience of theatre. About performance (10). pp. 15--34.

[32]

Stuart Reeves. 2011. Designing interfaces in public settings: Understanding the role of the spectator in Human-Computer Interaction. Springer Science&Business Media.

Digital Library

[33]

Guy Schofield, Tom Bartindale, and Peter Wright. 2015. Bootlegger: Turning Fans into Film Crew. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 767--776.

Digital Library

[34]

Phoebe Sengers and Bill Gaver. 2006. Staying open to interpretation: engaging multiple meanings in design and evaluation. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). ACM, New York, NY, USA, 99--108.

Digital Library

[35]

Jennifer G. Sheridan, Nick Bryan-Kinns, and Alice Bayliss. 2007. Encouraging witting participation and performance in digital live art. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1 (BCS-HCI '07), Vol. 1. British Computer Society, Swinton, UK, UK, 13--23.

Digital Library

[36]

John A. Sloboda, Susan A. O'Neill and Antonia Ivaldi. 2001. Functions of music in everyday life: An exploratory study using the Experience Sampling Method. Musicae scientiae, 5(1), pp.9--32.

[37]

Lucy A. Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge university press.

Digital Library

[38]

Raphael Velt, Steve Benford, and Stuart Reeves. 2017. A Survey of the Trajectories Conceptual Framework: Investigating Theory Use in HCI. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2091--2105.

Digital Library

[39]

Bradley W. Vines, Carol L. Krumhansl, Marcelo M. Wanderley, Ioana M. Dalca, and Daniel J. Levitin. 2011. Music to my eyes: Cross-modal interactions in the perception of emotions in musical performance. Cognition, 118(2), pp.157--170.

[40]

David M. Weigl and Kevin R. Page. 2017. A framework for distributed semantic annotation of musical score: "Take it to the bridge!". In Proceedings of the 18th International Society for Music Information Retrieval Conference (ISMIR 2017), Suzhou, China, 221--228.

Cited By

Greenhalgh C(2023)Crafting Interactive Experiences with Non-programmersCompanion Proceedings of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3596454.3597174(1-4)Online publication date: 27-Jun-2023
https://dl.acm.org/doi/10.1145/3596454.3597174
Benford SManninen KMartindale SHazzard AMartinez Avila JTennent PSpence JCastle-Green TBrundell PBarnard PDarzentas D(2023)Infrastructures for Virtual Volunteering at Online Music FestivalsProceedings of the ACM on Human-Computer Interaction10.1145/35794987:CSCW1(1-26)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579498
Tsenova VWood GKirk D(2023)Loci Stories: Exploring Design for Polyvocality Proceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596114(15-30)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596114
Show More Cited By

Index Terms

Designing the Audience Journey through Repeated Experiences
1. Human-centered computing

Recommendations

Children's music journey: the development of an interactive software solution for early childhood music education
Theoretical and Practical Computer Applications in Entertainment

Music is recognized as a fundamental component in the education of the individual. Despite this fact, support and funding for music programs in public schools across North America continues to decline. This article discusses the benefits of music ...
The Role of Live Visuals in Audience Understanding of Electronic Music Performances
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music Experiences

There is an identified lack of visual feedback in electronic music performances. Live visuals have been used to fill in this gap. However, there is a scarcity of studies that analyze the effectiveness of live visuals in conveying feedback. In this paper,...
Novel Methods in Facilitating Audience and Performer Interaction Using the Mood Conductor Framework
Sound, Music, and Motion
Abstract
While listeners’ emotional response to music is the subject of numerous studies, less attention is paid to the dynamic emotion variations due to the interaction between artists and audiences in live improvised music performances. By opening a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Engineering and Physical Sciences Research Council

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
517
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)6

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Greenhalgh C(2023)Crafting Interactive Experiences with Non-programmersCompanion Proceedings of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3596454.3597174(1-4)Online publication date: 27-Jun-2023
https://dl.acm.org/doi/10.1145/3596454.3597174
Benford SManninen KMartindale SHazzard AMartinez Avila JTennent PSpence JCastle-Green TBrundell PBarnard PDarzentas D(2023)Infrastructures for Virtual Volunteering at Online Music FestivalsProceedings of the ACM on Human-Computer Interaction10.1145/35794987:CSCW1(1-26)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579498
Tsenova VWood GKirk D(2023)Loci Stories: Exploring Design for Polyvocality Proceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596114(15-30)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596114
Greenhalgh CHazzard ABenford SCliffe LKelly E(2022)Crafting Trajectories of Smart Phone Use at the OperaACM Transactions on Computer-Human Interaction10.1145/353100729:6(1-37)Online publication date: 16-Nov-2022
https://dl.acm.org/doi/10.1145/3531007
Tholander JRossitto CRostami AIshiguro YMiyaki TRekimoto JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Design in Action: Unpacking the Artists’ Role in Performance-Led ResearchProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445056(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445056
Capra OBerthaut FGrisoni LWakkary RAndersen KOdom WDesjardins APetersen M(2020)Have a SEAT on StageProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395492(695-707)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395492
Ramchurn RMartindale SWilson MBenford SBrewster SFitzpatrick GCox AKostakos V(2019)From Director's Cut to User's CutProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300378(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300378
Hazzard AGreenhalgh CKallionpaa MBenford SVeinberg AKanga ZMcPherson ABrewster SFitzpatrick GCox AKostakos V(2019)Failing with StyleProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300260(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300260
Redeker GKessler GKipper L(2019)Lean information for lean communicationInternational Journal of Information Management: The Journal for Information Professionals10.1016/j.ijinfomgt.2018.12.01847:C(31-43)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1016/j.ijinfomgt.2018.12.018
Lewis DWeigl DBullivant JPage KPage K(2018)Publishing musicology using multimedia digital librariesProceedings of the 5th International Conference on Digital Libraries for Musicology10.1145/3273024.3273038(21-25)Online publication date: 28-Sep-2018
https://dl.acm.org/doi/10.1145/3273024.3273038
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents