research-article

Open Symphony: Creative Participation for Audiences of Live Music Performances

Authors:

Yongmeng Wu,

Leshao Zhang,

Nick Bryan-Kinns,

Mathieu BarthetAuthors Info & Claims

IEEE MultiMedia, Volume 24, Issue 1

Pages 48 - 62

https://doi.org/10.1109/MMUL.2017.19

Published: 01 January 2017 Publication History

Abstract

Most contemporary Western performing arts practices restrict creative interactions from audiences. Open Symphony is designed to explore audience-performer interaction in live music performances, assisted by digital technology. Audiences can conduct improvising performers by voting for various musical "modes." Technological components include a web-based mobile application, a visual client displaying generated symbolic scores, and a server service for the exchange of creative data. The interaction model, app, and visualization were designed through an iterative participatory design process. The system was experienced by about 120 audience and performer participants (35 completed surveys) in controlled (lab) and real-world settings. Feedback on usability and user experience was overall positive, and live interactions demonstrate significant levels of audience creative engagement. The authors identified further design challenges around audience sense of control, learnability, and compositional structure. This article is part of a special issue on multimedia for enriched music.

References

[1]

J. Freeman, “ Large Audience Participation, Technology, and Orchestral Performance,” in Proc. Int'l Computer Music Conf., 2005, pp. 757–760.

Google Scholar

[2]

“ Synchronisation Schnell, N. and Robaszkiewicz, S. Lambert, J.-P. for Distributed Audio Rendering over Heterogeneous Devices, in HTML5,” in Proc. of Web Audio Conference (WAC), 2016.

Google Scholar

[3]

A. Clément, “ Bridging the Gap between Performers and the Audience Using Networked Smartphones: The a.bel Systern.,” Proc. Int'l Conf. Live Interfaces, 2016, pp. 96–102.

Google Scholar

[4]

T. Cerratto-Pargman, C. Rossitto, and L. Barkhuus, “ Understanding Audience Participation in an Interactive Theater Performance,” in Proc. 8th Nordic Conf. Human-Computer Interaction: Fun, Fast, Foundational. 2014. pp. 608–617.

Digital Library

Google Scholar

[5]

J. Schwarz, “ Phone as a Pixel: Enabling Ad-Hoc, Large-Scale Displays Using Mobile Devices,” in Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI), 2012, pp. 2235–2238.

Crossref

Google Scholar

[6]

G. Fazekas, M. Barthet, and M.B. Sandler, “ The Mood Conductor System: Audience and Performer Interaction Using Mobile Technology and Emotion Cues,” in Proc. Int'l Symp. computer Music Multidisciplinary Research (CMMR), 2013, pp. 106–121.

Google Scholar

[7]

M. Barthet, “ From Interactive to Adaptive Mood-Based Music Listening Experiences in Social or Personal Contexts,” J. Audio Eng. Soc., vol. Volume 64, no. Issue 9, 2016, pp. 673–682.

Google Scholar

[8]

F. Berthaut, “ Reflets: Combining and Revealing Spaces for Musical Performances,” Proc. Int'l Conf. New Interfaces for Musical Expression (NIME), 2015.

Digital Library

Google Scholar

[9]

M. Feldmeier and J.A. Paradiso, “ An Interactive Music Environment for Large Groups with Giveaway Wireless Motion Sensors,” Computer Music J., vol. Volume 31, no. Issue 1, 2007, pp. 50–67.

Digital Library

Google Scholar

[10]

N. Weitzner, “ MassMobile—An Audience Participation Framework,” Proc. Int'l Conf. New Interfaces for Musical Expression (NIME), 2012, pp. 92–95.

Google Scholar

[11]

L. Zhang, Y. Wu, and M. Barthet, “ A Web Application for Audience Participation in Live Music Performance: The Open Symphony Use Case,” Proc. Int'l Conf. New Interfaces for Musical Expression (NIME), 2016, pp. 170–175.

Google Scholar

[12]

S. Jordà, “ On Stage: The Reactable and Other Musical Tangibles Go Real,” Int. J. Arts and Technology, vol. Volume 1, no. Issue 3/4, 2008, pp. 268–287.

Crossref

Google Scholar

Cited By

View all

Greenhalgh CHazzard ABenford SCliffe LKelly E(2022)Crafting Trajectories of Smart Phone Use at the OperaACM Transactions on Computer-Human Interaction10.1145/353100729:6(1-37)Online publication date: 16-Nov-2022
https://dl.acm.org/doi/10.1145/3531007
Yan C(2021)Audience Evaluation and Analysis of Symphony Performance Effects Based on the Genetic Neural Network Algorithm for the Multilayer Perceptron (GA-MLP-NN)Computational Intelligence and Neuroscience10.1155/2021/41338922021Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1155/2021/4133892
Yakura HKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)No More Handshaking: How have COVID-19 pushed the expansion of computer-mediated communication in Japanese idol culture?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445252(1-10)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445252
Show More Cited By

Recommendations

A Participatory Live Music Performance with the Open Symphony System
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Our Open Symphony system reimagines the music experience for a digital age, fostering alliances between performer and audience and our digital selves. Open Symphony enables live participatory music performance where the audience actively engages in the ...
From Battle Metris to Symbiotic Symphony: a new model for musical games
CyberGames '06: Proceedings of the 2006 international conference on Game research and development

Music and games have a rich history of interplay. Instrumental composers engage with the idea of game play as a way to serialise musical material, facilitate performer's real-time decision making and organise a particular theatricality in performance. On ...
The Symphony as a Novel: Mahler’s Tenth

Comments

Information & Contributors

Information

Published In

IEEE MultiMedia Volume 24, Issue 1

January 2017

87 pages

ISSN:1070-986X

Issue’s Table of Contents

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 January 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Greenhalgh CHazzard ABenford SCliffe LKelly E(2022)Crafting Trajectories of Smart Phone Use at the OperaACM Transactions on Computer-Human Interaction10.1145/353100729:6(1-37)Online publication date: 16-Nov-2022
https://dl.acm.org/doi/10.1145/3531007
Yan C(2021)Audience Evaluation and Analysis of Symphony Performance Effects Based on the Genetic Neural Network Algorithm for the Multilayer Perceptron (GA-MLP-NN)Computational Intelligence and Neuroscience10.1155/2021/41338922021Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.1155/2021/4133892
Yakura HKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)No More Handshaking: How have COVID-19 pushed the expansion of computer-mediated communication in Japanese idol culture?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445252(1-10)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445252
Otsu KYuan JFukuda HKobayashi YKuno YYamazaki K(2021)Enhancing Multimodal Interaction Between Performers and Audience Members During Live Music PerformancesExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451584(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451584
Martins GGomes GConceição JMarques LSilva DCastro TGadelha Bde Freitas RSantos CBento Villela MGasparini IUchôa Conte T(2020)Enhanced interactionProceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems10.1145/3424953.3426492(1-9)Online publication date: 26-Oct-2020
https://dl.acm.org/doi/10.1145/3424953.3426492
Turchet LWest TWanderley M(2020)Touching the audience: musical haptic wearables for augmented and participatory live music performancesPersonal and Ubiquitous Computing10.1007/s00779-020-01395-225:4(749-769)Online publication date: 24-Mar-2020
https://dl.acm.org/doi/10.1007/s00779-020-01395-2
Viola FTurchet LAntoniazzi FFazekas G(2018)C Minor: a Semantic Publish/Subscribe Broker for the Internet of Musical ThingsProceedings of the 23rd Conference of Open Innovations Association FRUCT10.5555/3299905.3299960(405-415)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.5555/3299905.3299960
Turchet LViola FFazekas GBarthet M(2018)Towards a Semantic Architecture for the Internet of Musical ThingsProceedings of the 23rd Conference of Open Innovations Association FRUCT10.5555/3299905.3299957(382-390)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.5555/3299905.3299957
Turchet LBarthet M(2018)Jamming with a Smart Mandolin and Freesound-based AccompanimentProceedings of the 23rd Conference of Open Innovations Association FRUCT10.5555/3299905.3299956(375-381)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.5555/3299905.3299956
Hu HZhang HYang Y(2018)Security risk situation quantification method based on threat prediction for multimedia communication networkMultimedia Tools and Applications10.1007/s11042-017-5602-077:16(21693-21723)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1007/s11042-017-5602-0
Show More Cited By

Abstract

References

Cited By

Recommendations

A Participatory Live Music Performance with the Open Symphony System

From Battle Metris to Symbiotic Symphony: a new model for musical games

The Symphony as a Novel: Mahler’s Tenth

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations