poster

Public Access

Towards Enhancing a Recorded Concert Experience in Virtual Reality by Visualizing the Physiological Data of the Audience

Authors:

Xiaru Meng,

Yan He,

Kai KunzeAuthors Info & Claims

AHs '23: Proceedings of the Augmented Humans International Conference 2023

Pages 330 - 333

https://doi.org/10.1145/3582700.3583709

Published: 14 March 2023 Publication History

All formats PDF

Abstract

This work is a first attempt to visualize the social atmosphere of a audience in a VR experience using their recorded the physiological state, and then presents them to another group of audience members, aiming at a transformative perception from individual to collective experience. A virtual environment is built to share the audience’s aesthetic feelings and emotions, creating a novel way of non-verbal communication in performance scenarios that aim at enhancing audio-visual perception through physiological sensing and emotional experience sharing. This experiment was designed to investigate the effect of physiological data-based reproduction of musical performances in VR on affective states.

References

[1]

Bowen Alpern and Fred B Schneider. 1985. Defining liveness. Information processing letters 21, 4 (1985), 181–185.

Google Scholar

[2]

Philip Auslander. 2008. Liveness: Performance in a mediatized culture. Routledge.

Crossref

Google Scholar

[3]

Asaf Bachrach, Yann Fontbonne, Coline Joufflineau, and José Luis Ulloa. 2015. Audience entrainment during live contemporary dance performance: Physiological and cognitive measures. Frontiers in human neuroscience 9 (2015), 179.

Google Scholar

[4]

Patrícia J Bota, Chen Wang, Ana LN Fred, and Hugo Silva. 2020. A Wearable System for Electrodermal Activity Data Acquisition in Collective Experience Assessment. In ICEIS (2). 606–613.

Google Scholar

[5]

Margaret M Bradley and Peter J Lang. 1994. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry 25, 1(1994), 49–59.

Crossref

Google Scholar

[6]

Aman Gupta, Finn L Strivens, Benjamin Tag, Kai Kunze, and Jamie A Ward. 2019. Blink as you sync: Uncovering eye and nod synchrony in conversation using wearable sensing. In Proceedings of the 23rd International Symposium on Wearable Computers. 66–71.

Digital Library

Google Scholar

[7]

Yan He, George Chernyshov, Jiawen Han, Dingding Zheng, Ragnar Thomsen, Danny Hynds, Muyu Liu, Yuehui Yang, Yulan Ju, Yun Suen Pai, 2022. Frisson Waves: Exploring Automatic Detection, Triggering and Sharing of Aesthetic Chills in Music Performances. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–23.

Digital Library

Google Scholar

[8]

Yan He, George Chernyshov, Dingding Zheng, Jiawen Han, Ragnar Thomsen, Danny Hynds, Yuehui Yang, Yun Suen Pai, Kai Kunze, and Kouta Minamizawa. 2021. Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances. In SIGGRAPH Asia 2021 Emerging Technologies. 1–2.

Google Scholar

[9]

Kwan Min Lee. 2004. Presence, explicated. Communication theory 14, 1 (2004), 27–50.

Google Scholar

[10]

Haruka Shoda, Mayumi Adachi, and Tomohiro Umeda. 2016. How live performance moves the human heart. PLoS One 11, 4 (2016), e0154322.

Crossref

Google Scholar

[11]

Fernando Silveira, Brian Eriksson, Anmol Sheth, and Adam Sheppard. 2013. Predicting audience responses to movie content from electro-dermal activity signals. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. 707–716.

Digital Library

Google Scholar

[12]

Mel Slater, Martin Usoh, Ernest Catena, and Sima Arman. 2000. Using presence questionnaires in reality. Presence: teleoperators and virtual environments 9 (2000), 497–503.

Google Scholar

[13]

Moe Sugawa, Taichi Furukawa, George Chernyshov, Danny Hynds, Jiawen Han, Marcelo Padovani, Dingding Zheng, Karola Marky, Kai Kunze, and Kouta Minamizawa. 2021. Boiling Mind: Amplifying the Audience-Performer Connection through Sonification and Visualization of Heart and Electrodermal Activities. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction. 1–10.

Digital Library

Google Scholar

Cited By

View all

Sparrow LGalwey CLoveridge BGlasser SOsborne MKelly R(2024)Heart and Soul: The Ethics of Biometric Capture in Immersive Artistic PerformanceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642309(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642309
Park JChoi YLee K(2024)Research Trends in Virtual Reality Music Concert Technology: A Systematic Literature ReviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337206930:5(2195-2205)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372069

Index Terms

Towards Enhancing a Recorded Concert Experience in Virtual Reality by Visualizing the Physiological Data of the Audience
1. Applied computing
  1. Arts and humanities
    1. Performing arts
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Activities-based virtual reality experience for better audience engagement
Abstract
The benefits of virtual reality have definitely expanded beyond the gaming industry to a variety of other businesses. From virtual conferences to virtual exhibitions, the MICE (Meetings, Incentives, Conferences, and Exhibitions) ...
Highlights
- Activities in the virtual reality experience improve audience engagement.
- ...
Visualizing the keyboard in virtual reality for enhancing immersive experience
SIGGRAPH '17: ACM SIGGRAPH 2017 Posters

Recently, virtual reality (VR) becomes more and more popular and provides users an immersive experience with a head-mounted display (HMD). However, in some applications, users have to interact with physical objects while immersed in VR. With a non-see-...
VR4UrbanDev: An Immersive Virtual Reality Experience for Energy Data Visualization
VRST '24: Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology

In this demonstration paper, we present our interactive virtual reality (VR) experience, which has been designed to facilitate interaction with energy-related information. This experience consists of two main modes: the world in miniature for large-scale ...

Comments

Information & Contributors

Information

Published In

AHs '23: Proceedings of the Augmented Humans International Conference 2023

March 2023

395 pages

ISBN:9781450399845

DOI:10.1145/3582700

General Chairs:
Jamie A. Ward
Goldsmiths, University of London, United Kingdom
,
Mark McGill
University of Glasgow, United Kingdom
,
Karola Marky
Ruhr-University Bochum, Germany

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2023

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Japan Science and Technology Agency

Conference

AHs '23

AHs '23: Augmented Humans Conference

March 12 - 14, 2023

Glasgow, United Kingdom

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
293
Total Downloads

Downloads (Last 12 months)185
Downloads (Last 6 weeks)21

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sparrow LGalwey CLoveridge BGlasser SOsborne MKelly R(2024)Heart and Soul: The Ethics of Biometric Capture in Immersive Artistic PerformanceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642309(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642309
Park JChoi YLee K(2024)Research Trends in Virtual Reality Music Concert Technology: A Systematic Literature ReviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337206930:5(2195-2205)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372069

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Activities-based virtual reality experience for better audience engagement

Visualizing the keyboard in virtual reality for enhancing immersive experience

VR4UrbanDev: An Immersive Virtual Reality Experience for Energy Data Visualization

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

HTML Format

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations