short-paper

Drawing Sound in MR Space: A Multi-User Audiovisual Experience in Mixed Reality Space

Authors:

Ryu Nakagawa,

Ryo Komatsubara,

Taku Ota,

Takahisa MitsumoriAuthors Info & Claims

VRIC '18: Proceedings of the Virtual Reality International Conference - Laval Virtual

Article No.: 20, Pages 1 - 4

https://doi.org/10.1145/3234253.3234309

Published: 04 April 2018 Publication History

Get Access

Abstract

In this study, we propose a multi-user interactive audiovisual art system using mixed reality (MR). In the MR space, participants can draw virtual lines in mid-air to create audiovisual effects. Each drawn line has a moving point object. The moving point object moves repeatedly from the starting to the ending point of a line. When the lines overlap and the points on the lines collide, an audiovisual effect is generated. The sound component of the audiovisual effect is related to the height of the real space. Participants can also move and erase the drawn line objects. Using these effects, participants can "draw sound in MR space."

References

[1]

K. Furukawa, M. Fujihata, and W. Münch. Small Fish, 1999. http://zkm.de/en/publication/small-fish.

Google Scholar

[2]

K. Jo. Draw Sound, 2008/2010. http://www.ntticc.or.jp/ja/feature/2010/Kidsprogram2010/Works/work01_j.html

Google Scholar

[3]

S. Jordà, G. Geiger, M. Alonso, and M. Kaltenbrunner. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces.Proceedings of the 1st international conference on Tangible and embedded interaction (TEI '07). ACM New York. 139--146, 2007.

Digital Library

Google Scholar

[4]

Tmema (Golan Levin and Zachary Lieberman), with Jaap Blonk and Joan La Barbara. Messa di Voce (Installation), 2003.

Google Scholar

[5]

G. Marino, M.H. Serra and J.M. Raczinski, The UPIC System: Origins and Innovations, Perspectives of New Music Vol. 31, No. 1 (Winter, 1993), 258--269, 1993.

Crossref

Google Scholar

[6]

Y. Mori, Symbolization of the human body: Sacred and symbolized hands in premodern Western Europe, Otsuma journal of social information studies 14, 1--29, 2005.

Google Scholar

Cited By

View all

Gruy EBerthaut F(2024)Musical Drawing in 2D and 3D: Dimensions and PerspectivesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678317(181-188)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678317
Baron LWang QSegear SCohn BKim KBarmaki R(2021)Enjoyable Physical Therapy Experience with Interactive Drawing Games in Immersive Virtual RealityProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485285(1-8)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3485279.3485285
Nakagawa RSonobe K(2019)EncountersSIGGRAPH Asia 2019 XR10.1145/3355355.3361886(6-8)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3355355.3361886
Show More Cited By

Index Terms

Drawing Sound in MR Space: A Multi-User Audiovisual Experience in Mixed Reality Space
1. Applied computing
  1. Arts and humanities
    1. Fine arts
    2. Media arts

Recommendations

Encounters: A Multiparticipant Audiovisual Art Experience with XR
SA '19: SIGGRAPH Asia 2019 XR

“Encounters” provides a multiparticipant audiovisual art experience with a cross reality (XR) system which consists of HoloLens units, VIVE Tracker units, SteamVR system and so on. In this experience, participants fire virtual bullets or beams at ...
Air Maestros: A Multi-User Audiovisual Experience Using MR
SUI '18: Proceedings of the 2018 ACM Symposium on Spatial User Interaction

Extended reality (XR) technology challenges practitioners to update the method of representation in art, which our laboratory has been working on as well [2]. Thus, in this demonstration, we present Air Maestros (AM), a multi-user audiovisual experience ...
Encounters 2.0: A Multiparticipant Audiovisual Art Experience with XR
SIGGRAPH '20: ACM SIGGRAPH 2020 Immersive Pavilion

“Encounters” provides a multiparticipant audiovisual art experience with a cross reality (XR) system which consists of HoloLens units, VIVE Tracker units, a SteamVR system and so on. In the experience, participants fire virtual bullets or beams at ...

Comments

Information & Contributors

Information

Published In

VRIC '18: Proceedings of the Virtual Reality International Conference - Laval Virtual

April 2018

173 pages

ISBN:9781450353816

DOI:10.1145/3234253

Conference Chair:
Simon Richir
Arts et Metiers ParisTech, France

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Laval Virtual: Laval Virtual

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

Japan Society for the Promotion of Science

Conference

VRIC '18

VRIC '18: Virtual Reality International Conference - Laval Virtual VRIC '18

April 4 - 6, 2018

Laval, France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
226
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gruy EBerthaut F(2024)Musical Drawing in 2D and 3D: Dimensions and PerspectivesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678317(181-188)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678317
Baron LWang QSegear SCohn BKim KBarmaki R(2021)Enjoyable Physical Therapy Experience with Interactive Drawing Games in Immersive Virtual RealityProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485285(1-8)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3485279.3485285
Nakagawa RSonobe K(2019)EncountersSIGGRAPH Asia 2019 XR10.1145/3355355.3361886(6-8)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3355355.3361886
Nakagawa RKomatsubara ROta TOhmura H(2018)Air MaestrosProceedings of the Symposium on Spatial User Interaction10.1145/3267782.3274685(168-168)Online publication date: 13-Oct-2018
https://dl.acm.org/doi/10.1145/3267782.3274685

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Encounters: A Multiparticipant Audiovisual Art Experience with XR

Air Maestros: A Multi-User Audiovisual Experience Using MR

Encounters 2.0: A Multiparticipant Audiovisual Art Experience with XR

Comments

Information

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations