research-article

Mixed reality immersive design: a study in interactive dance

Authors:

Rodrigo Carvalho,

Sebastian KoxAuthors Info & Claims

ImmersiveMe '13: Proceedings of the 2013 ACM international workshop on Immersive media experiences

Pages 45 - 50

https://doi.org/10.1145/2512142.2512147

Published: 22 October 2013 Publication History

Abstract

Dance performance interconnects the notion of space and movement, providing therefore the ideal framework to design and research immersive relations between the virtual and physical world: mixed reality performance. We start by discussing conceptual approaches to immersive and mixed reality environments, and reporting some of the current state of the art solutions.

We developed two proof-of-concept systems and frameworks to implement the use of spatial augmented reality applied to dance performance. Our systems establish a real time dialogue and interaction between 3D geometry and perspective grids calculations with body movement. We also present our framework design and implementation of our system, outlining relevant problems and solutions we find in the process.

Finally, the frameworks and design processes were validated through a field experiment - the performance - after which we gathered and analyzed the feedback from the performers, the audience and the choreographer.

Supplementary Material

ZIP File (ime05.zip)

Images (jpeg format)

Download
7.61 MB

References

[1]

Krueger, M. (1977). "Responsive Enviroments". In Packer, R., Jordan, K. "MULTIMEDIA, From Wagner to Virtual Reality". New York: Norton&Company; (2002). ISBN {0-393-04979-5}. pp.105--118.

[2]

Sutherland, I. (1965). "The Ultimate Display". In "Proceedings of IFIP Congress 1965". pp. 506--508.

[3]

Gibson, W. (1984). "Neuromante". Lisboa, Gravida.ISBN {972-662-084-8}.

[4]

Manovich, L. (2002) "The poetics of augmented space". {http://www.manovich.net}.Accessed 24.06.2013

[5]

Gibson, W. (2010). interviewed by Steve Paikin. In "The Agenda: The new Cyber/Reality". {www.youtube.com/watch?v=WVEUWfDHqsU}. Accessed in 24.06.2013.

[6]

Davies, C. (1997). "Changing Space: Virtual Reality as an Arena of Embodied Being". In Packer, R., Jordan, K. "MULTIMEDIA, From Wagner to Virtual Reality". New York: Norton&Company; (2002). ISBN {0-393-04979-5}. pp.293--300.

[7]

Clay, A., Couture, N., Nigay, L., Rivière, J., Martin, J., Courgeon, M., Desainte C., M., Orvai, E., Girondel, V., Domenger, G. (2012). "Interactions and systems for augmenting a live dance performance", in "ISMAR 2012 - International Symposium on Mixes and Augmented Reality", Atlanta, GA : United States.

[8]

OJanen, M., Souminen,J.,Kallio, T.,Lassfolk, J.(2007). "Design Principles and User Interfaces of Erkki Kurenniemi's Electronic Musical Instruments of the 1960?s and 1970's", in "Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07)" New York, NY, USA.

Digital Library

[9]

Kurenniemi, E.(1971) "DIMI-Ballet". in Taanile, M. (2002) "The Dawn of Midi" DVD.

[10]

Roekeby, D. (1986). "Very Nervous System" project report. {http://www.davidrokeby.com/vns.html}. Accessed 24.06.2013

[11]

Levin, G., Lieberman, Z. (2003) "Messa di Voce" project report. {http://www.tmema.org/messa/messa.html}. Accessed 24.06.2013.

[12]

Obermaier, K. (2006) "Le Sacre Du Printemps" project report. {http://www.exile.at/sacre/}. Accessed 24.06.2013.

[13]

Obermaier, K. (2004--2013) "Apparition" project report. {http://www.exile.at/apparition/}. Accessed 24.06.2013.

[14]

Recoil Performance Group (2008). "Body Navigation" project report. {http://www.recoil-performance.org/productions/body-navigation}. Accessed 24.06.2013.

[15]

Anarchy Dance Theatre, Ultra Combos (2011). "Seventh Sense". {http://anarchydancetheatre.org/en/project/seventh-sense/}.Accessed 24.06.2013.

[16]

RAM Dance toolkit. {http://interlab.ycam.jp/en/projects/ram/about_ram}.Accessed 24.06.2013.

[17]

Dixon, S. (2007). "Digital Performance. A History of New Media in Theater, Dance, Performance Art, and Installation". Massachusets: MIT Press. ISBN {780262042352}. p.147.

[18]

Bimber, O., Raskar, R. (2005). "Spacial Augmented Reality. Merging Real and Virtual Worlds". Wellesley, A K Peters. ISBN {ISBN 1-56881-230-2}. pp.7--8.

Digital Library

[19]

Ibid., p. 214.

[20]

Brett, J., Hrvoje, B., Eyal, O., Andy, W. (2013) "IllumiRoom: Peripheral Projected Illusions for Interactive Experiences", University of Illinois at Urbana-Champaign, ACM.

[21]

Milgram, P., Takemura, H., Utsumi, A., Kishino, F. (1994). "Augmented Reality: A class of displays on the reality-virtuality continuum". In "SPIE Vol. 2351, Telemanipulator and Telepresence Technologies" (1994). pp. 289--292.

[22]

Benford, S.; Giannachi, G. (2011). "Performing Mixed Reality", MIT. ISBN {978-0-262-01576-9}.

Digital Library

[23]

Cube Mapping technique. {http://en.wikipedia.org/wiki/Cube_mapping}. Accessed 24.06.2013.

[24]

Ni Mate, Real Time Motion capture. {http://www.ni-mate.com/}. Accessed 24.06.2013.

[25]

Mulder, A. (1994). "Human Movement Tracking Technology". Technical Report, NSERC Hand Centered Studies of Human Movement project,Canada: Simon Fraser University.

[26]

Wanderley M., Rovan J.et al. (1997). "Instrumental Gestural Mapping Strategies as Expressivity". IRCAM. Paris.

[27]

Quartz Composer. {https://developer.apple.com/technologies/mac/graphics-and-animation.html}

[28]

Syphon. {http://syphon.v002.info/}. Accessed 25.06.2013.

[29]

Madmapper. {http://www.madmapper.com/}. Accessed 25.06.2013.

[30]

1024 Perspective Plugin. {http://1024d.wordpress.com/}. Accessed 25.06.2013.

[31]

Butoh Dance, {http://en.wikipedia.org/wiki/Butoh}. Accessed 25.06.2013.

[32]

Unity3d Software, {http://unity3d.com/}.Accessed 25.06.2013.

[33]

3DVIA Studio Pro {http://www.3ds.com/}. Accessed 25.06.2013

Cited By

LC RLiu SLyu QEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)IN/ACTive: A Distance-Technology-Mediated Stage for Performer-Audience Telepresence and Environmental ControlProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613791(6989-6997)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3613791
Carlson KIrannezhad ZCarney L(2022)DesquamationProceedings of the 8th International Conference on Movement and Computing10.1145/3537972.3538012(1-3)Online publication date: 22-Jun-2022
https://dl.acm.org/doi/10.1145/3537972.3538012
Ландяк О(2021)СПЕЦИФІКА ВТІЛЕННЯ АРТ-ПРАКТИК ЗМІШАНОЇ РЕАЛЬНОСТІ В НОВОМУ МЕДІЙНОМУ МИСТЕЦТВІМолодий вчений10.32839/2304-5809/2021-2-90-20(104-108)Online publication date: 26-Feb-2021
https://doi.org/10.32839/2304-5809/2021-2-90-20
Show More Cited By

Index Terms

Mixed reality immersive design: a study in interactive dance
1. Information systems

Recommendations

Understanding Users' Capability to Transfer Information between Mixed and Virtual Reality: Position Estimation across Modalities and Perspectives
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Mixed Reality systems combine physical and digital worlds, with great potential for the future of HCI. It is possible to design systems that support flexible degrees of virtuality by combining complementary technologies. In order for such systems to ...
Augmented Objects as Portals into Virtual Worlds:Using Audio to Create Immersive Experiences in Extended Realities
AM '22: Proceedings of the 17th International Audio Mostly Conference

Building on a long history of the integration of new technology into the arts, in this research we set out to develop and evaluate new methods for creating immersive, audio-centric artworks in a Mixed Reality (MR) context. We employ multiple levels of ...
IllumiRoom: peripheral projected illusions for interactive experiences
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

IllumiRoom is a proof-of-concept system that augments the area surrounding a television with projected visualizations to enhance traditional gaming experiences. Our system demonstrates how projected visualizations in the periphery can negate, include, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ImmersiveMe '13: Proceedings of the 2013 ACM international workshop on Immersive media experiences

October 2013

68 pages

ISBN:9781450324021

DOI:10.1145/2512142

Program Chairs:
Teresa Chambel
Lasige, Fac of Sciences, Univ of Lisbon, Portugal
,
V. Michael Bove
MIT Media Lab, USA
,
Sharon Strover
University of Texas at Austin, USA
,
Paula Viana
Polytechnic of Porto and INESC TEC, Portugal
,
Graham Thomas
BBC, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM '13

Sponsor:

SIGMM

MM '13: ACM Multimedia Conference

October 22, 2013

Barcelona, Spain

Acceptance Rates

ImmersiveMe '13 Paper Acceptance Rate 6 of 19 submissions, 32%;

Overall Acceptance Rate 11 of 31 submissions, 35%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
583
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

LC RLiu SLyu QEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)IN/ACTive: A Distance-Technology-Mediated Stage for Performer-Audience Telepresence and Environmental ControlProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613791(6989-6997)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3613791
Carlson KIrannezhad ZCarney L(2022)DesquamationProceedings of the 8th International Conference on Movement and Computing10.1145/3537972.3538012(1-3)Online publication date: 22-Jun-2022
https://dl.acm.org/doi/10.1145/3537972.3538012
Ландяк О(2021)СПЕЦИФІКА ВТІЛЕННЯ АРТ-ПРАКТИК ЗМІШАНОЇ РЕАЛЬНОСТІ В НОВОМУ МЕДІЙНОМУ МИСТЕЦТВІМолодий вчений10.32839/2304-5809/2021-2-90-20(104-108)Online publication date: 26-Feb-2021
https://doi.org/10.32839/2304-5809/2021-2-90-20
Pennefather PKrebs CSaroyan J(2020)Reimagining the Audience-Dancer Relationship Through Mobile Augmented RealityMultidisciplinary Perspectives on New Media Art10.4018/978-1-7998-3669-8.ch006(119-141)Online publication date: 26-Jun-2020
https://doi.org/10.4018/978-1-7998-3669-8.ch006
Rzezonka AFernaeus YMcMillan DJonsson MGirouard ATholander J(2018)Choreographic Computational CompositesProceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3173225.3173342(715-717)Online publication date: 18-Mar-2018
https://dl.acm.org/doi/10.1145/3173225.3173342
Son HShin SChoi SKim SKim J(2018)Interacting Automultiscopic 3D With Haptic Paint Brush in Immersive RoomIEEE Access10.1109/ACCESS.2018.28838216(76464-76474)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2883821
Kim JShin SChoi SYoo Y(2016)Multimodal Interaction on Automultiscopic Content with Mobile Surface HapticsETRI Journal10.4218/etrij.16.2716.004838:6(1085-1094)Online publication date: 1-Dec-2016
https://doi.org/10.4218/etrij.16.2716.0048

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents