poster

Immersive VisualAudioDesign: Spectral Editing in VR

Authors:

Rainer GrohAuthors Info & Claims

AM '18: Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion

Article No.: 38, Pages 1 - 4

https://doi.org/10.1145/3243274.3243279

Published: 12 September 2018 Publication History

Abstract

VisualAudioDesign (VAD) is an attempt to design audio in a visual way. The frequency-domain visualized as a spectrogram construed as pixel data can be manipulated with image filters. Thereby, an approach is described to get away from direct DSP parameter manipulation to a more comprehensible sound design. Virtual Reality (VR) offers immersive insights into data and embodied interaction in the virtual environment. VAD and VR combined enrich spectral editing with a natural work-flow. Therefore, a design paper prototype for interaction with audio data in an virtual environment was used and examined.

References

[1]

2014. Historic acoustic-phonetic Collection at the Technische Universität Dresden. http://www.universitaetssammlungen.de/sammlung/687?setLocale=en

[2]

Niels Bogaards and Axel Röbel. 2005. An Interface for Analysis-Driven Sound Processing. In Audio Engineering Society Convention 119.

[3]

Niels Bogaards, Axel Roebel, and Xavier Rodet. 2004. Sound Analysis and Processing with AudioSculpt 2 To cite this version: Sound Analysis and Processing with AudioSculpt 2. International Computer Music Conference (ICMC) Icmc (nov 2004), 1.

[4]

D. A. Bowman and R. P. McMahan. 2007. Virtual Reality: How Much Immersion Is Enough? Computer 40, 7 (July 2007), 36--43.

Digital Library

[5]

Rudolph Darken and Barry Peterson. 2001. Spatial Orientation, Wayfinding, and Representation. In Handbook of Virtual Environment Technology, K Stanney (Ed.). Number November 2001.

[6]

Eduard Deines, Martin Hering-Bertram, Jan Mohring, Jevgenijs Jegorovs, and Hans Hagen. 2010. Audio-visual Virtual Reality System for Room Acoustics. In Scientific Visualization: Advanced Concepts, Hans Hagen (Ed.). Dagstuhl Follow-Ups, Vol. 1. Schloss Dagstuhl--Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 303--320.

[7]

G Eckel. 1992. Manipulation of Sound Signals Based on Graphical Representation-A Musical Point of View. In Proceedings of the International Workshop on Models and Representations of Musical Signals, Capri, Italia.

[8]

Lars Engeln and Rainer Groh. 2017. AudioFlux: A Proposal for interactive Visual Audio Manipulation. In Mensch und Computer 2017 - Workshopband, M. Burghardt, R. Wimmer, C. Wolff, and C. Womser-Hacker (Eds.). Gesellschaft für Informatik e.V., Regensburg.

[9]

Lars Engeln, Dietrich Kammer, Leon Brandt, and Rainer Groh. 2018. Multi-Touch Enhanced Visual Audio-Morphing. In Proceedings of the International Conference on New Interfaces for Musical Expression (in press). Blacksburg, VA, USA.

[10]

Nicolas Gerig, Johnathan Mayo, Kilian Baur, Frieder Wittmann, Robert Riener, and Peter Wolf. 2018. Missing depth cues in virtual reality limit performance and quality of three dimensional reaching movements. PLoS one 13, 1 (2018), e0189275.

[11]

John M Grey and John W Gordon. {n. d.}. Perceptual effects of spectral modifications on musical timbres. 63, 5 ({n. d.}), 1493--1500.

[12]

Rainer Groh. 2017. An Iconography of Interaction (neuerscheinung ed.). TUDpress. 245 pages.

[13]

Marc Hassenzahl and Noam Tractinsky. 2006. User experience-a research agenda. Behaviour & information technology 25, 2 (2006), 91--97.

[14]

Atsuto Inoue, Kohei Yatabe, Yasuhiro Oikawa, and Yusuke Ikeda. 2017. Visualization of 3D Sound Field Using See-through Head Mounted Display. In ACM SIGGRAPH 2017 Posters (SIGGRAPH '17). ACM, New York, NY, USA, Article 34, 2 pages.

Digital Library

[15]

H. G. Kaper, E. Wiebel, and S. Tipei. 1999. Data sonification and sound visualization. Computing in Science Engineering 1, 4 (Jul 1999), 48--58.

Digital Library

[16]

Michael Klingbeil. 2005. Klingbeil, M. (2005). Software for spectral Analysis, Editing, and synthesis. In ICMC.Software for spectral Analysis, Editing, and synthesis. In ICMC.

[17]

Michael Klingbeil. 2012. SPEAR: Sinusoidal Partial Editing Analysis and Resynthesis. retrieved from on Nov 12 (2012), 3.

[18]

Thinh Nguyen-Vo, Bernhard E. Riecke, and Wolfgang Stuerzlinger. 2018. Simulated Reference Frame: A Cost-Effective Solution to Improve Spatial Orientation in VR. IEEE VR (2018).

[19]

Benjamin I Outram. 2016. Synesthesia audio-visual interactive-sound and music visualization in virtual reality with orbital observation and navigation. In Mixed Reality Art (MRA), IEEE International Workshop on. IEEE, 7--8.

[20]

Gemma M. Echevarria Sanchez, Timothy Van Renterghem, Kang Sun, Bert De Coensel, and Dick Botteldooren. 2017. Using Virtual Reality for assessing the role of noise in the audio-visual design of an urban public space. Landscape and Urban Planning 167 (2017), 98--107.

[21]

William A Sethares, Andrew J Milne, Stefan Tiedje, Anthony Prechtl, and James Plamondon. 2009. Spectral Tools for Dynamic Tonality and Audio Morphing. MIT Press - Journals.

[22]

Gerda Strobl, Gerhard Eckel, Davide Rocchesso, and S Le Grazie. 2006. Sound texture modeling: A survey. In Proceedings of the 2006 Sound and Music Computing (SMC) International Conference, Vol. 61. 1--7.

[23]

Ruth West, Max J Parola, Amelia R Jaycen, and Christopher P Lueg. 2015. Embodied information behavior, mixed reality and big data. In The Engineering Reality of Virtual Reality 2015, Vol. 9392. International Society for Optics and Photonics, 93920E.

Cited By

Festa GMelanthiou YMeriano P(2022)Engineering the Metaverse for Innovating the Electronic Business: A Socio-technological PerspectiveBusiness Advancement through Technology Volume II10.1007/978-3-031-07765-4_4(65-86)Online publication date: 12-Dec-2022
https://doi.org/10.1007/978-3-031-07765-4_4

Index Terms

Immersive VisualAudioDesign: Spectral Editing in VR
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Building a Prototype for Easy to Use Collaborative Immersive Analytics
Computational Science – ICCS 2021
Abstract
The increase in the size and complexity of today’s datasets creates a need to develop and experiment with novel data visualization methods. One of these innovations is immersive analytics, in which extended reality technologies such as virtual ...
A Pilot Study Comparing User Interactions Between Augmented and Virtual Reality
Advances in Visual Computing
Abstract
Immersive Analytics (IA) and consumer adoption of augmented reality (AR) and virtual reality (VR) head-mounted displays (HMDs) are both rapidly growing. When used in conjunction, stereoscopic IA environments can offer improved user understanding ...
VRIA - A Framework for Immersive Analytics on the Web
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

We report on the design, implementation and evaluation of <VRIA>, a framework for building immersive analytics (IA) solutions in Web-based Virtual Reality (VR), built upon WebVR, A-Frame, React and D3. The recent emergence of affordable VR interfaces ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '18: Proceedings of the Audio Mostly 2018 on Sound in Immersion and Emotion

September 2018

252 pages

ISBN:9781450366090

DOI:10.1145/3243274

Conference Chair:
Stuart Cunningham,
Program Chair:
Richard Picking

Copyright © 2018 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2018

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

AM'18

AM'18: Sound in Immersion and Emotion

September 12 - 14, 2018

Wrexham, United Kingdom

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
145
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Festa GMelanthiou YMeriano P(2022)Engineering the Metaverse for Innovating the Electronic Business: A Socio-technological PerspectiveBusiness Advancement through Technology Volume II10.1007/978-3-031-07765-4_4(65-86)Online publication date: 12-Dec-2022
https://doi.org/10.1007/978-3-031-07765-4_4

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents