If you want to learn how to use Max 6 and/or TouchDesigner, or work in audio-visual real-time pro... more If you want to learn how to use Max 6 and/or TouchDesigner, or work in audio-visual real-time processing, this is the book for you. It is intended for intermediate users of both programs and can be helpful for artists, designers, musicians, VJs, and researchers. A basic understanding of audio principles is advantageous.
2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2020
Air traffic control officers (ATCOs) are specialized workers responsible to monitor and guide air... more Air traffic control officers (ATCOs) are specialized workers responsible to monitor and guide airplanes in their assigned airspace. Such a task is highly visual and mainly supported by 2D visualizations. In this paper, we designed and assessed an application for visualizing air traffic in both orthographic (2D) and perspective (3D) views. A user study was then performed to compare these two types of representations in terms of situation awareness, workload, performance, and user acceptance. Results show that the 3D view yielded both higher situation awareness and less workload than the 2D view condition. However, such a performance does not match the opinion of the ATCOs about the 3D representation.
There are several algorithms and approaches to Room Impulse Response (RIR) estimation. To the bes... more There are several algorithms and approaches to Room Impulse Response (RIR) estimation. To the best of the author’s knowledge, there is no documentation of accuracy, speed, or even the feasibility of using signed distance functions (SDFs) in combination with sphere tracing for this task. A proof of concept with a focus on real-time performance is presented here, which still lacks many features such as frequency-dependent absorption and scattering coefficients, arbitrary source and receiver directives etc. The results are then compared to real room impulse responses and to a different simulation algorithm. Also, the rather special merits of such an approach, such as 4D reverberation and simple rounding of geometry, are briefly discussed and presented.
We describe two proof-of-concept approaches on the sonification of estimated operation states and... more We describe two proof-of-concept approaches on the sonification of estimated operation states and conditions focusing on two scenarios: a laboratory setup of a manipulated 3D printer and an industrial setup focusing on the operations of a punching machine. The results of these studies form the basis for the development of an “intelligent” noise protection headphone as part of Cyber Physical Production Systems which provides auditorily augmented information to machine operators and enables radio communication between them. Further application areas are implementations in control rooms (equipped with multi-channel loudspeaker systems) and utilization for training purposes. As a first proof-of-concept, the data stream of error probability estimations regarding partly manipulated 3D printing processes were mapped to three sonification models, providing evidence about momentary operation states. The neural network applied indicates a high accuracy (> 93%) of the error estimation disti...
If you want to learn how to use Max 6 and/or TouchDesigner, or work in audio-visual real-time pro... more If you want to learn how to use Max 6 and/or TouchDesigner, or work in audio-visual real-time processing, this is the book for you. It is intended for intermediate users of both programs and can be helpful for artists, designers, musicians, VJs, and researchers. A basic understanding of audio principles is advantageous.
2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2020
Air traffic control officers (ATCOs) are specialized workers responsible to monitor and guide air... more Air traffic control officers (ATCOs) are specialized workers responsible to monitor and guide airplanes in their assigned airspace. Such a task is highly visual and mainly supported by 2D visualizations. In this paper, we designed and assessed an application for visualizing air traffic in both orthographic (2D) and perspective (3D) views. A user study was then performed to compare these two types of representations in terms of situation awareness, workload, performance, and user acceptance. Results show that the 3D view yielded both higher situation awareness and less workload than the 2D view condition. However, such a performance does not match the opinion of the ATCOs about the 3D representation.
There are several algorithms and approaches to Room Impulse Response (RIR) estimation. To the bes... more There are several algorithms and approaches to Room Impulse Response (RIR) estimation. To the best of the author’s knowledge, there is no documentation of accuracy, speed, or even the feasibility of using signed distance functions (SDFs) in combination with sphere tracing for this task. A proof of concept with a focus on real-time performance is presented here, which still lacks many features such as frequency-dependent absorption and scattering coefficients, arbitrary source and receiver directives etc. The results are then compared to real room impulse responses and to a different simulation algorithm. Also, the rather special merits of such an approach, such as 4D reverberation and simple rounding of geometry, are briefly discussed and presented.
We describe two proof-of-concept approaches on the sonification of estimated operation states and... more We describe two proof-of-concept approaches on the sonification of estimated operation states and conditions focusing on two scenarios: a laboratory setup of a manipulated 3D printer and an industrial setup focusing on the operations of a punching machine. The results of these studies form the basis for the development of an “intelligent” noise protection headphone as part of Cyber Physical Production Systems which provides auditorily augmented information to machine operators and enables radio communication between them. Further application areas are implementations in control rooms (equipped with multi-channel loudspeaker systems) and utilization for training purposes. As a first proof-of-concept, the data stream of error probability estimations regarding partly manipulated 3D printing processes were mapped to three sonification models, providing evidence about momentary operation states. The neural network applied indicates a high accuracy (> 93%) of the error estimation disti...
Uploads