Real-time feature-based synthesis for live musical performance
Pages 309 - 312
Abstract
A crucial set of decisions in digital musical instrument design deals with choosing mappings between parameters controlled by the performer and the synthesis algorithms that actually generate sound. Feature-based synthesis offers a way to parameterize audio synthesis in terms of the quantifiable perceptual characteristics, or features, the performer wishes the sound to take on. Techniques for accomplishing such mappings and enabling feature-based synthesis to be performed in real time are discussed. An example is given of how a real-time performance system might be designed to take advantage of feature-based synthesis's ability to provide perceptually meaningful control over a large number of synthesis parameters.
References
[1]
Bencina, R. The Metasurface -- Applying Natural Neighbor Interpolation to Two-to-Many Mapping. In Proceedings of the Conference on New Interfaces for Musical Expression (NIME05) (Vancouver, BC, Canada).
[2]
Hoffman, M., Cook, P. R., Feature-Based Synthesis: Mapping Acoustic and Perceptual Features onto Synthesis Parameters. In Proceedings of the International Computer Music Conference (ICMC '06) (New Orleans, LA, USA, 2006).
[3]
Horner, A., Beauchamp, J., and Haken, L. Machine Tongues XVI: Genetic Algorithms and Their Application to FM Matching Synthesis. Computer Music Journal 17(3) (1993), 17--29.
[4]
Hunt, A. and Kirk, R. Mapping Strategies for Musical Performance -- Trends in Gestural Control of Music. In Trends in Gestural Control of Music, M. Wanderley and M. Battier, eds. Paris, France Institut de Recherche et Coordination Acoustique Musique---Centre Pompidou, 2000, pp. 231--258.
[5]
Janer, J. Voice-Controlled Plucked Bass Guitar Through Two Synthesis Techniques. In Proceedings of the Conference on New Interfaces for Musical Expression (NIME05) (Vancouver, BC, Canada).
[6]
Johnson, C. and Gounaropoulos, A. Timbre Interfaces Using Adjectives and Adverbs. In Proceedings of the Conference on New Interfaces for Musical Expression (NIME06) (Paris, France, 2006).
[7]
Lee, M., and Wessel, D. Connectionist Models for Real-Time Control of Synthesis and Compositional Algorithms. In Proceedings of the International Computer Music Conference (ICMC '92) (San Jose, CA, USA, 1992).
[8]
Loscos, A. and Aussenac, T. The Wahwactor: a Voice Controlled Wah-Wah Pedal. In Proceedings of the Conference on New Interfaces for Musical Expression (NIME05) (Vancouver, BC, Canada).
[9]
Schwarz, D. Current Research in Concatenative Sound Synthesis. In Proceedings of the International Computer Music Conference (ICMC '05) (Barcelona, Spain, 2005).
[10]
Tzanetakis, G. and Cook, P. MARSYAS: a Framework for Audio Analysis. Organized Sound (1999), 4: 169--175.
[11]
Verfaille, V. and Arfib, D. A-DAFX: Adaptive Digital Audio Effects. In Proceedings of the COST G-6 Conference on Digital Audio Effects (DAFx-01) (Limerick, Ireland, December 6--8, 2001).
[12]
Verfaille, V., Boissinot, J., Depalle, Ph., and Wanderley, M. M. SSynth: a Real Time Additive Synthesizer with Flexible Control. In Proceedings of the International Computer Music Conference (ICMC '06) (New Orleans, LA, USA, 2006).
[13]
Wanderley, M., Schnell, N., and Rovan, J. B. Escher - modeling and performing composed instruments in real-time. In Proc. IEEE Int. Conf. Systems, Man, and Cybernetics (SMC'98), (San Diego, USA, 1998) pp. 1080--4.
[14]
Wun, S., Horner, A., and Ayers, L. A Comparison Between Local Search and Genetic Algorithm Methods for Wavetable Matching. In Proceedings of the International Computer Music Conference (ICMC '04) (Miami, FL, USA, 2004
- Real-time feature-based synthesis for live musical performance
Recommendations
Reflexive loopers for solo musical improvisation
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsLoop pedals are real-time samplers that playback audio played previously by a musician. Such pedals are routinely used for music practice or outdoor "busking". However, loop pedals always playback the same material, which can make performances ...
A neural network based interface to real time control musical synthesis processes
ICC'07: Proceedings of the 11th Conference on Proceedings of the 11th WSEAS International Conference on Circuits - Volume 11In this paper, we present an innovative Neural Network system interface that allows an electronic music composer to plan and conduct the musical expressivity of a performer. For musical expressivity we mean all those execution techniques and modalities ...
Kinesonic approaches to mapping movement and music with the remote electroacoustic kinesthetic sensing (RAKS) system
MOCO '15: Proceedings of the 2nd International Workshop on Movement and ComputingSensor technologies allow for a direct link between a dancer's kinetic and kinesthetic experience and musical expression. The Remote electroAcoustic Kinesthetic Sensing (RAKS) system, a wearable wireless sensor interface designed specifically for belly ...
Comments
Information & Contributors
Information
Published In
June 2007
484 pages
Copyright © 2007 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- New York University Music Technology Program
- Harvestworks
- LEMUR: League of Electronic Musical Urban Robots
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 June 2007
Check for updates
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 143Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 23 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in