Abstract
This paper describes an approach for a system which analyses an orchestra conductor in real-time, with the purpose of using the extracted information of time pace and expression for an automatic play of a computer-controlled instrument (synthesizer). The system in its final stage will use non-intrusive computer vision methods to track the hands of the conductor. The main challenge is to interpret the motion of the hand/baton/mouse as beats for the timeline. The current implementation uses mouse motion to simulate the movement of the baton. It allows to “conduct” a pre-stored MIDI file of a classical orchestral music work on a PC.
Chapter PDF
Similar content being viewed by others
References
Xenakis, I.: Musiques Formelles (1963), reprinted Paris, Stock (1981)
Doornbusch, P.: The Music of CSIRAC, Australia’s first computer music. Common Ground (2005)
Heckroth, J.: Tutorial on MIDI and Music Synthesis. MIDI Manufacturers Association Inc. (2001) (accessed 12 February, 2007), http://www.midi.org/about-midi/tutorial/tutor.shtml
Dannenberg, R.B.: Music Understanding by Computer. 1987/88 Computer Science Research Review, Carnegie Mellon School of Computer science, pp. 19–28 (1988)
Bolas, M., Stone, P.: Virtual mutant theremin. In: Int. Computer Music Conference, San Jose, CA, USA, pp. 360–361 (1992)
Theremin World: (accessed 14 February, 2007), http://www.thereminworld.com/software.asp
Vienna Symphonic Library: (accessed 15 February, 2007), http://www.vsl.co
Garritan Orchestral Libraries: (accessed 15 February, 2007), http://www.garritan.com
Mathews, M.V., Rosler, L.: Graphical Language for the Scores of Computer-Generated Sound. In: Perspectives of New Music, pp. 92–118 (1968)
Boulanger, R.C., Mathews, M.V.: The 1997 Mathews radio-baton and improvisation modes. In: Proc. of ICMC 1997, Thessaloniki (1997)
Brill, L.M.: A Microcomputer based conducting system. Computer Music Journal 4(1), 8–21 (1980)
Haflich, F., Burnds, M.: Following a Conductor: the Engineering of an Input Device. In: Proc. of the 1983 International Computer Music Conference, San Francisco (1983)
Marrin Nakra, T.: Immersion Music: A Progress Report. 2003. In: Int. Conf. On New Interfaces for Musical Expression (NIME), May 22-24, Montreal (2003)
Paradiso, J.A.: The Brain Opera Technology: New Instruments and Gestural Sensors for Musical Interaction and Performance. Journal of New Music Research 28(2), 130–149 (1998)
Marrin Nakra, T., Paradiso, J.A.: The Digital Baton: a Versatile Performance Instrument. In: Proc. of the 1997 International Computer Music Conference, San Francisco, pp. 313–316 (1997)
Marrin, T.A.: Towards an Understanding of Musical Gesture: Mapping Expressive Intention with the Digital Baton. MSc thesis, MIT, Boston (1996)
Schertenlaib, S., Gutierrez, M., Vexo, V., Thalmann, D.: Conducting a virtual orchestra. IEEE Multimedia 11(3), 40–49 (2004)
Borchers, J.O., Samminger, W., Mühlhäuser, M.: Personal Orchestra: conducting audio/video music recordings. In: Proc. of Wedelmusic, Darmstadt (2002)
Rovan, J.B., Wanderley, M.M., Dubnov, S., Depalle, P.: Instrumental Gestural Mapping Strategies as Expressivity Determinants in Computer Music Performance. In: Wanderley, M., Battier, M. (eds.) Trends in Gestural Control of Music, Ircam, Paris (2000)
Hunt, A., Wanderley, M.M., Paradis, M.: The importance of parameter mapping in electronic instrument design. In: Proc. of the 2002 Conference on New Instruments for Musical Expression (NIME), Dublin, Ireland (2002)
Green, E.A.H.: The Modern Conductor, 6th edn. Prentice Hall, Upper Saddle River, New Jersey (1997)
Vercoe, B.: Teaching your computer how to play by ear. In: Proc. of 3rd Symposium on Arts and Technology (1991)
Dannenberg, R.B., Grubb, L.: Automated accompaniment of musical ensembles. In: Proc. of the 12th National Conference on Artificial Intelligence, AAAI, pp. 94–99 (1994)
Behringer, R.: Conducting Digitally Stored Music by Computer Vision Tracking. In: 1st Int. Conf. on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS), Florence (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Behringer, R. (2007). Gesture Interaction for Electronic Music Performance. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. HCI 2007. Lecture Notes in Computer Science, vol 4552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73110-8_61
Download citation
DOI: https://doi.org/10.1007/978-3-540-73110-8_61
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73108-5
Online ISBN: 978-3-540-73110-8
eBook Packages: Computer ScienceComputer Science (R0)