Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1178823.1178855acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
Article

From driving to expressive music performance: ensuring tempo smoothness

Published: 14 June 2006 Publication History

Abstract

This paper focuses on the mapping strategies in the interface design for the Expression Synthesis Project (ESP). The goal of ESP is to use the metaphor of driving to allow non-experts to interactively create expressive renderings of music pieces. In ESP, the road represents the music, with bends and straight segments representing places where one might slow down and speed up respectively. The user controls the tempo (rate of beats) and dynamics (amplitude) by the way s/he drives through the road. Our design objective in the ESP environment is to define mapping strategies that guarantee tempo smoothness, a hallmark of expert and practiced performances, under all driving conditions. Because the road has non-zero width, several strategies exist for mapping the car's position on the road to the musical score. We propose mapping strategies that ensure tempo smoothness, and provide mathematical and empirical proofs for the success of these strategies.

References

[1]
Car Physics for Games, Marco Monster. http://home.planet.nl/~monstrous/tutcar.html
[2]
Cambouropoulos, E., Dixon, S., Goebl, W. and Widmer, G. Human Preferences for Tempo Smoothness. In Proceedings of the VIII Brazilian Symposium on Computer Music (Fortaleza, Brazil, 2001)
[3]
Chew, Elaine, Alexandre François, Jie Liu and Aaron Yang. ESP: A Driving Interface for Musical Expression Synthesis. Conference on New Interfaces for Musical Expression, Vancouver, B. C., Canada, May 26--28, 2005.
[4]
Edwards, B., Player Piano History and Evolution. http://www.perfessorbill.com/ragtime5.shtml
[5]
Expression Synthesis Project, http://www-rcf.usc.edu/~mucoaco/ESP/
[6]
François, A. R. J. A Hybrid Architectural Style for Distributed Parallel Processing of Generic Data Streams. In Proceedings of the International Conference on Software Engineering (ICSE '04) (Edinburgh, Scotland, May 2004). pp. 367--376
[7]
François A. R. J. Modular Flow Scheduling Middleware (MFSM), 2001. mfsm.sourceforge.net
[8]
Friberg, A. (1991). Generative Rules for Music Performance: A Formal Description of a Rule System. Computer Music Journal, Vol.15 No.2, pp.56--71
[9]
Harris, M. C., Exploring smoothness and discontinuities in human motor behavior with Fourier analysis, Mathematical Biosciences, 188 (2004), p99--116.
[10]
Hatwal, H. and Mikulcik. E. C. Some Inverse Solutions to an Automobile Path-Tracking Problems with Input Control of Steering and Brakes, Vehicle System Dynamics 15 (1986), 61--71
[11]
Hu, Z., Barnard, E., Smoothness Analysis For Trajectory Features, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'97), Volume 2 p. 979
[12]
Katayose, H., and Keita, O. Using an Expressive Performance Template in a Music Conducting Interface. In Proceedings of the 2004 Conference on New Instruments for Musical Expression (NIME'2004) (Hamamatsu, Japan, June 3-5, 2004)
[13]
Krylow, M. Andrew, Rymer, Zev, W., Role of Intrinsic Muscle Properties in Producing Smooth Movements, IEEE Transactions on Biomedical Engineering, Vol. 44, No. 2, February. 1997
[14]
Lee, E., Nakra, M. T., and Borchers, J. You're The Conductor: A Realistic Interactive Conducting System for Children. In Proceedings of the 2004 Conference on New Instruments for Musical Expression (NIME'2004) (Hamamatsu, Japan, June 3-5, 2004)
[15]
Modler, P., Myatt, T., and Saup, M. An Experimental Set of Hand Gestures for Expressive Control of Musical Parameters in Realtime. In Proceedings of the 2003 Conference on New Interfaces for Musical Expression (NIME'2003) (Montreal, Canada).
[16]
Murphy, D., Andersen, T. H., Jensen, K. Conducting Audio Files via Computer Vision. In Proceedings of Gesture Workshop (Genova, Italy, April 15-17 2003)
[17]
Sundberg, J., Friberg, A., and Bresin, R. Attempts to Reproduce a Pianist's Expressive Timing with Director Musices Performance Rules. Journal of New Musical Research 32, 3 (2003), 317--325.
[18]
Sundberg, J., Friberg, A. and Fryden, L., Music and locomotion. A study of the perception of tones with level envelopes replicating force patterns of walking. Speech Transmission Laboratory Quarterly Progress and Status Report, 4/1992, pp. 109--122.
[19]
Todd, P. M. N, The kinematics of musical expression. Journal of the Acoustical Society of America, March 1995, Vol.97, Issue 3, pp.1940--1949
[20]
Todorov, E. and Jordan, I. M., Smoothness Maximization Along a Predefined Path Accurately Predicts the Speed Profiles of Complex Arm Movements, The Journal of Neurophysiology, Vol. 80, No. 2, August 1998, pp696--714
[21]
Widmer, G., Discovering simple rules in complex data: A meta-learning algorithm and some surprising musical discoveries. Artificial Intelligence, 146, 129--148.
[22]
Widmer, G., and Tobudic, A. Playing Mozart by analogy: learning multi-level timing and dynamics strategies. Journal of new Music Research, 32, 259--268.
[23]
Xu, Y., Song, J., Nechyba, C. M., and Yam, Y. Performance evaluation and optimization of human control strategy. Robotics and Autonomous Systems, 39(2002), 19--36
[24]
Zanon, P., and De Poli, G., Estimation of parameters in rule system for expressive rendering of musical performance. Computer Music Journal, 27(2003), 29--46.
[25]
Zanon, P., and De Poli, G., Time-varying estimation of parameters in rule systems for music performance. Journal of New Music Research, 32(2003), 295--315.

Cited By

View all
  • (2024)Evaluation of several gaze control methods for a board game with no time pressureProcedia Computer Science10.1016/j.procs.2023.10.237225:C(2457-2466)Online publication date: 4-Mar-2024
  • (2014)Music interaction with others as conveyor of relational intent: A response to Cross (2014)Psychology of Music10.1177/030573561454940742:6(826-838)Online publication date: 13-Nov-2014
  • (2012)MelodicBrushProceedings of the Designing Interactive Systems Conference10.1145/2317956.2318018(418-427)Online publication date: 11-Jun-2012

Index Terms

  1. From driving to expressive music performance: ensuring tempo smoothness

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology
    June 2006
    572 pages
    ISBN:1595933808
    DOI:10.1145/1178823
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 June 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. driving interface
    2. minimum jerk model
    3. music performance rendering
    4. musical expression
    5. tempo smoothness
    6. virtual environment

    Qualifiers

    • Article

    Conference

    ACE2006
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 36 of 90 submissions, 40%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 03 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Evaluation of several gaze control methods for a board game with no time pressureProcedia Computer Science10.1016/j.procs.2023.10.237225:C(2457-2466)Online publication date: 4-Mar-2024
    • (2014)Music interaction with others as conveyor of relational intent: A response to Cross (2014)Psychology of Music10.1177/030573561454940742:6(826-838)Online publication date: 13-Nov-2014
    • (2012)MelodicBrushProceedings of the Designing Interactive Systems Conference10.1145/2317956.2318018(418-427)Online publication date: 11-Jun-2012

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media