Article

Articulated paint: musical expression for non-musicians

Authors:

André Knörig,

Boris Müller,

Reto WettachAuthors Info & Claims

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

Pages 384 - 385

https://doi.org/10.1145/1279740.1279826

Published: 06 June 2007 Publication History

Get Access

Abstract

In this paper we present the concept and prototype of a new musical interface that utilizes the close relationship between gestural expression in the act of painting and that of playing a musical instrument in order to provide non-musicians the opportunity to create musical expression. A physical brush on a canvas acts as the instrument. The characteristics of its stroke are intuitively mapped to a conductor program, defining expressive parameters of the tone in real-time. Two different interaction modes highlight the importance of bodily expression in making music as well as the value of a metaphorical visual representation.

References

[1]

Malinowski, S. The Conductor Program. http://www.musanim.com/tapper/

Google Scholar

[2]

Lee, E., et al. 2006. iSymphony: an adaptive interactive orchestral conducting system for digital audio and video streams. In CHI '06 Extd. Abstracts. ACM Press, New York, NY, 259--262.

Digital Library

Google Scholar

[3]

Chew, E., Liu, J., and François, A. R. 2006. ESP: roadmaps as constructed interpretations and guides to expressive performance. In Proc. AMCMM '06. ACM Press, New York, NY, 137--145.

Digital Library

Google Scholar

[4]

Dixon, S., Goebl, W., and Widmer, G. 2005. The "Air Worm": An Interface for Real-Time Manipulation of Expressive Music Performance. In Proc. ICMC '05, 614--617.

Google Scholar

[5]

Rozin, D. 1998. Easel.

Google Scholar

[6]

Ryokai, K., Marti, S., and Ishii, H. 2004. I/O brush: drawing with everyday objects as ink. In Proc. CHI '04. ACM Press, New York, NY, 303--310.

Digital Library

Google Scholar

[7]

Digit. 2004. MotoGlyph.

Google Scholar

[8]

Knörig, A. 2006. Free the body and the mind will follow. Diploma Thesis, Univ. of Applied Sciences Wedel, Germany. http://andreknoerig.de/projects/free-the-body

Google Scholar

[9]

Marrin Nakra, T. 2000. Inside the "Conductor's Jacket": Analysis, Interpretation and Musical Synthesis of Expressive Gesture. Doctoral Thesis, MIT Media Lab.

Digital Library

Google Scholar

[10]

vvvv Group. vvvv. http://www.vvvv.org/

Google Scholar

[11]

Fry, B., Reas, C. Processing. http://www.processing.org

Google Scholar

[12]

Puckette, M. S. Pure Data. http://crca.ucsd.edu/~msp/software.html

Google Scholar

[13]

Trueman, D., DuBois, R. L. PeRColate. http://www.music.columbia.edu/PeRColate/

Google Scholar

Cited By

View all

Gruy EBerthaut F(2024)Musical Drawing in 2D and 3D: Dimensions and PerspectivesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678317(181-188)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678317
Valer RSchramm RNedel L(2020)Musical Brush: Exploring Creativity in an AR-based Tool Combining Music and Drawing Generation2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW50115.2020.00168(634-635)Online publication date: Mar-2020
https://doi.org/10.1109/VRW50115.2020.00168
Wu YBryan-Kinns NShamma DYew JBailey B(2017)Supporting Non-Musicians? Creative Engagement with Musical InterfacesProceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition10.1145/3059454.3059457(275-286)Online publication date: 22-Jun-2017
https://dl.acm.org/doi/10.1145/3059454.3059457
Show More Cited By

Articulated paint: musical expression for non-musicians
1. Applied computing
  1. Arts and humanities

Recommendations

On interface expressivity: a player-based study
NIME '05: Proceedings of the 2005 conference on New interfaces for musical expression

While many new interfaces for musical expression have been presented in the past, methods to evaluate these interfaces are rare. This paper presents a method and a study comparing the potential for musical expression of different string-instrument based ...
Design of a touchless multipoint musical interface in a virtual studio environment
ACE '11: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology

In this paper we describe a system for creating live musical expressions in a virtual studio environment. The underlying concept of this work is to provide casual and semi-professional users with a user experience that allow to easily create musical ...
Composing the digital rainstick
MULTIMEDIA '04: Proceedings of the 12th annual ACM international conference on Multimedia

This paper describes work on a composed instrument, the digital rainstick. The instrument is an acoustic rainstick that is augmented by five sensors that send real time performance data to the computer. A generative mechanism creates sound outputs that ...

Comments

Information & Contributors

Information

Published In

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

June 2007

484 pages

ISBN:9781450378376

DOI:10.1145/1279740

Conference Chairs:
Carol Parkinson
Harvestworks Digital Media Arts Center
,
Eric Singer
LEMUR: League of Electronic Musical Urban Robots

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gruy EBerthaut F(2024)Musical Drawing in 2D and 3D: Dimensions and PerspectivesProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678317(181-188)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678317
Valer RSchramm RNedel L(2020)Musical Brush: Exploring Creativity in an AR-based Tool Combining Music and Drawing Generation2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW50115.2020.00168(634-635)Online publication date: Mar-2020
https://doi.org/10.1109/VRW50115.2020.00168
Wu YBryan-Kinns NShamma DYew JBailey B(2017)Supporting Non-Musicians? Creative Engagement with Musical InterfacesProceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition10.1145/3059454.3059457(275-286)Online publication date: 22-Jun-2017
https://dl.acm.org/doi/10.1145/3059454.3059457
Ichino JPon ASharlin EEagle DCarpendale SLeong T(2014)VuzikProceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design10.1145/2686612.2686649(240-249)Online publication date: 2-Dec-2014
https://dl.acm.org/doi/10.1145/2686612.2686649
LI JNgai GChan SHua KLeong HChan AHua KRui YSteinmetz RHanjalic ANatsev AZhu W(2014)From Writing to PaintingProceedings of the 22nd ACM international conference on Multimedia10.1145/2647868.2654911(57-66)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2647868.2654911
Vandoren PVan Laerhoven TClaesen LTaelman JRaymaekers CVan Reeth F(2008)IntuPaint: Bridging the gap between physical and digital painting2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems10.1109/TABLETOP.2008.4660185(65-72)Online publication date: Oct-2008
https://doi.org/10.1109/TABLETOP.2008.4660185

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

On interface expressivity: a player-based study

Design of a touchless multipoint musical interface in a virtual studio environment

Composing the digital rainstick

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations