research-article

A toolkit for explorations in sonic interaction design

Authors:

Stefano Delle Monache,

Pietro Polotti,

Davide RocchessoAuthors Info & Claims

AM '10: Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound

Article No.: 1, Pages 1 - 7

https://doi.org/10.1145/1859799.1859800

Published: 15 September 2010 Publication History

Abstract

Physics-based sound synthesis represents a promising paradigm for the design of a veridical and effective continuous feedback in augmented everyday contexts. In this paper, we introduce the Sound Design Toolkit (SDT), a software package available as a complete front-end application, providing a palette of virtual lutheries and foley pits, that can be exploited in sonic interaction design research and education. In particular, the package includes polyphonic features and connectivity to multiple external devices and sensors in order to facilitate the embedding of sonic attributes in interactive artifacts. The present release represents an initial version towards an effective and usable tool for sonic interaction designers.

References

[1]

}}J.-M. Adrien. The missing link: modal synthesis. In G. De Poli, A. Piccialli, and C. Roads, editors, Representations of musical signals, pages 269--298. MIT Press, Cambridge, MA, USA, 1991.

Digital Library

[2]

}}V. T. Ament. The Foley Grail. Focal Press, 2009.

[3]

}}G. Anceschi. Basic Design, fondamenta del design. In G. Anceschi, M. Botta, and M. A. Garito, editors, L'ambiente dell'apprendimento -- Web design e processi cognitivi, pages 57--67. McGraw Hill, Milano, Italia, 2006.

[4]

}}N. Armstrong. An enactive approach to digital musical instrument design. PhD thesis, Princeton University, 2006.

[5]

}}C. Bartneck. Notes on design and science in the HCI community. Design Issues, 25(2):46--61, 2009.

[6]

}}B. Buxton. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann, 2007.

Digital Library

[7]

}}P. R. Cook. Real Sound Synthesis for Interactive Applications. A. K. Peters, Ltd., Natick, MA, USA, 2002.

Digital Library

[8]

}}S. Delle Monache, D. Hug, and C. Erkut. Basic exploration of narration and performativity for sounding interactive commodities. In Proceedings of the 5th International Workshop on Haptic and Audio Interaction Design (HAID), Copenhagen, Denmark, 2010.

Digital Library

[9]

}}S. Delle Monache, P. Polotti, S. Papetti, and D. Rocchesso. Sonically augmented found objects. In Proc. New Interfaces for Musical Expression, pages 154--157, Genova, Italy, 2008.

[10]

}}K. v. d. Doel. Physically based models for liquid sounds. ACM Trans. Appl. Percept., 2(4):534--546, 2005.

Digital Library

[11]

}}P. Dourish. Where the Action Is: The Foundations of Embodied Interaction. MIT Press, Cambridge, Mass., 2001.

Digital Library

[12]

}}C. Drioli, P. Polotti, D. Rocchesso, S. Delle Monache, K. Adiloglu, R. Anniés, and K. Obermayer. Auditory representations as landmarks in the sound design space. In Proc. Conference on Sound and Music Computing, pages 315--320, Port, Portugal, july 2009.

[13]

}}P. Dupont, V. Hayward, B. Armstrong, and F. Altpeter. Single state elasto-plastic friction models. IEEE Trans. Automat. Contr., 47(5):787--792, 2002.

[14]

}}G. Essl and S. O'Modhrain. An enactive approach to the design of new tangible musical instruments. Organised Sound, 11(3):285--296, 2006.

Digital Library

[15]

}}A. Findeli. Rethinking design education for the 21st century: Theoretical, methodological, and ethical discussion. Design Issues, 17(1):5--17, 2001.

[16]

}}K. Franinovic. Toward basic interaction design. Elisava Temes de Disseny Journal, 2009.

[17]

}}K. Franinovic and Y. Visell. Strategies for sonic interaction design: from context to basic design. In Proceedings of the 14th International Conference on Auditory Display, Paris, France, 2008. inproceedings.

[18]

}}W. Gaver, J. Bowers, T. Kerridge, A. Boucher, and N. Jarvis. Anatomy of a failure: how we knew when our design went wrong, and what we learned from it. In CHI '09: Proceedings of the 27th international conference on Human factors in computing systems, pages 2213--2222, New York, NY, USA, 2009. ACM.

Digital Library

[19]

}}W. W. Gaver. What in the world do we hear? an ecological approach to auditory event perception. Ecological Psychology, 5:1--29, 1993.

[20]

}}D. Hug. Investigating narrative and performative sound design strategies for interactive commodities. In S. Ystad, M. Aramaki, R. Kronland-Martinet, and K. Jensen, editors, Auditory Display - 6th International Symposium, CMMR/ICAD 2009, Copenhagen, Denmark, May 18--22, 2009, Revised Papers, volume 5954 of Lecture Notes in Computer Science. Springer, 2010.

Digital Library

[21]

}}A. Jylhä and C. Erkut. A hand clap interface for sonic interaction with the computer. In CHI EA '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, pages 3175--3180, New York, NY, USA, 2009. ACM.

Digital Library

[22]

}}G. Lemaitre, O. Houix, Y. Visell, K. Franinovic, N. Misdariis, and P. S. P. Toward the design and evaluation of continuous sound in tangible interfaces: The spinotron. International Journal of Human-Computer Studies, 67, 2009. Special issue on Sonic Interaction Design, to appear.

Digital Library

[23]

}}E. Lupton and J. C. Phillips. Graphic Design: The New Basics. Princeton Architectural Press, 2008.

[24]

}}D. W. Marhefka and D. E. Orin. A compliant contact model with nonlinear damping for simulation of robotic systems. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 29(6):566--572, 1999.

Digital Library

[25]

}}E. R. Miranda and M. Wanderley. New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series). A-R Editions, Inc., 2006.

Digital Library

[26]

}}P. Polotti, S. Delle Monache, S. Papetti, and D. Rocchesso. Gamelunch: forging a dining experience through sound. In CHI '08: CHI '08 extended abstracts on Human factors in computing systems, pages 2281--2286, New York, NY, USA, 2008. ACM.

Digital Library

[27]

}}M. Rinott and I. Ekman. Using vocal sketching for designing sonic interactions. In to be published in DIS 2010: Proceedings of the Designing Interactive Systems Conference, 2010.

Digital Library

[28]

}}D. Rocchesso, R. Bresin, and M. Fernström. Sounding objects. IEEE Multimedia, 10(2):42--52, april 2003.

Digital Library

[29]

}}D. Rocchesso, P. Polotti, and S. Delle Monache. Designing continuous sonic interaction. International Journal of Design, 3(3), December 2009.

[30]

}}D. Rocchesso, S. Serafin, F. Behrendt, N. Bernardini, R. Bresin, G. Eckel, K. Franinovic, T. Hermann, S. Pauletto, P. Susini, and Y. Visell. Sonic interaction design: sound, information and experience. In CHI '08: CHI '08 extended abstracts on Human factors in computing systems, pages 3969--3972, New York, NY, USA, 2008. ACM.

Digital Library

[31]

}}D. A. Schön. The Reflective Practitioner. Basic Books, London, UK, 1983.

[32]

}}B. Smith and R. Casati. Naive physics: An essay in ontology. Philosphical Psychology, 7(2):225--244, 1994.

[33]

}}J. O. Smith. Principles of digital waveguide models of musical instruments. In M. Kahrs and K. Brandenburg, editors, Applications of Digital Signal Processing to Audio and Acoustics, pages 417--466. Kluwer Academic Publishers, 1998.

[34]

}}E. Stolterman. The nature of design practice and implications for interaction design research. International Journal of Design, 2(1):55--65, April 2008.

[35]

}}P. Susini, N. Misdariis, G. Lemaitre, D. Rocchesso, P. Polotti, K. Franinovic, Y. Visell, and K. Obermayer. Closing the loop of sound evaluation and design. In Proceedings of the 2nd ISCA/DEGA Tutorial and Research Workshop on Perceptual Quality of Systems, Berlin, 2006.

[36]

}}V. Valimaki, J. Pakarinen, C. Erkut, and M. Karjalainen. Discrete-time modelling of musical instruments. Reports on Progress in Physics, 69(1):1--78, January 2006.

[37]

}}K. van den Doel, P. G. Kry, and D. K. Pai. Foleyautomatic: physically-based sound effects for interactive simulation and animation. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 537--544, New York, NY, USA, 2001. ACM.

Digital Library

Cited By

Zorea MKushi K(2024)Empathic Directions for The Sounds of Parenting Technology: The Case of Baby MonitorsProceedings of the 3rd Empathy-Centric Design Workshop: Scrutinizing Empathy Beyond the Individual10.1145/3661790.3661792(8-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3661790.3661792
Kantan PDahl SSerafin SSpaich E(2024)Sonifying gait kinematics: generating water wading sounds through a digital Foley approachPersonal and Ubiquitous Computing10.1007/s00779-024-01829-1Online publication date: 10-Sep-2024
https://doi.org/10.1007/s00779-024-01829-1
Weger MSvoronos-Kanavas IHöldrich R(2022)Schrödinger’s box: an artifact to study the limits of plausibility in auditory augmentationsProceedings of the 17th International Audio Mostly Conference10.1145/3561212.3561222(15-23)Online publication date: 6-Sep-2022
https://dl.acm.org/doi/10.1145/3561212.3561222
Show More Cited By

Index Terms

A toolkit for explorations in sonic interaction design
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Auditory feedback

Recommendations

Form Follows Sound: Designing Interactions from Sonic Memories
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Sonic interaction is the continuous relationship between user actions and sound, mediated by some technology. Because interaction with sound may be task oriented or experience-based it is important to understand the nature of action-sound relationships ...
A review of methods and frameworks for sonic interaction design: exploring existing approaches
CMMR/ICAD'09: Proceedings of the 6th international conference on Auditory Display

This article presents a review of methods and frameworks focused on the early conceptual design of sonic interactions. The aim of the article is to provide novice and expert designers in human computer interaction an introduction to sonic interaction ...
Evaluating a sonic interaction design based on a historic theatre sound effect
Highlights
- Digital modelling of a historical theatre sound effect (acoustic wind machine).
Abstract
This paper reports on the procedure and results of a preliminary experiment to evaluate participants’ perceptual experiences of a mechanical theatre sound effect and its digital counterpart. The theatre sound effect chosen - an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '10: Proceedings of the 5th Audio Mostly Conference: A Conference on Interaction with Sound

September 2010

156 pages

ISBN:9781450300469

DOI:10.1145/1859799

Conference Chair:
Katarina Delsing
The Interactive Institute
,
Program Chair:
Mats Liljedahl
The Interactive Institute

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

The Interactive Institute AB

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AM '10

Sponsor:

AM '10: The 5th Audio Mostly Conference

September 15 - 17, 2010

Piteå, Sweden

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
691
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zorea MKushi K(2024)Empathic Directions for The Sounds of Parenting Technology: The Case of Baby MonitorsProceedings of the 3rd Empathy-Centric Design Workshop: Scrutinizing Empathy Beyond the Individual10.1145/3661790.3661792(8-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3661790.3661792
Kantan PDahl SSerafin SSpaich E(2024)Sonifying gait kinematics: generating water wading sounds through a digital Foley approachPersonal and Ubiquitous Computing10.1007/s00779-024-01829-1Online publication date: 10-Sep-2024
https://doi.org/10.1007/s00779-024-01829-1
Weger MSvoronos-Kanavas IHöldrich R(2022)Schrödinger’s box: an artifact to study the limits of plausibility in auditory augmentationsProceedings of the 17th International Audio Mostly Conference10.1145/3561212.3561222(15-23)Online publication date: 6-Sep-2022
https://dl.acm.org/doi/10.1145/3561212.3561222
Sköld M(2022)The Visual Representation of TimbreOrganised Sound10.1017/S1355771822000541(1-14)Online publication date: 15-Dec-2022
https://doi.org/10.1017/S1355771822000541
Avanzini F(2022)Procedural Modeling of Interactive Sound Sources in Virtual RealitySonic Interactions in Virtual Environments10.1007/978-3-031-04021-4_2(49-76)Online publication date: 14-Oct-2022
https://doi.org/10.1007/978-3-031-04021-4_2
Serafin S(2022)Audio in Multisensory Interactions: From Experiments to ExperiencesSonic Interactions in Virtual Environments10.1007/978-3-031-04021-4_10(305-318)Online publication date: 14-Oct-2022
https://doi.org/10.1007/978-3-031-04021-4_10
Scurto HKerrebroeck BCaramiaux BBevilacqua F(2021)Designing Deep Reinforcement Learning for Human Parameter ExplorationACM Transactions on Computer-Human Interaction10.1145/341447228:1(1-35)Online publication date: 20-Jan-2021
https://dl.acm.org/doi/10.1145/3414472
Passalenti APaisa RNilsson NAndersson NFontana FNordahl RSerafin S(2019)No Strings Attached: Force and Vibrotactile Feedback in a Virtual Guitar Simulation2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR.2019.8798168(1116-1117)Online publication date: Mar-2019
https://doi.org/10.1109/VR.2019.8798168
Kim TCooperstock J(2018)Enhanced Pressure-Based Multimodal Immersive ExperiencesProceedings of the 9th Augmented Human International Conference10.1145/3174910.3174928(1-3)Online publication date: 6-Feb-2018
https://dl.acm.org/doi/10.1145/3174910.3174928
Frid EMoll JBresin RSallnäs Pysander E(2018)Haptic feedback combined with movement sonification using a friction sound improves task performance in a virtual throwing taskJournal on Multimodal User Interfaces10.1007/s12193-018-0264-4Online publication date: 9-May-2018
https://doi.org/10.1007/s12193-018-0264-4
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents