research-article

Open access

Conceptualising sound-driven design: an exploratory discourse analysis

Authors:

Stefano Delle Monache,

Nicolas MISDARIIS, and

Elif OzcanAuthors Info & Claims

C&C '21: Proceedings of the 13th Conference on Creativity and Cognition

June 2021

Article No.: 42, Pages 1 - 8

https://doi.org/10.1145/3450741.3465258

Published: 22 June 2021 Publication History

All formats PDF

Abstract

Sound-driven design is an emerging, human-centered design practice informed by technology and listening in the multisensory dimension of interaction. In this paper we present a discourse analysis approach aimed at qualitatively understanding the constituent concepts of such a practice, by means of semi-structured interviews with sound designers, design researchers, engineers and expert users in the context of critical care. Preliminary results show that sound-driven design is inherently embodied, situated, and participatory, that the four categories of interviewees equally contribute to the definition of the design problem, and yet that a clear, shared arena is still missing.

References

[1]

Anna Barney and Salomé Voegelin. 2018. Collaboration and consensus in Listening. Leonardo Music Journal 28 (2018), 82–87. https://doi.org/10.1162/lmj_a_01046

[2]

Marguerite Barry and Gavin Doherty. 2017. What we talk about when we talk about interactivity: Empowerment in public discourse. New Media & Society 19, 7 (2017), 1052–1071. https://doi.org/10.1177/1461444815625944

[3]

Dilip Birdja and Elif Özcan. 2019. Better Sleep Experience for the Critically Ill: A Comprehensive Strategy for Designing Hospital Soundscapes. Multimodal Technologies and Interaction 3, 2 (2019). https://doi.org/10.3390/mti3020036

[4]

Kendall Burdick, Madison Courtney, Mark T. Wallace, Sarah H. Baum Miller, and Joseph J. Schlesinger. 2019. Living and working in a multisensory world: From basic neuroscience to the hospital. Multimodal Technologies and Interaction 3, 1 (2019). https://doi.org/10.3390/mti3010002

[5]

Maxime Carron, Thomas Rotureau, Françoise Dubois, Nicolas Misdariis, and Patrick Susini. 2017. Speaking about sounds: a tool for communication on sound features. Journal of Design Research 15, 2 (2017), 85–109. https://doi.org/10.1504/JDR.2017.086749

[6]

Senthil Chandrasegaran, Sriram Karthik Badam, Lorraine Kisselburgh, Kylie Peppler, Niklas Elmqvist, and Karthik Ramani. 2017. VizScribe: A visual analytics approach to understand designer behavior. International Journal of Human-Computer Studies 100 (2017), 66–80. https://doi.org/10.1016/j.ijhcs.2016.12.007

[7]

Stefano Delle Monache and Davide Rocchesso. 2019. Exploring design cognition in voice-driven sound sketching and synthesis. In Proceedings of the 14th International Symposium on Computer Music Multidisciplinary Research (Marseille, France), M. Aramaki, O. Derrien, R. Kronland Martinet, and S. Ystad(Eds.). Laboratory PRISM, Marseille, France, 157–169.

[8]

Stefano Delle Monache, Davide Rocchesso, Frédéric Bevilacqua, Guillaume Lemaitre, Stefano Baldan, and Andrea Cera. 2018. Embodied sound design. International Journal of Human-Computer Studies 118 (2018), 47 – 59. https://doi.org/10.1016/j.ijhcs.2018.05.007

[9]

Ozgur Eris, Nikolas Martelaro, and Petra Badke-Schaub. 2014. A comparative analysis of multimodal communication during design sketching in co-located and distributed environments. Design Studies 35, 6 (2014), 559–592. https://doi.org/10.1016/j.destud.2014.04.002

[10]

Omid Ettehadi, Lee Jones, and Kate Hartman. 2020. Heart Waves: A Heart Rate Feedback System Using Water Sounds. In Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction(Sydney NSW, Australia) (TEI ’20). Association for Computing Machinery, New York, NY, USA, 527–532. https://doi.org/10.1145/3374920.3374982

Digital Library

[11]

Kjetil Falkenberg, Adrian Benigno Latupeirissa, Hans Lindetorp, and Emma Frid. 2020. Creating digital musical instrument with and for children: including vocal sketching as method for engaging in co-design. Human Technology 16, 3 (2020), 348—371. https://doi.org/10.17011/ht/urn.202011256768

[12]

Daniel Fallman. 2007. Why research-oriented design isn’t design-oriented research: On the tensions between design and research in an implicit design discipline. Knowledge, Technology & Policy 20, 3 (2007), 193–200. https://doi.org/10.1007/s12130-007-9022-8

[13]

Michael (Ed.) Filimowicz. 2019. Foundations in Sound Design for Embedded Media, A Multidisciplinary Approach. Routledge, New York, USA. https://doi.org/10.4324/9781315106359

[14]

John S. Gero and Julie Milovanovic. 2020. A framework for studying design thinking through measuring designers’ minds, bodies and brains. Design Science 6(2020), e19. https://doi.org/10.1017/dsj.2020.15

[15]

Ashok K. Goel, Swaroop Vattam, Bryan Wiltgen, and Michael Helms. 2012. Cognitive, collaborative, conceptual and creative — Four characteristics of the next generation of knowledge-based CAD systems: A study in biologically inspired design. Computer-Aided Design 44, 10 (2012), 879–900. https://doi.org/10.1016/j.cad.2011.03.010 Fundamentals of Next Generation CAD/E Systems.

Digital Library

[16]

Laura Hay, Philip Cash, and Seda McKilligan. 2020. The future of design cognition analysis. Design Science 6(2020), e20. https://doi.org/10.1017/dsj.2020.20

[17]

Laura Hay, Alex H. B. Duffy, Chris McTeague, Laura M. Pidgeon, Tijana Vuletic, and Madeleine Grealy. 2017. A systematic review of protocol studies on conceptual design cognition: Design as search and exploration. Design Science 3(2017), e10. https://doi.org/10.1017/dsj.2017.11

[18]

Tobias Hildebrandt, Thomas Hermann, and Stefanie Rinderle-Ma. 2016. Continuous sonification enhances adequacy of interactions in peripheral process monitoring. International Journal of Human-Computer Studies 95 (2016), 54–65. https://doi.org/10.1016/j.ijhcs.2016.06.002

Digital Library

[19]

Kasper Hornbæk, Aske Mottelson, Jarrod Knibbe, and Daniel Vogel. 2019. What Do We Mean by “Interaction”? An Analysis of 35 Years of CHI. ACM Trans. Comput.-Hum. Interact. 26, 4, Article 27 (July 2019), 30 pages.

Digital Library

[20]

Maarten Houben, Rens Brankaert, Saskia Bakker, Gail Kenning, Inge Bongers, and Berry Eggen. 2020. The Role of Everyday Sounds in Advanced Dementia Care. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376577

Digital Library

[21]

Daniel Hug. 2020. How Do You Sound Design? An Exploratory Investigation of Sound Design Process Visualizations. In Proceedings of the 15th International Conference on Audio Mostly (Graz, Austria) (AM ’20). Association for Computing Machinery, New York, NY, USA, 114–121. https://doi.org/10.1145/3411109.3411144

Digital Library

[22]

Markus Kiefer and Marcel Harpaintner. 01 Jan. 2020. Varieties of abstract concepts and their grounding in perception or action. Open Psychology 2, 1 (01 Jan. 2020), 119 – 137. https://doi.org/10.1515/psych-2020-0104

[23]

Lau Langeveld, René van Egmond, Reinier Jansen, and Elif Özcan. 2013. Product sound design: Intentional and consequential sounds. In Advances in industrial design engineering, Denis A. Coelho (Ed.). InTech Croatia, 45–73. https://doi.org/10.5772/55274

[24]

Marc Leman, Federico Avanzini, Alain de Cheveigne, and Emmanuel Bigand. 2007. The societal contexts for sound and music computing: Research, education, industry, and socio-culture. Journal of New Music Research 36, 3 (2007), 149–167. https://doi.org/10.1080/09298210701859164

[25]

Nicolas Misdariis, Andrea Cera, and William Rodriguez. 2019. Electric and Autonomous Vehicle: from Sound Quality to Innovative Sound Design. In Proceedings of the 23rd International Congress on Acoustics, Martin Ochmann, Michael Vorländer, and Janina Fels(Eds.). Deutsche Gesellschaft für Akustik, Berlin, Germany, 7161–7168. https://doi.org/10.18154/RWTH-CONV-239273

[26]

Arne Nykänen, Johnny Wingstedt, Johan Sundhage, and Peter Mohlin. 2015. Sketching sounds – Kinds of listening and their functions in designing. Design Studies 39(2015), 19–47. https://doi.org/10.1016/j.destud.2015.04.002

[27]

William Odom, MinYoung Yoo, Henry Lin, Tijs Duel, Tal Amram, and Amy Yo Sue Chen. 2020. Exploring the Reflective Potentialities of Personal Data with Different Temporal Modalities: A Field Study of Olo Radio. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 283–295. https://doi.org/10.1145/3357236.3395438

Digital Library

[28]

Elif Özcan, Dilip Birdja, and Judith Edworthy. 2018. A Holistic and Collaborative Approach to Audible Alarm Design. Biomedical Instrumentation & Technology 52, 6 (2018), 422–432. https://doi.org/10.2345/0899-8205-52.6.422

[29]

Elif Özcan, Lois Frankel, and Jesse Stewart. 2019. Uncommon music making: The functional roles of music in design for healthcare. Music and Medicine 11, 4 (2019), 245–255. https://doi.org/10.47513/mmd.v11i4.707

[30]

Davide Rocchesso, Stefano Delle Monache, and Stephen Barrass. 2019. Interaction by ear. International Journal of Human-Computer Studies 131 (2019), 152–159. https://doi.org/10.1016/j.ijhcs.2019.05.012

Digital Library

[31]

Davide Rocchesso and Stefania Serafin. 2009. Sonic Interaction Design. International Journal of Human-Computer Studies 67, 11 (2009), 905–906. https://doi.org/10.1016/j.ijhcs.2009.09.009 Special issue on Sonic Interaction Design.

Digital Library

[32]

Niklas Rönnberg and Jonas Löwgren. 2021. Designing the user experience of musical sonification in public and semi-public spaces. SoundEffects - An Interdisciplinary Journal of Sound and Sound Experience 10, 1 (Jan. 2021), 125–141. https://doi.org/10.7146/se.v10i1.124202

[33]

Liz Sanders and Pieter Jan Stappers. 2014. From designing to co-designing to collective dreaming: three slices in time. Interactions 21, 6 (2014), 24–33. https://doi.org/10.1145/2670616

Digital Library

[34]

Hugo Scurto, Bavo Van Kerrebroeck, Baptiste Caramiaux, and Frédéric Bevilacqua. 2021. Designing Deep Reinforcement Learning for Human Parameter Exploration. ACM Trans. Comput.-Hum. Interact. 28, 1, Article 1 (Jan. 2021), 35 pages. https://doi.org/10.1145/3414472

Digital Library

[35]

Andrew E. Smith and Michael S. Humphreys. 2006. Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behavior research methods 38, 2 (2006), 262–279.

[36]

Popi Sotiriadou, Jessie Brouwers, and Tuan-Anh Le. 2014. Choosing a qualitative data analysis tool: a comparison of NVivo and Leximancer. Annals of Leisure Research 17, 2 (2014), 218–234. https://doi.org/10.1080/11745398.2014.902292

[37]

Bruno Sousa, Alessandro Donati, Elif Özcan, René van Egmond, Reinier Jansen, Judy Edworthy, Regina Peldszus, and Yann Voumard. 2017. Designing and Deploying Meaningful Auditory Alarms for Control Systems. In Space Operations: Contributions from the Global Community, Craig Cruzen, Michael Schmidhuber, Young H. Lee, and Bangyeop Kim (Eds.). Springer International Publishing, Cham, 255–270. https://doi.org/10.1007/978-3-319-51941-8_12

[38]

Megan Woods, Rob Macklin, and Gemma K Lewis. 2016. Researcher reflexivity: exploring the impacts of CAQDAS use. International Journal of Social Research Methodology 19, 4(2016), 385–403.

[39]

Laura Zattra, Nicolas Misdariis, Frank Pecquet, Nicolas Donin, and David Fierro. 2018. Analysis of Sound Design Practices [ASDP]. Research methodology. In Machine sounds, Sound machines - Proceedings of the XXII CIM Colloquium on Music Informatics, Federico Fontana and Andrea Gulli (Eds.). 168–175.

Cited By

Zorea MKushi K(2024)All Is Heard: Reimagining The Sounds of Home With CareProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660686(2708-2718)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660686
Kang LJackson SPinch T(2022)The ElectronicistsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517506(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517506
Misdariis NÖzcan EGrassi MPauletto SBarrass SBresin RSusini P(2022)Sound experts’ perspectives on astronomy sonification projectsNature Astronomy10.1038/s41550-022-01821-w6:11(1249-1255)Online publication date: 11-Nov-2022
https://doi.org/10.1038/s41550-022-01821-w

Recommendations

From-The-Wild: Towards Co-Designing For and From Nature
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

Here we present in-progress methodological research exploring how to co-design technology for nature-related experiences. To support increasingly situated and participatory practices in this space, we propose a turn towards co-designing from-the-wild, ...
Read More
Embodied Design Ideation Methods: Analysing the Power of Estrangement
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Embodied design ideation practices work with relationships between body, material and context to enliven design and research potential. Methods are often idiosyncratic and due to their physical nature not easily transferred. This presents challenges for ...
Read More
Documenting trajectories in design space: a methodology for applied game design research
FDG '18: Proceedings of the 13th International Conference on the Foundations of Digital Games

Recent years have borne witness to an explosion of games research from diverse home disciplines. Much of this work concerns game design, but the games research community has yet to agree on practices and methods for examining game design that are ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

C&C '21: Proceedings of the 13th Conference on Creativity and Cognition

June 2021

581 pages

ISBN:9781450383769

DOI:10.1145/3450741

General Chairs:
Corina Sas
Lancaster University, UK
,
Neil Maiden
City, University of London, UK

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2021

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

C&C '21

Sponsor:

SIGCHI

C&C '21: Creativity and Cognition

June 22 - 23, 2021

Virtual Event, Italy

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
769
Total Downloads

Downloads (Last 12 months)224
Downloads (Last 6 weeks)24

Other Metrics

View Author Metrics

Citations

Cited By

Zorea MKushi K(2024)All Is Heard: Reimagining The Sounds of Home With CareProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660686(2708-2718)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660686
Kang LJackson SPinch T(2022)The ElectronicistsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517506(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517506
Misdariis NÖzcan EGrassi MPauletto SBarrass SBresin RSusini P(2022)Sound experts’ perspectives on astronomy sonification projectsNature Astronomy10.1038/s41550-022-01821-w6:11(1249-1255)Online publication date: 11-Nov-2022
https://doi.org/10.1038/s41550-022-01821-w

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents