research-article

Towards a Framework of Aesthetics in Sonic Interaction

Authors:

Stuart Cunningham,

Jonathan Weinel,

Tony StockmanAuthors Info & Claims

AM '23: Proceedings of the 18th International Audio Mostly Conference

Pages 109 - 115

https://doi.org/10.1145/3616195.3616219

Published: 11 October 2023 Publication History

Abstract

As interaction design has advanced, increased attention has been directed to the role that aesthetics play in shaping factors of user experience. Historically stemming from philosophy and the arts, aesthetics in interaction design has gravitated towards visual aspects of interface design thus far, with sonic aesthetics being underrepresented. This article defines and describes key dimensions of sonic aesthetics by drawing upon the literature and the authors’ experiences as practitioners and researchers. A framework is presented for discussion and evaluation, which incorporates aspects of classical and expressive aesthetics. These aspects of aesthetics are linked to low-level audio features, contextual factors, and user-centred experiences. It is intended that this initial framework will serve as a lens for the design, and appraisal, of sounds in interaction scenarios and that it can be iterated upon in the future through experience and empirical research.

References

[1]

Ahamed Altaboli and Yingzi Lin. 2011. Investigating effects of screen layout elements on interface and screen design aesthetics. Advances in Human-Computer Interaction 2011 (2011), 1–10.

Digital Library

[2]

Tomás Alves, Joana Natálio, Joana Henriques-Calado, and Sandra Gama. 2020. Incorporating personality in user interface design: A review. Personality and Individual Differences 155 (2020), 109709.

[3]

Michael L Austin. 2016. Safe and sound: Using audio to communicate comfort, safety, and familiarity in digital media. In Emotions, technology, and design. Elsevier, 19–35.

[4]

Javier A Bargas-Avila and Kasper Hornbæk. 2011. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, United States, 2689–2698.

Digital Library

[5]

Anil Ufuk Batmaz and Wolfgang Stuerzlinger. 2021. The effect of pitch in auditory error feedback for fitts’ tasks in virtual reality training systems. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, IEEE, 85–94.

[6]

Michael Bauerly and Yili Liu. 2008. Effects of symmetry and number of compositional elements on interface and design aesthetics. Intl. Journal of Human–Computer Interaction 24, 3 (2008), 275–287.

[7]

Michaël Berghman and Paul Hekkert. 2017. Towards a unified model of aesthetic pleasure in design. New Ideas in Psychology 47 (2017), 136–144. https://doi.org/10.1016/j.newideapsych.2017.03.004

[8]

Meera M Blattner, Denise A Sumikawa, and Robert M Greenberg. 1989. Earcons and icons: Their structure and common design principles. Human–Computer Interaction 4, 1 (1989), 11–44.

Digital Library

[9]

Letizia Bollini. 2017. Beautiful interfaces. From user experience to user interface design. The Design Journal 20, sup1 (2017), S89–S101.

[10]

Stephen A Brewster, Peter C Wright, and Alistair DN Edwards. 1995. Experimentally derived guidelines for the creation of earcons. In Adjunct Proceedings of HCI, Vol. 95. Cambridge University Press, 155–159.

[11]

William Buxton. 1989. Introduction to this special issue on nonspeech audio. Human Computer Interaction 4 (1989), 1–9.

[12]

Julie L. Darbyshire, Paul R. Greig, Lisa Hinton, and J. Duncan Young. 2021. Monitoring sound levels in the intensive care unit: A mixed-methods system development project to optimize design features for a new electronic interface in the healthcare environment. International Journal of Medical Informatics 153 (2021), 104538. https://doi.org/10.1016/j.ijmedinf.2021.104538

[13]

Judy Edworthy and Neville Stanton. 1995. A user-centred approach to the design and evaluation of auditory warning signals: 1. Methodology. Ergonomics 38, 11 (1995), 2262–2280.

[14]

Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement.Journal of experimental psychology 47, 6 (1954), 381.

[15]

Guy E Garnett. 2001. The aesthetics of interactive computer music. Computer Music Journal 25, 1 (2001), 21–33.

Digital Library

[16]

William W Gaver. 1989. The SonicFinder: An interface that uses auditory icons. Human–Computer Interaction 4, 1 (1989), 67–94.

[17]

William W Gaver. 1993. Synthesizing auditory icons. In Proceedings of the INTERACT’93 and CHI’93 conference on Human factors in computing systems. Association for Computing Machinery, New York, NY, United States, 228–235.

Digital Library

[18]

Lisa Graham. 2008. Gestalt theory in interactive media design. Journal of Humanities & Social Sciences 2, 1 (2008).

[19]

Lars Hallnäs and Johan Redström. 2002. From use to presence: on the expressions and aesthetics of everyday computational things. ACM Transactions on Computer-Human Interaction (TOCHI) 9, 2 (2002), 106–124.

Digital Library

[20]

Eduard Hanslick. 1891. The beautiful in music: A contribution to the revisal of musical aesthetics. Novello.

[21]

Jan Hartmann, Alistair Sutcliffe, and Antonella De Angeli. 2008. Towards a theory of user judgment of aesthetics and user interface quality. ACM Transactions on Computer-Human Interaction (TOCHI) 15, 4 (2008), 1–30.

Digital Library

[22]

Paul Hekkert. 2014. Aesthetic responses todesign: a battle of impulses. Cambridge University Press, 277–299. https://doi.org/10.1017/CBO9781139207058.015

[23]

Christian Hennig, Marina Meila, Fionn Murtagh, and Roberto Rocci. 2015. Handbook of cluster analysis. CRC press, Boca Raton, FL, United States.

[24]

Eve Hoggan and Stephen Brewster. 2012. Nonspeech auditory and crossmodal output. In Human Computer Interaction Handbook : Fundamentals, Evolving Technologies, and Emerging Applications (3 ed.), Julie A. Jacko (Ed.). CRC press, Boca Raton, FL, United States, Chapter 10, 211–235.

[25]

Kristina Hook. 2018. Designing with the body: Somaesthetic interaction design. MIT Press, Cambridge, MA, United States.

[26]

Kasper Hornbæk and Morten Hertzum. 2017. Technology acceptance and user experience: A review of the experiential component in HCI. ACM Transactions on Computer-Human Interaction (TOCHI) 24, 5 (2017), 1–30.

Digital Library

[27]

Talia Lavie and Noam Tractinsky. 2004. Assessing dimensions of perceived visual aesthetics of web sites. International journal of human-computer studies 60, 3 (2004), 269–298.

Digital Library

[28]

Youn-kyung Lim, Erik Stolterman, Heekyoung Jung, and Justin Donaldson. 2007. Interaction gestalt and the design of aesthetic interactions. In Proceedings of the 2007 conference on Designing pleasurable products and interfaces. Association for Computing Machinery, New York, NY, United States, 239–254.

[29]

Edward A Lippman. 1994. A history of Western musical aesthetics. U of Nebraska Press.

[30]

Josh H McDermott. 2012. Auditory preferences and aesthetics: Music, voices, and everyday sounds. In Neuroscience of preference and choice. Elsevier, 227–256.

[31]

Elizabeth D Mynatt. 1994. Designing with auditory icons: how well do we identify auditory cues?. In Conference Companion on human factors in computing systems. Association for Computing Machinery, New York, NY, United States, 269–270.

Digital Library

[32]

David Chek Ling Ngo, Lian Seng Teo, and John G Byrne. 2003. Modelling interface aesthetics. Information Sciences 152 (2003), 25–46.

Digital Library

[33]

Donald A Norman. 2005. Emotional design: Why we love (or hate) everyday things. Basic Books.

[34]

Max Paddison. 1997. Adorno’s aesthetics of music. Cambridge University Press.

[35]

Roy D Patterson. 1990. Auditory warning sounds in the work environment. Philosophical Transactions of the Royal Society of London. B, Biological Sciences 327, 1241 (1990), 485–492.

[36]

Ingrid Pettersson, Florian Lachner, Anna-Katharina Frison, Andreas Riener, and Andreas Butz. 2018. A bermuda triangle? A review of method application and triangulation in user experience evaluation. In Proceedings of the 2018 CHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, United States, 1–16.

Digital Library

[37]

Yuriko Saito. 2007. Everyday aesthetics. Oxford University Press on Demand.

[38]

Kahra Scott-James. 2018. Sound Design for Moving Image: From Concept to Realization. Bloomsbury Publishing.

[39]

Roger Scruton. 1997. The aesthetics of music. Oxford University Press.

[40]

Denis Smalley. 1986. Spectro-morphology and Structuring Processes. Palgrave Macmillan UK, London, 61–93. https://doi.org/10.1007/978-1-349-18492-7_5

[41]

Xiuhua Song, Xinbo Lv, Dongming Yu, and Qianqian Wu. 2018. Spatial-temporal change analysis of plant soundscapes and their design methods. Urban Forestry & Urban Greening 29 (2018), 96–105.

[42]

Noam Tractinsky. 1997. Aesthetics and apparent usability: empirically assessing cultural and methodological issues. In Proceedings of the ACM SIGCHI Conference on Human factors in computing systems. Association for Computing Machinery, New York, NY, United States, 115–122.

Digital Library

[43]

Noam Tractinsky, Adi S Katz, and Dror Ikar. 2000. What is beautiful is usable. Interacting with computers 13, 2 (2000), 127–145.

[44]

Alexandre N Tuch, Sandra P Roth, Kasper Hornbæk, Klaus Opwis, and Javier A Bargas-Avila. 2012. Is beautiful really usable? Toward understanding the relation between usability, aesthetics, and affect in HCI. Computers in Human Behavior 28, 5 (2012), 1596–1607.

Digital Library

[45]

Robert W Veryzer Jr and J Wesley Hutchinson. 1998. The influence of unity and prototypicality on aesthetic responses to new product designs. Journal of consumer research 24, 4 (1998), 374–394.

[46]

Eberhard Zwicker and Hugo Fastl. 1999. Psychoacoustics Facts and Models Second Updated Edition. Psychoacoustics, Vol. 22. Springer Berlin / Heidelberg, Germany.

Cited By

Hultman AGoina MBresin R(2024)Interactive sonification helps make sense of the negative environmental impact of vessel traffic in the Baltic SeaProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678320(209-217)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678320
Hicks KRogers KGerling KNacke L(2024)Juicy Audio: Audio Designers' Conceptualization of the Term in Video GamesProceedings of the ACM on Human-Computer Interaction10.1145/36770848:CHI PLAY(1-28)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677084

Index Terms

Towards a Framework of Aesthetics in Sonic Interaction
1. Applied computing
  1. Arts and humanities
    1. Sound and music computing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI theory, concepts and models
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Sonic interaction design: sound, information and experience
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

Sonic Interaction Design (SID) is an emerging field that is positioned at the intersection of auditory display, ubiquitous computing, interaction design, and interactive arts. SID can be used to describe practice and inquiry into any of various roles ...
Beyond Beauty: Towards a Deeper Understanding of Aesthetics in HCI
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

The word aesthetics, as used in Human-Computer Interaction (HCI), tends to refer to visual characteristics of an interface. Furthermore, it is broadly taken to mean beauty, which, while a significant aspect of aesthetics, is not its only concern. ...
The use of aesthetics in HCI systems
CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing Systems

As computing expands its domain from workplace to pervasive and domestic environments, interest in aesthetics for designing is increasing in HCI. HCI literatures in aesthetics provide wide variety of theoretical foundations for how aesthetics might be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '23: Proceedings of the 18th International Audio Mostly Conference

August 2023

204 pages

ISBN:9798400708183

DOI:10.1145/3616195

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AM '23

AM '23: Audio Mostly 2023

August 30 - September 1, 2023

Edinburgh, United Kingdom

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
117
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)6

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hultman AGoina MBresin R(2024)Interactive sonification helps make sense of the negative environmental impact of vessel traffic in the Baltic SeaProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678320(209-217)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678320
Hicks KRogers KGerling KNacke L(2024)Juicy Audio: Audio Designers' Conceptualization of the Term in Video GamesProceedings of the ACM on Human-Computer Interaction10.1145/36770848:CHI PLAY(1-28)Online publication date: 15-Oct-2024
https://dl.acm.org/doi/10.1145/3677084

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents