Abstract
Exploring our environment in everyday life, multiple sensors are frequently applied in the learning processes. Previous design research mainly considered users’ visual perception in terms of how they perceive an object visually and how they feel about the appearance of a product. Little research was focused on the investigation of the relationship between sound and shape characteristics. This study attempts to focus on the exploration of the cognitive relationship between object shape and sound effects. 54 participants (male 25, female 29; ages 18–25 years) were invited to participatory the experiment. Two variables experiment (i.e., shapes x sounds) were conducted in this study. Six types of stimuli including human, cars, animals (i.e., natural objects), cones, cubes, and spheres (i.e., artifacts) were adopted in the experiment. Each type of stimulus was displayed in pairs (e.g., large volume and small volume) on the screen. Audio stimulus was played after visual stimulus to help participants match the audio and visual stimuli. The results showed that there are significant congruent relationships between shape and sound. Participants were able to perceive and identify the larger volume of objects and to associate them with bigger sounds; in contrast, the smaller volume of objects to associate with the smaller sounds. Moreover, a small volume of objects is congruent with high pitch and low volume of sound. In visual identification, the shape with sharp angles is in accordance with large volume and high pitch of sound, while the curved shape appears to be congruent with small volume and low pitch of sounds. However, participants are likely to have difficulty in matching circle and square shapes with the sounds assigned. The results of this study should benefit designers in the development of interfaces enhancing shape and sound and attempting to have consistent sensations to users’ mental model.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Norman, D.A.: The Design of Future Things. Basic Books, New York (2007)
Spelke, E.: Infants’ intermodal perception of events. Cogn. Psychol. 8, 553–560 (1976)
Mondloch, C.J., Maurer, D.: Do small white balls squeak? Pitch-object correspondences in young children. Cogn. Affect. Behav. Neurosci. 4, 133–136 (2004)
Parise, C.V., Spence, C.: Audiovisual crossmodal correspondences and sound symbolism: a study using the implicit association test. Exp. Brain Res. 22, 319–333 (2012)
Carello, C., Anderson, K., Kunkler-Peck, A.: Perception of object length by sound. Psychol. Sci. 9(3), 211–214 (1998)
Grassi, M.: Do we hear size or sound: balls dropped on plates. Percept. Psychophys. 67, 274–284 (2005)
Houben, M.M.J., Kohlrausch, A., Hermes, D.J.: Perception of the size and speed of rolling balls by sound. Speech Commun. 43, 331–345 (2004)
Hermes, Dik J.: Measuring the perceptual similarity of pitch contours. J. Speech Lang. Hear. Res. 41, 73–82 (1998)
Giordano, B.L., McAdams, S.: Material identification of real impact sounds: effects of size variation in steel, glass, wood, and plexiglass plates. J. Acoust. Soc. Am. 119(2), 1171–1181 (2006)
Bien, N., ten Oever, S., Goebel, R., Sack, A.T.: The sound of size: Crossmodal binding in pitch-size synesthesia: a combined TMS, EEG, and psychophysics study. Neuroimage 59, 663–672 (2012)
Kadosh, R.C., Henik, A., Walsh, V.: Small is bright and big is dark in synaesthesia. Curr. Biol. 17, R834–R835 (2007)
Dehaene, S., Bossini, S., Giraux, P.: The mental representation of parity and number magnitude. J. Exp. Psychol. Gen. 122, 371–396 (1993)
Freesound. http://www.freesound.org
Walker, P., Bremner, J.G., Mason, U., Spring, J., Mattock, K., Slater, A., Johnson, S.P.: Preverbal infants’ sensitivity to synesthetic cross-modality correspondences. Psychol. Sci. 21, 21–25 (2010)
Desmet, P.M.A., Hekkert, P.: Framework of product experience. Int. J. des. 1, 57–66 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Wu, TY., Lee, A. (2018). The Study of Sound and Shape Effects on Design. In: Baldwin, C. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2017. Advances in Intelligent Systems and Computing, vol 586. Springer, Cham. https://doi.org/10.1007/978-3-319-60642-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-60642-2_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60641-5
Online ISBN: 978-3-319-60642-2
eBook Packages: EngineeringEngineering (R0)