article

Using sonification

Authors:

Stephen Barrass,

Gregory KramerAuthors Info & Claims

Multimedia Systems, Volume 7, Issue 1

Pages 23 - 31

https://doi.org/10.1007/s005300050108

Published: 01 January 1999 Publication History

Abstract

The idea behind sonification is that synthetic nonverbal sounds can represent numerical data and provide support for information processing activities of many differentkinds. This article describes some of the ways that sonification has been used in assistive technologies, remote collaboration, engineering analyses, scientific visualisations, emergency services and aircraft cockpits. Approaches for designing sonifications are surveyed, and issues raised by the existing approaches and applications are outlined. Relationsare drawn to other areas of knowledge where similar issueshave also arisen, such as human-computer interaction, scientific visualisation, and computer music. At the end is a listof resources that will help you delve further into the topic.

References

[1]

1. Albers M, Barrass S, Brewster S, Mynatt B (1997) Dissonance on Audio Interfaces. IEEE Expert, September; <http://www.computer.org/pubs/expert/>

[2]

2. Alty JL (1995) Multimedia Interface Design Tutorial Notes. In: Australian Conference on Computer-Human Interaction OZCHI'95, University of Wollongong, Wollongong, Australia

[3]

3. Alty JL, Bergan M, Craufurd P, Dolphin C (1993) Experiments using Multimedia Interfaces in Process Control: Some Initial Results. Comput Graphics 17(3)

[4]

4. Axen U, Choi I (1996) Investigating Geometric Data with Sound. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display, 1996, Palo Alto, Calif., Web-proceedings <http://www.santafe.edu/~icad>

[5]

5. Ballass JA (1994) Delivery of Information Through Sound. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces, SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison-Wesley, Reading, Mass., pp 79-94

[6]

6. Barrass S (1998) Auditory Information Design. Ph.D. Thesis. Australian National University, Canberra, Australia <http://viswiz.gmd.de/barrass/thesis/index.html>

[7]

7. Barrass S (1998) Some Golden Rules for Designing Auditory Displays. In: Boulanger R (ed) Csound Textbook. MIT Press, Cambridge, Mass. (in press)

[8]

8. Begault DR, Wenzel EM, Shrum R, Miller J (1996) A Virtual Audio Guidance and Alert System for Commercial Aircraft. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif., Web-proceedings <http://www.santafe.edu/~icad>

[9]

9. Bertin J (1981) Graphics and Graphic Information Processing. Walter de Gruyter, Berlin

[10]

10. Blattner M, Sumikawa D, Greenberg R (1989) Earcons and Icons: Their Structure and Common Design Principles. Hum Comput Interaction 4(1): 11-44. Lawrence Erlbaum Associater. Mahawah, New Jersey

Digital Library

[11]

11. Blattner MM, Papp AL, Glinert EP (1994) Sonic Enhancement of Two-Dimensional Graphics Displays. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 447-470

[12]

12. Bly S (1994) Multivariate data analysis. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 405-416

[13]

13. Bregman AS (1990) Auditory Scene Analysis. MIT Press, Cambridge, Mass.

[14]

14. Brewster SA, Wright PC, Edwards ADN (1994) A Detailed Investigation into the Effectiveness of Earcons. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 471-498

[15]

15. Casner S (1992) A Task Analytic Approach to the Automated Design of Graphic Presentations. ACM Trans Graphics 10: 111-151

[16]

16. Cleveland WS (1985) The Elements of Graphing Data. Wadsworth Advanced Books and Software, Monterey, Calif.

[17]

17. Cohen J (1994) Monitoring Background Activities. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 499-532

[18]

18. Craighead H (1997) Silicon Guitar; <http://www.npr.org/news/tech/970724.guitar.html>

[19]

19. Davis JC, Packard R (1997) Quantum oscillations between two weakly coupled reservoirs of superfluid He-3. Nature July 31 1997 <http://physics1.berkeley.edu/research/jcdavis/press.html>

[20]

20. Dougherty T (1996) What Does Pink Sound Like? Designing the Audio Interface for the TalOS. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif., Web-proceedings <http://www.santafe.edu/~icad>

[21]

21. Fitch WT, Kramer G (1994) Sonifying ther Body Electric: Superiority of an Auditory over a Visual Display in a Complex Multivariate System. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., Web-proceedings <http://www.santafe.edu/~icad>

[22]

22. Flowers JH, Buhman DC, Turnage KD (1996) Data Sonification from the Desktop: Should Sound be part of Standard Data Analysis Software. In: Frysinger S, Kramer G (eds) Proceeedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif.

[23]

23. Gardner JA, Lundquist R, Sahyun S (1996) Triangle, a Practical Application of Non-Speech Audio for Imparting Information. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif., Web-proceedings <http://www.santafe.edu/~icad>

[24]

24. Gaver WW (1994) Using and Creating Auditory Icons. In: Kramer G (ed) (1994) Auditory Display: Sonification, Audification and Auditory Interfaces, SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 417-446

[25]

25. Gaver WW, Smith RB, O'Shea T (1991) Effective Sounds in Complex Systems: The Arkola Simulation, Proceedings of CHI '91 Human Factors in Computing Systems, New Orleans, April 28-May 2, 1991. ACM Press, New York, pp 85-90

[26]

26. Hayward C (1994) Listening to the Earth Sing. In: Kramer G (ed) (1994) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 369-404

[27]

27. Horry Y (1994) A Graphical User Interface for MIDI Signal Generation and Sound Synthesis. In: Proceedings of the International Computer Music Conference ICMC '94, September 12-17, 1994, Aarhus, Denmark. International Computer Music Association, San Francisco, Calif., pp 276-279

[28]

28. James F (1996) Presenting HTML Structure in Audio: User Satisfaction with Audio Hypertext. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif., Web-proceedings <http://www.santafe.edu/~icad>

[29]

29. Kendall GS (1991) Visualization by Ear: Auditory Imagery for Scientific Visualization and Virtual Reality. Comput Music J 15(4): 70-73

[30]

30. Kennel AR (1996) AudioGraf: A Diagram reader for Blind People. In: Proceedings of ASSETS'96 Second Annual ACM Conference on Assistive Technologies, April 11-12, 1996, Vancouver, Canada. ACM Press, New York, pp51-56

[31]

31. Kramer G (1994a) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass.

[32]

32. Kramer G (1994b) Some Organizing Principles for Representing Data With Sound. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 185-222

[33]

33. Loomis JM, Gollege RG, Klatzky RL, Spiegle JM, Teitz J (1994) Personal Guidance System for the Visually Impaired. In: Proceedings of ASSETS'94 First Annual ACM Conference on Assistive Technologies, Oct 31-Nov 1, 1994. Los Angeles, Calif. ACM Press, New York, pp 85-91

[34]

34. Lucas PA (1994) An Evaluation of the Communicative Ability of Auditory Icons and Earcons. In: Kramer G, Smith S (eds) Proceedings of the Second International Conference on Auditory Display ICAD '94, Santa Fe, New Mexico. 7-9 Nov, 1994

[35]

35. Martins ACG, Rangayyan RM, Portelo LA, Amaro E, Ruschioni RA (1996) Auditory Display and Sonification of Textured Images. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif. Web-proceedings <http://www.santafe.edu/~icad>

[36]

36. McCabe K, Rangwalla A (1994) Auditory Display of Computational Fluid Dynamics Data. In: Kramer G (ed) Auditory Display : Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 321-340

[37]

37. Misenheimer R, Landreth C (1993) Caustic Sky. In: Bargar R, Evans B, Scaletti C (eds) An Introduction to Data Sonification, Siggraph'93, August 1-6, 1993, Anaheim, Calif. ACM Press

[38]

38. Mynatt ED (1994a) Auditory Presentation of Graphical User Interfaces. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 533-555

[39]

39. Mynatt ED (1994b) Designing with Auditory Icons. In: Kramer G, Smith S (eds) Proceedings of the Second International Conference on Auditory Display ICAD '94, Santa Fe Institute, Santa Fe, New Mexico. 7-9 Nov, 1994

[40]

40. Newman WR, Krickler A, Bove BM (1991) Television, Sound, and Viewer Perceptions. In: Proceedings Joint IEEE and Audio Engineering Society Meeting, 1991, Detroit, Mich. February 1-2, 1994

[41]

41. Patterson RD (1982) Guidelines for Auditory Warning Systems on Civil Aircraft. Paper No. 82017, Civil Aviation Authority, London, UK

[42]

42. Robertson PK (1988) Visualizing Color Gamuts: A User Interface for the Effective Use of Perceptual Color Spaces in Data Displays. IEEE Comput Graphics Appl 8(5): 50-64

Digital Library

[43]

43. Scaletti C (1994) Sound Synthesis Algorithms for Auditory Data Representations. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 223-252

[44]

44. Smith S (1990) Representing Data with Sound. In: Proceedings of IEEE Visualization 1990. IEEE CS Press, Piscataway, N.J.

[45]

45. Smith S, Levkowitz H, Pickett RM, Torpey M (1994) A System for Psychometric Testing of Auditory Representations of Scientific Data. In: Kramer G, Smith S (eds) Proceedings of the Second International Conference on Auditory Display ICAD'94, Santa Fe, New Mexico

[46]

46. Smith S, Picket RM, Williams MG (1994) Environments for Exploring Auditory Representations of Multidimensional Data. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 167-184

[47]

47. Stevens RD, Brewster SA, Wright PC, Evans ADN (1994) Design and Evaluation of an Auditory Glance at Algebra for Blind readers. In: Kramer G, Smith S (eds) Proceedings of the Second International Conference on Auditory Display ICAD '94, Santa Fe Institute, Santa Fe, New Mexico. 7-9 Nov, 1994

[48]

48. Swan N (1996) Ways of Seeing. The Health Report. Radio National Transcripts, Monday, 19 February 1996; <http://www.abc.net.au/rn/talks/8.30/helthrpt/hstories/hr190201.htm<

[49]

49. Tkaczevski A (1996) Auditory Interface Problems and Solution for Commercial Multimedia Products. In: Frysinger S, Kramer G (eds) Proceedings of the Third International Conference on Auditory Display ICAD'96, Palo Alto, Calif., Web-proceedings <http://www.santafe.edu/~icad>

[50]

50. Williams SM (1994) Perceptual Principles in Sound Grouping. In: Kramer G (ed) Auditory Display: Sonification, Audification and Auditory Interfaces. SFI Studies in the Sciences of Complexity, Proceedings Volume XVIII. Addison Wesley, Reading, Mass., pp 95-126

Cited By

Georgiou CAndreopoulou AMetallinou FMoussas TGeorgaki A(2024)Micropolyphony and Stochastic Compositional Techniques as Tools for the Sonification of Magnetic StormsProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678318(189-197)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678318
Kacem AZbiss KWatta PMohammadi A(2024)Wave space sonification of the folding pathways of protein molecules modeled as hyper-redundant robotic mechanismsMultimedia Tools and Applications10.1007/s11042-023-15385-y83:2(4929-4949)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s11042-023-15385-y
Li HBellona JSmith LBower ARoberts J(2023)“Let the Volcano Erupt!”: Designing Sonification to Make Oceanography Accessible for Blind and Low Vision Students in Museum EnvironmentProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614482(1-6)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614482
Show More Cited By

Index Terms

Using sonification
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Evaluation of psychoacoustic sound parameters for sonification
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

Sonification designers have little theory or experimental evidence to guide the design of data-to-sound mappings. Many mappings use acoustic representations of data values which do not correspond with the listener's perception of how that data value ...
Lyricon Lyrics + Earcons Improves Identification of Auditory Cues
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187

Auditory researchers have developed various non-speech cues in designing auditory user interfaces. A preliminary study of "lyricons" lyricsï ź+ï źearcons [1] has provided a novel approach to devising auditory cues in electronic products, by combining ...
Aesthetic strategies in sonification

Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as ...

Comments

Information & Contributors

Information

Published In

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 January 1999

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Georgiou CAndreopoulou AMetallinou FMoussas TGeorgaki A(2024)Micropolyphony and Stochastic Compositional Techniques as Tools for the Sonification of Magnetic StormsProceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures10.1145/3678299.3678318(189-197)Online publication date: 18-Sep-2024
https://dl.acm.org/doi/10.1145/3678299.3678318
Kacem AZbiss KWatta PMohammadi A(2024)Wave space sonification of the folding pathways of protein molecules modeled as hyper-redundant robotic mechanismsMultimedia Tools and Applications10.1007/s11042-023-15385-y83:2(4929-4949)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s11042-023-15385-y
Li HBellona JSmith LBower ARoberts J(2023)“Let the Volcano Erupt!”: Designing Sonification to Make Oceanography Accessible for Blind and Low Vision Students in Museum EnvironmentProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3614482(1-6)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3614482
Guerreiro JKim YNogueira RChung SRodrigues AOh U(2023)The Design Space of the Auditory Representation of Objects and Their Behaviours in Virtual Reality for Blind PeopleIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324709429:5(2763-2773)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247094
Asonitis TAllmendinger RBenatan MCliment R(2023)SonOpt: understanding the behaviour of bi-objective population-based optimisation algorithms through soundGenetic Programming and Evolvable Machines10.1007/s10710-023-09451-524:1Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1007/s10710-023-09451-5
Bardelli SFerretti CLudovico LPresti GRinaldi M(2021)A Sonification of the zCOSMOS Galaxy DatasetCulture and Computing. Interactive Cultural Heritage and Arts10.1007/978-3-030-77411-0_12(171-188)Online publication date: 24-Jul-2021
https://dl.acm.org/doi/10.1007/978-3-030-77411-0_12
Quinton MMcGregor IBenyon DGroß-Vogt KHöldrich R(2020)Sonification of an exoplanetary atmosphereProceedings of the 15th International Audio Mostly Conference10.1145/3411109.3411117(191-198)Online publication date: 15-Sep-2020
https://dl.acm.org/doi/10.1145/3411109.3411117
Nordmoen CArmitage JMorreale FStewart RMcPherson AHarrison SBardzell SNeustaedter CTatar D(2019)Making Sense of SensorsProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322368(135-146)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322368
Khot RAggarwal DPennings RHjorth LMueller FMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)EdiPulseProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025980(6593-6607)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025980
Freeman EWilson GVo DNg APolitis IBrewster S(2017)Multimodal feedback in HCIThe Handbook of Multimodal-Multisensor Interfaces10.1145/3015783.3015792(277-317)Online publication date: 24-Apr-2017
https://dl.acm.org/doi/10.1145/3015783.3015792
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents