Straebel-Sonification Metaphor
Straebel-Sonification Metaphor
Straebel-Sonification Metaphor
, USA
June 9–15, 2010
Proceedings
of the 16th International Conference
on Auditory Display
Volker Straebel
1 2
p. 9 p. 147, n30
ICAD-287
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
Starting in the 1950s, composers began to refer to minute) a measure. The three tempi superimposed create
extra-musical entities, particularly scientific data, on a a rather complex resulting rhythm [7]2.
different level. They no longer imitated sounds or Since the durations of the glissandi of each
expressed certain feelings or poetic ideas, but instrument remain constant, the change of speed needs to
incorporated algorithmic or conceptual procedures in be expressed by the change of interval that gets spanned
their compositional process. The sonification metaphor within the constant duration (fig. 2). The sonified speed
was used, before its concept was established, to map the of the gas particles is musically represented by the
shapes of stones or the panorama of the Alps to melodic glissando’s differential. (The use of pizzicato, however,
lines or sound spectrums. This way, the representational makes it rather difficult to actually hear the glissandi,
aspect was internalized into the composition itself. since the attack emphasizes the pitches from which the
sliding tones start).
2.1. Iannis Xenakis: Pithoprakta
In each part, the durations of the glissandi remain In a similarly abstract way, Karlheinz Stockhausen made
constant, occasionally skipping one beat. The durations reference to the mountains around Paspels, Switzerland
are 3, 4 or 5 beats per measure with 26MM (beats per in his Gruppen for three orchestras. Begun in the little
village in the summer of 1955 and completed two years
2
p. 15
1 3
p. 18 p. 13
ICAD-288
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
ICAD-289
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
easily available sensor technology in the 1960s, as well music with stones, because when you draw around a
as the improvement of computer performance for stone you don’t necessarily draw the same way each
algorithmic composition and sound synthesis, led to a time” [20]2.)
considerable increase in the number of electronic music An important aspect in data mapping is the question
compositions influenced by the sonification metaphor of scale. The horizontal axis of the Ryoanji score equals
[15], [16]. To supplement research undertaken in the time, but only the part for voice contains a tempo
field of electro-acoustic music, I will here discuss two indication, two minutes per double page that constitute
works of instrumental music that are inspired by the one section (or “garden”). From what we know about
sonification metaphor. Cage’s practice when scoring and rehearsing the first
performances, we can assume the same tempo was
3.1. John Cage: Ryoanji requested for all the parts. In contrast, the scaling of the
vertical axis is indicated in the scores since it changes
In 1983-85, John Cage composed Ryoanji in five parts chance-determined for every section, varying from one
for flute, oboe, trombone, voice, and double bass, to be semitone (in the flute, pp. 6/7) to one octave and a fourth
performed solo or in any combination, but always (in the voice, pp. 18/19). Obviously, the scaling factor of
together with a part for percussion (or orchestra in the pitch axis greatly impacts the sounding result. It
unison). The scores are graphic, consisting of curved determines whether the changes in pitch are microtonal
lines that indicate glissandi with time equaling space on and subtle, or large intervals are spanned in high tempo.
the horizontal and pitch equaling space on the vertical So it comes as no surprise that Cage used this factor as a
axis (fig. 4). The title Ryoanji refers to the Ryoanji Zen dimension of composition. By the way, musically this
garden in Kyoto, Japan, where 15 large stones are placed situation is very similar to Xenakis’s transformation of
in 5 groups (of 5, 2, 3, 2, and 3 stones from east to west) particle speeds into glissandi by controlling the intervals
on a slim rectangle of raked sand. Cage created the spanned by these glissandi.
graphs in the score by placing stones from a collection of According to Cage’s performance instructions, “[t]he
15 at chance-determined positions on paper and tracing glissandi are to be played smoothly and as much as is
parts of their perimeters. Per double page, 15 to 30 stones possible like sound events in nature rather than sounds in
were used, and sometimes up to four lines overlap in one music” [21]. In other words, the sonification of natural
instrument, so that parts need to be pre-recorded and objects is supposed to sound like nature, not music. But
played back during live performance [17]1, [19]. Cage’s composition is not so much representational of
stones he traced but of the Ryoanji garden as a whole. In
his comments, Cage claims “the staves are actually the
area of the garden” [20]3 , and “for the accompaniment
[i.e. the percussion part] I turned my attention to the
raked sand” [17]4. In summary, it may be argued that the
composition Ryoanji is a conceptual artistic
representation of the garden, incorporating elements of
sonification.
Inspired by his work with magnetic tape, Cage had
begun utilizing propositional notation where time equals
space in the early 1950s. As he explained, “with
propositional notation, you automatically produce a
picture of what you hear” [20]5. This connection of music
music and visual representation can easily be turned
around, so that the music follows what you see (e.g. the
aforementioned music from star maps and drawings).
Figure 4: John Cage, Ryoanji. Flute [21]. Copyright Basically, this means nothing other than the
© 1984 by Henmar Press Inc. Used by kind permission. interchangeability of visual and auditive representation,
All rights reserved. which is one of the fundamental assumptions of
(To be precise: in preparing the score, Cage actually sonification research.
did not draw around stones; he used paper templates that
resembled the shapes of the 15 stones. This was not so
much to facilitate the composition process, but to ensure
2
that repetitions would occur: “I obviously couldn’t write p. 280
3
p. 242
4
p. 135
1 5
pp. 134-136; also, with illustrations: [18] p. 243
ICAD-290
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
3.2. Alvin Lucier: Panorama works, you find out about it, and you also connect to it in
a beautiful way” [23]1. And disclosing the metaphysical
In his composition Panorama for Trombone and Piano implications of his aesthetic approach, Lucier stated that
(1993), Alvin Lucier mapped the panorama of the Swiss his works were “perhaps closer in spirit to alchemy,
Alps to the pitches of a slide trombone. He worked from whose purpose was to transform base metals into pure
a reproduction of a panorama drawing by Fritz Morach gold” [24]2.
after a landscape photo by Hermann Vögeli [22]. The
print (98 x 11.5 cm) indicates the mountain peaks with
4. SONIFICATION’S ROMANTIC IMPLICATIONS
vertical lines that label their name and height (fig. 5).
John Cage and many experimental music composers after
him are known to have been influenced by the writings of
the American Transcendentalist Henry David Thoreau. In
Walden, an essay that reflects his experience of living
alone in the woods from 1845 to 1847, Thoreau interprets
the quality of sounds heard from a long distance and
echoed in the valleys as “a vibration of the universal
lyre” [25]3. In 1851 Thoreau witnessed a telegraph line
being erected [26] 4 . Despite his doubts about the
usefulness of this invention (“We are in great haste to
construct a magnetic telegraph from Maine to Texas; but
Maine and Texas, it may be, have nothing important to
communicate.” [25] 5 ) Thoreau enjoyed and attached
importance to the sound of the “telegraph wire vibrating
like an Æolian Harp” [26]6 . To Thoreau, the telegraph
became “[t]he first strain of the American lyre” [27]7 and
and “the divine humming of the telegraph” [27]8 revealed
Figure 5: Alvin Lucier, Panorama. Excerpt from revealed the “spirit [that] sweeps the string of the
drawing [22] and score. Copyright © Alvin Lucier. Used
telegraph harp – and strains of music are drawn out
by kind permission.
endlessly like the wire itself. We have no need to refer
music and poetry to Greece for an origin now. […] The
In his composition, Lucier kept the scaling of both
world is young & music is its infant voice” [26]9. Finally,
dimensions fixed: The mountain height in meters divided
Thoreau states, the “wire […] always brings a special &
by 8 results in the frequency in Hz, and the distance
general message to me from the highest” [28]10 – “the
between two mountain peaks in mm is interpreted as time
wind which was conveying a message to me from heaven
in seconds, leading to a total duration of 16 minutes.
dropt it on the wire of the telegraph which it vibrated as it
Since Lucier did not use a longitudinal section of the
past [sic]” [28] 11 . This phrasing is indeed close to the
mountain range but worked from a panorama view, the
often quoted definition of sonification as the “use of non-
distances he sonifies do not correspond to the actual
speech audio to convey information” [29]12.
distances between the peaks, a fact that is reflected in the
Thoreau, however, favors the language metaphor,
work’s title.
when he records in his journal the way he sees himself:
The piano part indicates the moments when the
“A writer a man writing is the scribe of all nature – he is
trombone reaches a mountain peak with a single tone or a
the corn & the grass & the atmosphere writing” [26]13.
two-tone chord of adjacent pitch classes. Since the
trombone freely slides through the continuum of
frequencies, while the piano is bound to pitches in equal 1
p. 348
2
temperament, beatings and difference tones occur. This is p. 11
3
a typical technique Lucier has incorporated in his p. 123 (chapter Sounds)
4
compositions since the 1980s. p. 16 (Aug. 28, 1851)
5
Besides his affinity for translation processes in music p. 52 (chapter Economy)
6
and sound art, Alvin Lucier often draws his inspiration p. 75 (Sept. 12, 1851)
7
p. 3 (Feb. 13, 1854)
from scientific experiments. His reference to sonification 8
p. 4 (Feb. 13, 1854)
satisfies both interests. It also stands for the composer’s 9
p. 238 (Jan. 3, 1852)
belief that his aesthetic research may reveal the beauty 10
p. 437 (Jan. 9, 1853)
and charm of the world around us. He once explained 11
p. 76 (Sept. 12, 1851)
12
that “in imitating the natural, the way the natural world chapter 1, Executive Summary
13
p. 28 (Sept. 2, 1851)
ICAD-291
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
He also claims we were “in danger of forgetting the [association of ideas] [32] 4 . In his notes toward
language which all things and events speak without encyclopedism, Novalis finally asked himself whether all
metaphor” [25]1. sculptural form, from crystal to man, could not be
The idea that nature implies a language that, if only described acoustically, as inhibited movement. As
understood, could reveal metaphysical entities otherwise chemical acoustics [32]5.
inaccessible to mankind is prominent in German Early In their research on sonification, scholars and artists
Romanticism of the late 18th century. Novalis, in his Die alike borrow from the romanticists’ yearning to break the
Lehrlinge zu Saïs (“The Novices of Sais”), compares the spell and make the world understandable by translating
routes men take to wondrous figures, which seem to natural phenomena to our senses for immediate
belong to the script of ciphers that one can behold perception. Gregory Kramer opens his essential
everywhere, on wings and egg shells, in clouds, in snow, Introduction to Auditory Display [3] with a quote by Sufi
in crystals and geological formations, in filings drawn to teacher Hazrat Inayat Khan (1882-1927) from his
a magnet, finally in figures created by sand on vibrating Mysticism of Sound and Music: “[I]n the realm of music
sheets [30] 2 . The latter obviously refers to the the wise can interpret the secret and nature of the
experiments of Ernst Chladni, who covered metal sheets working of the whole universe” [33]6 . In his epigraph,
with a thin layer of sand before he made them vibrate by however, Kramer changed “music” to “sound” and
means of a violin bow. Depending on the vibrations the thereby extended the source of inspiration from a man-
sand would move on the surface and establish made art to a physical quality as such. Similarly, Andrea
geometrical figures (fig. 6). Polli quotes Walt Whitman’s nature poem Proud music
of the storm when introducing her works that sonify
meteorological data [34], and Chris Hayward titled a
paper on the sonification of seismological data poetically
– and somewhat euphemistically – Listening to the Earth
Sing [35].
Without typecasting these and many other authors as
hidden romanticists, I would like to emphasize the
unspoken implication of metaphysical assumptions and
romantic motives in sonification research. The
recognition of these implications may not only further an
understanding of the intellectual fascination with which
sonification projects are received, but may also facilitate
exchange between scientists and composers. The latter
seems to me of prime importance if we are to improve
the aesthetic and artistic quality of sonification
applications and artworks.
5. ACKNOWLEDGMENTS
ICAD-292
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
ICAD-293
The 16th International Conference on Auditory Display (ICAD-2010) June 9-15, 2010, Washington, D.C, USA
ICAD-294
Proceedings of the 16th International Conference
on Auditory Display Washington D.C., USA
ISBN: 0-9670904-3-1
c 2010 by the ICAD contributors.
Copyright
All rights reserved. Copyright remains with the individual authors. No part of this publication can be reproduced, stored in
a retrieval system, or transmitted in any form by any means, electronic, mechanical, photocopying, recording, or otherwise
without prior written permission of the individual authors.
Conference Co-Chairs:
Derek Brock, U.S. Naval Research Laboratory & Hesham Fouad, VRSonic & Ramani Duraiswami, University of Maryland
Papers/Posters Chair:
Eoin Brazil, Irish Centre for High End Computing
Demonstrations/Compositions Chair:
Evan Rogers, VRSonic
Sonification Chair:
Kelly Snook, NASA
Concert Co-Chairs:
Douglas Boyce, The George Washington University & Katharina Rosenberger, University of California, San Diego
Web Chair:
Brian McClimens, U.S. Naval Research Laboratory
Technical Chair:
Paul Oehlers, American University
Steering Committee:
Stephen Barrass, University of Canberra & Veronique Larcher, Sennheiser & David Worrall, worrall.avatar.com.au
Reviewers:
Alvaro Barbosa, CITAR - Portugal Douglas Boyce, The George Washington University
Soren Bech, Bang and Olufsen Eoin Brazil, Irish Centre for High Performance Computing
Derek Brock, Naval Research Laboratory Milena Droumeva, Simon Fraser University
Samuel Ferguson, University of Technology, Sydney Federico Fontana, University of Udine
Christopher Frauenberger, University of Sussex Fabien Gouyon, INESC Porto
Matti Gröhn, Finnish Institute of Occupational Health Florian Grond, Bielefeld University, CITEC
Brian Gygi, VANCHCS Thomas Hermann, Bielefeld University
Daniel Hug, Zurich University of the Arts Andy Hunt, University of York, UK
Trond Lossius, BEK - Bergen Center for Electronic Arts David McGookin, University of Glasgow
Roderick Murray-Smith, University of Glasgow Michael Nees, Georgia Institute of Technology
Flaithri Neff, Limerick Institute of Technology Evan Rogers, VRSonic
Markus Noisternig, IRCAM Sandra Pauletto, The University of York
Michael Qin, Naval Submarine Medical Research Laboratory Stefania Serafin, Aalborg University
Tony Stockman, Queen Mary, University of London Yon Visell, McGill University
Katharina Vogt, University of Music and Dramatic Arts Graz Hesham Fouad, VRSonic
Katharina Rosenberger, University of California, San Diego Kelly Snook, NASA
Washington D.C — June 2010