The Auditory Setting - Introudction
The Auditory Setting - Introudction
The Auditory Setting - Introudction
Budhaditya Chattopadhyay
Series Editors
Kevin Donnelly, University of Wales Aberystwyth
Beth Carroll, University of Southampton
www.edinburghuniversitypress.com/series/MAMI
THE AUDITORY SETTING
Environmental Sounds in
Film and Media Arts
Budhaditya Chattopadhyay
Edinburgh University Press is one of the leading university presses in the UK.
We publish academic books and journals in our selected subject areas across the
humanities and social sciences, combining cutting-edge scholarship with high editorial
and production values to produce academic works of lasting importance. For more
information visit our website: edinburghuniversitypress.com
A CIP record for this book is available from the British Library
The right of Budhaditya Chattopadhyay to be identified as the author of this work has
been asserted in accordance with the Copyright, Designs and Patents Act 1988, and
the Copyright and Related Rights Regulations 2003 (SI No. 2498).
CONTENTS
PART 1: INTRODUCTION
1 The First Sound and the Curiosity 3
1.1 Foregrounding environmental sound 3
1.2 Mise-en-sonore 6
1.3 Ambient sound in films 7
1.4 Ambient sound in other audiovisual media arts 10
2 The Auditory Context and Signification 14
2.1 Film sound research 14
2.2 The audiovisual relationship 17
2.3 Sound studies 18
2.4 Film and media arts 19
2.5 The phenomenology of ambient sound 20
2.6 Digital aesthetics 23
3 Key Concepts and Definitions 26
3.1 Diegetic sound 26
3.2 Mimesis 28
3.3 Presence 29
3.4 Rendering 31
3.5 Soundscape and the soundmark 32
contents
vi
contents
15 Airport 135
16 Underwater, Outer Space 139
Bibliography 187
List of Works/Media Cited 198
Index 202
Listening and viewing examples to support the text can be accessed via the QR
code on the back cover or at https://budhaditya.org/projects/auditory-setting/
vii
FIGURES
viii
ACKNOWLEDGEMENTS
This book is a culmination of many years’ intensive thinking, research and sen-
sitive listening to films and audiovisual media, and, most importantly, engage-
ment with locations during extensive travel across the globe. The personal
enquiry that germinated into this book started in 2002 when I was fresh out of
engineering school and contemplating joining film school. At that time, I was a
cinephile and a film buff – indeed, I still am – but my earlier innocence has been
partly replaced by a critical attitude. My interest and curiosity for sound in film
and media arts are distilled in this book. First, I would like to acknowledge the
inspiration I have drawn from fellow sound artists and practitioners.
This book is inspired by the extensive research conducted for my doc-
toral project at Leiden University, Netherlands, which I completed in 2017.
I warmly thank Prof. dr Marcel Cobussen and Prof. Frans de Ruiter of
the Academy of Creative and Performing Arts for their valuable comments
and suggestions towards developing the final version of the dissertation. I
am particularly grateful to Marcel Cobussen for kindly agreeing to become
my supervisor during the final and crucial stages of the PhD, providing me
with valuable guidance. This book has also been enriched by the following
three years of extensive writing and further research, partly produced during
my Mellon Postdoctoral Fellowship at the Center for Arts and Humanities,
American University of Beirut, Lebanon, 2018–2019. I would like to thank
the Center for Arts and Humanities for hosting me and facilitating an inspir-
ing writing environment in AUB’s wondrous campus with all those friendly
cats. I also thank the Faculty of Humanities at the University of Copenhagen,
ix
contents
Denmark, for supporting and financing earlier parts of this research from
2011 to 2015.
I would like to thank several people who have remained supportive through-
out the development of this project. Thanks to Professor Brandon LaBelle at
the University of Bergen, Norway, who invited me to join the seminar series
Dirty Ear Forum – his continuing support has been immensely helpful. Thanks
also to Morten Michelsen of the Department of Arts and Cultural Studies,
University of Copenhagen, who invited me to hold a panel at the ESSA2014
Sound Studies conference, where I had the chance to discuss this project with
fellow film sound scholars such as Martine Huvenne, who read parts of the
manuscript and gave helpful advice and comments. I would like to thank
Prof. Debasish Ghoshal at SRFTI, who listened patiently to my idea. I thank
Sharon Stewart, who helped me edit the final version of the dissertation. I
sincerely thank Associate Professor Ulrik Schmidt, who invited me to work
as a guest researcher at Roskilde University, Denmark, to further develop the
project. Interaction with students, who took part in the courses I taught at the
University of Copenhagen and the American University of Beirut, has consider-
ably enriched my research. My heartfelt thanks go to Prof. Andrew Lewis at
the School of Music in Bangor University, North Wales, UK, for providing hos-
pitality during my residency to develop the sound artwork Elegy for Bangalore
while working at Studio 4. I would also like to thank the Charles Wallace
India Trust, London, for funding my travel and stay in Bangor. Thanks to
Deutschlandradio, Berlin, for broadcasting the work and to Gruenrekorder
for publishing the work on CD. I would like to thank the Prince Claus Fund,
Netherlands, for providing financial support for the fieldwork conducted in
India to develop the project Decomposing Landscape. I thank ICST, Zurich
University of the Arts, Switzerland, for providing the resources, funds and
technical facilities for the development of the piece during a residency at their
Computer Music Studio equipped with an Ambisonics system. My heartfelt
thanks go to composer Johannes Schütt for providing technical guidance and
all the other support offered during this residency. I thank the Institute of
Electronic Music and Acoustics at the University of Music and Performing
Arts, Graz, Austria for having me in the IEM residency 2015–2016, supporting
the project Exile and Other Syndromes.
Thanks to Professor Cathy Lane and Professor Angus Carlyle of Creative
Research into Sound Arts Practice (CRiSAP), University of the Arts London,
for inviting me to be part of the book In the Field: The Art of Field Recording
(2013) where I talk at length about my work. I would also like to thank the
invited guests and participants to the two-day seminar, Affective Atmospheres:
Site-specific Sound, Neighborhood Music and the Social Formation (2018),
that I organized at the American University of Beirut and to the International
Ambiances Network for supporting the event. Thanks to Ernst Karel, on whose
x
contents
xi
PART 1
INTRODUCTION
You can’t show everything; if you do, it’s no longer art. Art lies in sugges-
tion. The great difficulty for filmmakers is precisely not to show things.
(Robert Bresson 19831)
1 THE FIRST SOUND AND
THE CURIOSITY
3
the auditory setting
I started going to the cinema frequently and enrolled myself at the SRFTI,
India’s prestigious national film school, as a film sound student. While fas-
cinated by the tone, texture and layered composition of sounds from nature
and environmental or ‘ambient’2 sounds of places I encountered, I also lis-
tened critically to the sonic universe of film each time I went in the cinema.
Through my experiences of various cinematic genres, I confronted the absence
of ‘ambience’ or sounds from the film’s ‘actual sites’. In my first scholarly
paper (Chattopadhyay 2007),3 I focused on how ambience could contribute to
a sense of place if given enough scope in filmmaking. I argued that the imposed
limitations practised in standard film sound production create lapses in the
existence and recognition of site-specific sonic information for each film’s
‘soundscape’. By this time, in 2007, I was already making field recordings and
composing with ambient sound in response to the screen-centric and visually
dominated field of film production. My shift to artistic practice as opposed to
becoming a film industry sound technician can be seen as a critical inclination
and personal choice. The above-mentioned paper was the beginning of my
work’s critical articulation within a growing interest for sound studies and
academia in general, not only to voice my concerns on these issues but also to
situate my artistic practice within this conundrum and the genealogy of sound
practice in general. At a certain stage, these considerations were instrumental
in initiating and unfolding this book project.
My sound art practice was simultaneously driven by environmental con-
cerns. Through field recordings in sites torn by industrialisation, I was exposed
to the environmental decay in many parts of a rapidly developing and re-
emerging India. I questioned how many of these transitory sites and envi-
ronmentally troubled landscapes were frequented and depicted in film and
media productions, and how sensitive they were towards sonic environments
disappearing at the hands of the profit-hungry consuming natural resources,
including fields, grasslands and various other natural sites. I was aware that the
intricate layers of environmental sounds from these sites would be lost through
technological exploitation and mediation, turning the landscape into a site
of spectacle, consumption and entertainment. The cultural appropriation of
nature and the environment and its audiovisual resources into man-made envi-
rons in architecture, buildings as well as film, media and cultural production,
became a focus in my work. I was moved by the fact that natural ambience was
being engulfed by mediated ambience, fulfilling human needs to the detriment
of ecological organisms.
At this time, worldwide communities began waking up from their slumber
to slowly face the realities of climate change. In November 1992 around
1,700 leading thinkers from around the globe, including a number of Nobel
laureates, issued an ardent appeal:
4
the first sound and the curiosity
Human beings and the natural world are on a collision course. Human
activities inflict harsh and often irreversible damage on the environment
and on critical resources. If not checked, many of our current practices
put at serious risk the future that we wish for human society and the
plant and animal kingdoms, and may so alter the living world that it
will be unable to sustain life in the manner that we know. Fundamental
changes are urgent if we are to avoid the collision our present course will
bring about.4
5
the auditory setting
making sonic environments in film, media arts and other audiovisual media
and technology-based arts that are consumed for both entertainment and
aesthetic engagement. Through this knowledge, aspects of the impact humans
have had on environments can be measured in relation to current environmen-
tal and ecological crises, and the prevailing Anthropocene.
1.2 Mise-en-sonore
In narrative works, the setting can be understood as the environment in which
a story or event takes place. Setting includes specific information about an
environmental situation as a description of place and time. It presents a back-
drop for narrative action. Careful engagement with this setting can result in
the meaningful portrayal of a site and its environs. The setting made within
a mediated world such as film or media artwork requires information about
place, the spatial situation and time arranged as aural and visual elements to
evoke intricate sights, sounds and other sensations of location and ‘situated-
ness’. I term the sonic environment crafted within a film and media production
as ‘auditory setting’ or mise-en-sonore,6 which is constructed by using a spe-
cific sound component known as ‘ambience’ or ‘ambient sound’.7 Ambience is
a standard term used by sound practitioners to denote the site-specific sounds
that provide characteristic atmosphere and spatial information in audiovisual
productions. How ambience or ambient sound is used as a site-specific element
to compose the auditory setting that renders a spatial sensation during the
production of films, media art and sound artworks is examined throughout
the book. Focus is placed on processes that (re)construct a site’s presence using
ambient sounds recorded from that site. In film it is often a fictional site. In
field recording-based media artworks it is the site for making a recording with
the purpose of developing a site-aware artistic production.
The mediated worlds within any work of sound production emerge through
the narrative and descriptive accounts of a place or site8 through the recording
and spatial organisation of sounds. Audiences engage with the site by recog-
nising its presence within this constructed world. The produced experience of
presence varies in degree and intensity depending on the sound practitioners’9
and sound artists’ attention to the site’s sonic details. The mediated world
appears convincing if the site’s resonance reverberates in the ears of its audi-
ence and triggers their sonic sensibilities long after it has been experienced. It is
no surprise then that the fundamental element of establishing a site’s presence
through sound is of foremost importance when it comes to convincingly con-
veying the narrative and descriptive account of a particular site.
This leads to a crucial question: How is the sonic environment of a spe-
cific site (re)produced in film and media artwork? Certainly, specific methods
and creative strategies are involved in constructing or evoking the relatively
6
the first sound and the curiosity
7
the auditory setting
(Sonnenschein 2001: 47). Film scholar Béla Balázs proclaims that it is sound’s
business to reveal the acoustic environment, the landscape that we experi-
ence every day as the ‘intimate whispering of the nature’ (Balázs 1985: 116).
Theories of spatial cognition also suggest that natural, site-specific, environ-
mental sounds can reinforce spatial aspects of perception ‘focusing primarily
on perception of sound-source direction’ (Waller and Nadel 2013: 83). These
varied perspectives indicate how ambient sounds provide depth and a spatial
dimension to a particular filmic sequence by establishing an environment con-
ducive to eliciting cognitive association between audience and site, reinforcing
‘the impression of reality’ (Percheron 1980: 17). In film, the organisation and
design of ambient sound completes a perception of reality in terms of aural
perspective and localisation,12 enabling audience members to relate to the spe-
cifics of a site’s sonic environment. Film sound scholar William Whittington’s
work (2007) focuses on science-fiction films, in which he unpacks the idea of
ambiences (or ‘ambient noises’ in his definition) and their role in the devel-
oping craft of sound design to not only provide a ‘sonic long shot’ (2007:
137) but also to reveal dramatic elements. Aesthetics scholar Martin Seel sees
ambient sound as the architect of the ‘interconnection of filmic space with the
space that is presented in the film’ (Seel 2018: 9). Contemporary film schol-
ars like Elsie Walker (2015) note ‘the contextualizing space’ by multi-track
ambient sounds drawing on Michel Chion’s coinage ‘superfield’ denoting to
‘the space created in multitrack films by ambient natural sounds’ (1994: 150).
These perspectives may be consolidated in a thorough, practice-based and
reflective analysis of ambient sound’s specific position in cinema by a more
sensitive listening.
Scholar of film sound production Tomlinson Holman states that ‘ambience
most typically consists of more or less continuous sound, often with a low-
frequency emphasis we associate with background noise of spaces’ (Holman
1997: 177). The advent of digital recording makes it possible to record these
deep layers of low-frequency sounds (Kerins 2011). Earlier recording media
– namely analogue optical recording and analogue magnetic recording – had
a limited dynamic range and was less capable of capturing the full spectrum
of ambient sounds, thus weakly affecting the way fictional sites could be por-
trayed in narration.
Trajectories of sound production within any national film industry such as
Indian cinema or Hollywood reveal shifts in location recording practices and
the mediation of myriad sonically produced environments. In both industries,
certain phases have determined sound production practices. For example, the
dubbing era (1960s–1990s in Indian cinema) and studio era (1930s–1950s in
Hollywood) centred less on the site and emphasised typical narrative tropes
such as song and dance sequences or musical scores. Since the digital era
(2000s–) in both Indian cinema and Hollywood, more realistic and concrete
8
the first sound and the curiosity
9
the auditory setting
historical trajectories are taken into consideration. The advent of digital tech-
nology has been especially successful in enabling rich layers of ambient sound
components to be incorporated into the production schemes of sound organi-
sation, which has somewhat homogenised sound production and sonic experi-
ences across the globe. A thorough study of the historical trajectories of sound
production leading to the contemporary digital domain, specifically focusing
on the use of ambient sound, will help contextualise critical listening, enquiry
and analyses. The comparative discussion of film examples from the wider field
of global cinema, including the less-discussed Indian and Asian films alongside
more-discussed American and European films will enrich the field. Indian
cinema, the largest producer of films in the global film industry, is as equally
a part of world cinema as European and American cinemas, though it faces a
lack of critical engagement. The inclusive and wide-ranging case studies from
Indian and other Asian cinema alongside their American and European coun-
terparts can generate new knowledge and add dimensions to the field of sound
studies, film sound and media art history.
10
the first sound and the curiosity
Notes
1. Cardullo (2009).
2. Though both connote the same meaning, in this book, I will be using ‘ambient
sound’ more often than ‘environmental sound’. The reason is to be faithful to the
practitioners’ terminology, while considering ‘environmental sound’ to be over-
loaded with an ecological discourse, which I would like to let gradually unfold in
the book.
3. Chattopadhyay (2007).
4. To access the article, see: https://www.ucsusa.org/about/1992-world-scientists.
html
5. See: https://science.gu.se/digitalAssets/1671/1671867_world-scientists-warning-to-
humanity_-a-second-notice_english.pdf
6. Mise-en-sonore is a neologism that will be explained fully while unpacking the
term ‘auditory setting’. The term draws on the idea of mise-en-scène, meaning the
arrangement of objects within a pro-filmic space and its visual framing, but rather
focuses on the arrangement of sounds within a pro-filmic space and its record-
ing. Altman, with McGraw Jones and Sonia Tatroe coined the term ‘mise-en-
bande’ (2000: 341), meaning the interaction of various sound components in the
soundtrack. While ‘mise-en-bande’ is concerned with the audio-audio relationship
between various elements of the soundtrack, e.g. voice, sound effects and music, my
proposed coinage mise-en-sonore focuses on the sound’s complex relationship with
site and space in cinema, and denotes the sonorous film space constructed through
the recording of the space and designing these recorded sounds for narration.
7. The terms broadly denote background sounds that are present in a scene or loca-
tion: wind, water, birds, room tone, office rumbles, traffic, forest murmurs, waves
from seashores, neighbourhood mutterings, etc. According to the online resources
11
the auditory setting
12
the first sound and the curiosity
middle ground in their organization of, or relationship with, the profilmic event: as
for example in the case of location-shot’ (Kuhn and Westwell 2014/2015: n.p.).
14. The term ‘environmental sound art’ has been coined by some sound artists and
incorporates processes in which the artist actively engages with the environ-
ment. See: https://global.oup.com/academic/product/environmental-sound-artists-
9780190234614?cc=dk&lang=en&#
15. See: https://earroom.wordpress.com/2013/12/04/seth-kim-cohen/
13