Tuning In to Intangibility : Reflections from My First 3 Years of Theremin Learning
Pages 2649 - 2659
Abstract
This paper presents an autoethnography of 3 years of learning to play the theremin, an instrument lacking tangible feedback. While the theremin is typically invoked in HCI to emphasize the importance of the tactile modality, we interrogate how I, the player, attained musical proficiency without touch.
Through a thematic analysis of 235 journal entries, our study distills my strategies for navigating the instrument as well as my personal transformations along the way. We discover that without touch, accurate and musical playing on the theremin relies on continuous auditory feedback, proprioception, and imaginative processes. We discuss challenges and opportunities for embodied and tangible interaction in light of these findings.
References
[1]
Eckart Altenmüller and Gottfried Schlaug. 2013. Neurologic music therapy: The beneficial effects of music making on neurorehabilitation. Acoustical Science and Technology 34, 1 (2013), 5–12.
[2]
Tove Grimstad Bang and Sarah Fdili Alaoui. 2023. Suspended Circles: Soma Designing a Musical Instrument. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–15.
[3]
Tove Grimstad Bang, Sarah Fdili Alaoui, and Elisabeth Schwartz. 2023. Designing in conversation with dance practice. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
[4]
Edgar Berdahl, Günter Niemeyer, and Julius O Smith III. 2009. Using haptics to assist performers in making gestures to a musical instrument. In NIME. 177–182.
[5]
Frédéric Bevilacqua, Eric O Boyer, Jules Françoise, Olivier Houix, Patrick Susini, Agnès Roby-Brami, and Sylvain Hanneton. 2016. Sensori-motor learning with movement sonification: perspectives from recent interdisciplinary studies. Frontiers in neuroscience 10 (2016), 385.
[6]
Ran Blake. 2010. Primacy of the Ear. Lulu. com (2010).
[7]
Hans-Joachim Braun. 2009. Pulled out of thin air? The revival of the Theremin. Sound Souvenirs: Audio Technologies, Memory and Cultural Practices (2009), 139–151.
[8]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
[9]
Bill Buxton and Mark Billinghurst. 2011. Gesture based interaction. Human Input to Computer Systems: Theories, Techniques and Technology (2011).
[10]
Miguel Civit, Javier Civit-Masot, Francisco Cuadrado, and Maria J Escalona. 2022. A systematic review of artificial intelligence-based music generation: Scope, applications, and future trends. Expert Systems with Applications (2022), 118190.
[11]
Terry Clark, Aaron Williamon, and Aleksandar Aksentijevic. 2012. Musical imagery and imagination: The function, measurement, and application of imagery skills for performance. Musical imaginations: Multidisciplinary perspectives on creativity, performance, and perception (2012), 351–365.
[12]
Mihaly Csikszentmihalyi, Sami Abuhamdeh, and Jeanne Nakamura. 2005. Flow. Handbook of competence and motivation (2005), 598–608.
[13]
Audrey Desjardins and Aubree Ball. 2018. Revealing Tensions in Autobiographical Design in HCI. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM. https://doi.org/10.1145/3196709.3196781
[14]
Paul Dourish. 2004. Where the action is: the foundations of embodied interaction. MIT press.
[15]
Carolyn Ellis, Tony E. Adams, and Arthur P. Bochner. 2011. Autoethnography: An Overview. Historical Social Research / Historische Sozialforschung 36, 4 (138) (2011), 273–290. http://www.jstor.org/stable/23032294
[16]
K Anders Ericsson, Ralf T Krampe, and Clemens Tesch-Römer. 1993. The role of deliberate practice in the acquisition of expert performance.Psychological review 100, 3 (1993), 363.
[17]
Jules Françoise, Sarah Fdili Alaoui, and Yves Candau. 2022. CO/DA: Live-Coding Movement-Sound Interactions for Dance Improvisation. In CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3491102.3501916
[18]
Jules Françoise, Sarah Fdili Alaoui, Thecla Schiphorst, and Frédéric Bevilacqua. 2014. Vocalizing dance movement for interactive sonification of laban effort factors. In Proceedings of the 2014 conference on Designing interactive systems. 1079–1082.
[19]
Karmen Franinovic and Stefania Serafin. 2013. Sonic interaction design. Mit Press.
[20]
James J. Gibson. 2014. The Ecological Approach to Visual Perception. Psychology Press.
[21]
Albert Glinsky. 2000. Theremin: ether music and espionage. University of Illinois Press.
[22]
Martin Heidegger. 1962. Being and time (J. Macquarrie & E. Robinson, trans.).
[23]
Patricia Ann Holmes. 2003. How Do They Remember All Those Notes?: A Study of the Integrated Roles of Emotion, Imagery and Technique During the Learning and Memorisation Processes of Two Experiences Solo Instrumentalists. Ph. D. Dissertation. University of Sheffield, Department of Music.
[24]
Sarah Homewood, Amanda Karlsson, and Anna Vallgårda. 2020. Removal as a Method: A Fourth Wave HCI Approach to Understanding the Experience of Self-Tracking. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS ’20). Association for Computing Machinery, New York, NY, USA, 13 pages. https://doi.org/10.1145/3357236.3395425
[25]
Kristina Höök. 2010. Transferring qualities from horseback riding to design. Proc NordiCHI’10 (2010), 226–235. http://portal.acm.org/citation.cfm?doid=1868914.1868943
[26]
Kristina Höök, Baptiste Caramiaux, Cumhur Erkut, Jodi Forlizzi, Nassrin Hajinejad, Michael Haller, Caroline Hummels, Katherine Isbister, Martin Jonsson, George Khut, Lian Loke, Danielle Lottridge, Patrizia Marti, Edward Melcer, Florian Müller, Marianne Petersen, Thecla Schiphorst, Elena Segura, Anna Ståhl, Dag Svanæs, Jakob Tholander, and Helena Tobiasson. 2018. Embracing First-Person Perspectives in Soma-Based Design. Informatics 5, 1 (feb 2018), 8. https://doi.org/10.3390/informatics5010008
[27]
Edmund Husserl and Dermot Moran. 2012. Ideas: General introduction to pure phenomenology. Routledge.
[28]
Hiroshi Ishii. 2008. Tangible bits: beyond pixels. In Proceedings of the 2nd international conference on Tangible and embedded interaction. xv–xxv.
[29]
Dhruv Jain, Audrey Desjardins, Leah Findlater, and Jon E. Froehlich. 2019. Autoethnography of a Hard of Hearing Traveler. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (Pittsburgh, PA, USA) (ASSETS ’19). Association for Computing Machinery, New York, NY, USA, 13 pages. https://doi.org/10.1145/3308561.3353800
[30]
Emile Jaques-Dalcroze. 2014. Rhythm, music and education. Read Books Ltd.
[31]
Alexander Refsum Jensenius. 2022. Sound actions: conceptualizing musical instruments. The MIT Press, Cambridge.
[32]
Lydia Kavina and Elizabeth Parcells. 1996. My Experience with the Theremin. Leonardo Music Journal 6, 1 (1996), 51–55.
[33]
David Kirsh. 2013. Embodied Cognition and the Magical Future of Interaction Design. ACM Trans. Comput.-Hum. Interact. 20, 1, Article 3 (April 2013), 30 pages. https://doi.org/10.1145/2442106.2442109
[34]
Andreas C Lehmann. 1997. Acquired mental representations in music performance: Anecdotal and preliminary empirical evidence. Does practice make perfect (1997), 141–163.
[35]
Lisa J Lehmberg and C Victor Fung. 2010. Benefits of music participation for senior citizens: A review of the literature. Music Education Research International 4, 1 (2010), 19–30.
[36]
Marc Leman. 2007. Embodied Music Cognition and Mediation Technology. MIT press. https://doi.org/10.7551/mitpress/7476.001.0001
[37]
Micheline Lesaffre, Pieter-Jan Maes, and Marc Leman. 2017. The Routledge companion to embodied music interaction. Routledge, Chapter Introduction, 1.
[38]
Alex Lough, Mark Micchelli, and Mari Kimura. 2018. Gestural envelopes: Aesthetic considerations for mapping physical gestures using wireless motion sensors. In ICMC.
[39]
Andrés Lucero. 2018. Living Without a Mobile Phone: An Autoethnography. In Proceedings of the 2018 Designing Interactive Systems Conference (Hong Kong, China) (DIS ’18). Association for Computing Machinery, New York, NY, USA, 12 pages. https://doi.org/10.1145/3196709.3196731
[40]
Maurice Merleau-Ponty. 2013. Phenomenology of Perception. Routledge.
[41]
David Miller and Jeffrey McFarland-Johnson (Eds.). 1998. Clara Rockmore Method for the Theremin.
[42]
Alexander Mordvintsev, Christopher Olah, and Mike Tyka. 2015. Inceptionism: Going deeper into neural networks. (2015).
[43]
Luc Nijs. 2017. The merging of musician and musical instrument: Incorporation, presence, and levels of embodiment. In The Routledge companion to embodied music interaction. Routledge, 49–57.
[44]
Maura Sile O’Modhrain. 2001. Playing by feel: incorporating haptic feedback into computer-based musical instruments. Stanford University.
[45]
Seymour A Papert. 2020. Mindstorms: Children, computers, and powerful ideas. Basic books.
[46]
Mitchel Resnick. 2014. Give P’sa chance: Projects, peers, passion, play. In Constructionism and creativity: Proceedings of the third international constructionism conference. Austrian computer society, Vienna. 13–20.
[47]
Jean-Philippe Rivière, Sarah Fdili Alaoui, Baptiste Caramiaux, and Wendy E Mackay. 2018. How Do Dancers Learn To Dance? A first-person perspective of dance acquisition by expert contemporary dancers. In Proceedings of the 5th International Conference on Movement and Computing. 1–7.
[48]
Joseph Rovan and Vincent Hayward. 2000. Typology of tactile sounds and their synthesis in gesture-driven computer music performance. Trends in gestural control of music (2000), 297–320.
[49]
David Matthew Sachs. 2005. A forearm controller and tactile display. Ph. D. Dissertation. Massachusetts Institute of Technology.
[50]
Stefania Serafin, Cumhur Erkut, Juraj Kojs, Niels C Nilsson, and Rolf Nordahl. 2016. Virtual reality musical instruments: State of the art, design principles, and future directions. Computer Music Journal 40, 3 (2016), 22–40.
[51]
Anna Ståhl, Vasiliki Tsaknaki, and Madeline Balaam. 2021. Validity and Rigour in Soma Design-Sketching with the Soma. ACM Transactions on Computer-Human Interaction 28, 6 (dec 2021), 1–36. https://doi.org/10.1145/3470132
[52]
David Sudnow. 1978. Ways of the hand: The Organization of Improvised Conduct. (1978).
[53]
David Sudnow and Hubert L Dreyfus. 2001. Ways of the hand: A rewritten account. (2001).
[54]
Atau Tanaka. 2009. Sensor-based musical instruments and interactive music. na.
[55]
Junichiro Tanizaki. 2001. In praise of shadows. Random House.
[56]
Moss William’Pete’ and Bryan Cunitz. 2005. Haptic Theremin: Developing a Haptic Musical controller using the Sensable Phantom Omni. In ICMC.
[57]
Xiao Xiao, Nicolas Audibert, Grégoire Locqueville, Christophe d’Alessandro, Barbara Kuhnert, and Claire Pillot-Loiseau. 2021. Prosodic disambiguation using chironomic stylization of intonation with native and non-native speakers. In Interspeech 2021. ISCA, 516–520.
[58]
Xiao Xiao and Hiroshi Ishii. 2016. Inspect, embody, invent: a design framework for music learning and beyond. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5397–5408.
[59]
Xiao Xiao, Barbara Kuhnert, Nicolas Audibert, Grégoire Locqueville, Claire Pillot-Loiseau, Haohan Zhang, and Christophe d’Alessandro. 2023. Performative Vocal Synthesis for Foreign Language Intonation Practice. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–9.
[60]
Xiao Xiao, Pablo Puentes, Edith Ackermann, and Hiroshi Ishii. 2016. Andantino: Teaching children piano with projected animated characters. In Proceedings of the the 15th international conference on interaction design and children. 37–45.
[61]
Robert J Zatorre and Andrea R Halpern. 2005. Mental concerts: musical imagery and auditory cortex. Neuron 47, 1 (2005), 9–12.
[62]
Xiao Zhang and Ron Wakkary. 2014. Understanding the Role of Designers’ Personal Experiences in Interaction Design Practice. In Proceedings of the 2014 Conference on Designing Interactive Systems (Vancouver, BC, Canada) (DIS ’14). Association for Computing Machinery, New York, NY, USA, 10 pages. https://doi.org/10.1145/2598510.2598556
Index Terms
- Tuning In to Intangibility : Reflections from My First 3 Years of Theremin Learning
Recommendations
A Retrospective Autoethnography Documenting Dance Learning Through Data Physicalisations
DIS '24: Proceedings of the 2024 ACM Designing Interactive Systems ConferenceWe present a retrospective autoethnography grounded in data-driven design. The first author collected her movement data and subjective experience of learning the dance repertoire of modern dance pioneer Isadora Duncan, which together were encoded into ...
Music-ensemble robot that is capable of playing the theremin while listening to the accompanied music
IEA/AIE'10: Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part IOur goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the ...
Music and HCI
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsMusic is an evolutionarily deep-rooted, abstract, real-time, complex, non-verbal, social activity. Consequently, interaction design in music can be a valuable source of challenges and new ideas for HCI. This workshop will reflect on the latest research ...
Comments
Information & Contributors
Information
Published In
July 2024
3616 pages
ISBN:9798400705830
DOI:10.1145/3643834
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
DIS '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 41Total Downloads
- Downloads (Last 12 months)41
- Downloads (Last 6 weeks)41
Reflects downloads up to 11 Aug 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format