research-article

Open access

Elk Audio OS: An Open Source Operating System for the Internet of Musical Things

Authors:

Carlo FischioneAuthors Info & Claims

ACM Transactions on Internet of Things, Volume 2, Issue 2

Article No.: 12, Pages 1 - 18

https://doi.org/10.1145/3446393

Published: 27 March 2021 Publication History

All formats PDF

Abstract

As the Internet of Musical Things (IoMusT) emerges, audio-specific operating systems (OSs) are required on embedded hardware to ease development and portability of IoMusT applications. Despite the increasing importance of IoMusT applications, in this article, we show that there is no OS able to fulfill the diverse requirements of IoMusT systems. To address such a gap, we propose the Elk Audio OS as a novel and open source OS in this space. It is a Linux-based OS optimized for ultra-low-latency and high-performance audio and sensor processing on embedded hardware, as well as for handling wireless connectivity to local and remote networks. Elk Audio OS uses the Xenomai real-time kernel extension, which makes it suitable for the most demanding of low-latency audio tasks. We provide the first comprehensive overview of Elk Audio OS, describing its architecture and the key components of interest to potential developers and users. We explain operational aspects like the configuration of the architecture and the control mechanisms of the internal sound engine, as well as the tools that enable an easier and faster development of connected musical devices. Finally, we discuss the implications of Elk Audio OS, including the development of an open source community around it.

References

[1]

E. Baccelli, C. Gündoğan, O. Hahm, P. Kietzmann, M. S. Lenders, H. Petersen, K. Schleiser, T. C. Schmidt, and M. Wählisch. 2018. RIOT: An open source operating system for low-end embedded devices in the IoT. IEEE Internet Things J. 5, 6 (2018), 4428--4440.

[2]

E. Berdahl. 2014. How to make embedded acoustic instruments. In Proceedings of the Conference on New Interfaces for Musical Expression. 140--143.

[3]

E. Berdahl and W. Ju. 2011. Satellite CCRMA: A musical interaction and sound synthesis platform. In Proceedings of the Conference on New Interfaces for Musical Expression. 173--178.

[4]

E. Berdahl, S. Salazar, and M. Borins. 2013. Embedded networking and hardware-accelerated graphics with satellite CCRMA. In Proceedings of the Conference on New Interfaces for Musical Expression. 325--330.

[5]

E. Borgia. 2014. The Internet of Things vision: Key features, applications and open issues. Comput. Commun. 54 (2014), 1--31.

Digital Library

[6]

J. H. Brown and B. Martin. 2010. How fast is fast enough? Choosing between Xenomai and Linux for real-time applications. In Proceedings of the 12th Real-time Linux Workshop. 1--17.

[7]

G. C. Buttazzo. 2011. Hard Real-time Computing Systems: Predictable Scheduling Algorithms and Applications. Vol. 24. Springer Science & Business Media.

[8]

M. Centenaro, P. Casari, and L. Turchet. 2020. Towards a 5G communication architecture for the Internet of Musical Things. In Proceedings of the IEEE Conference of Open Innovations Association (FRUCT’20). IEEE, 38--45.

[9]

A. Dunkels, B. Gronvall, and T. Voigt. 2004. Contiki-a lightweight and flexible operating system for tiny networked sensors. In Proceedings of the 29th Annual IEEE International Conference on Local Computer Networks. IEEE, 455--462.

[10]

J. Eyre. 2001. The digital signal processor derby. IEEE Spectr. 38, 6 (2001), 62--68.

Digital Library

[11]

G. P. Fettweis. 2014. The Tactile Internet: Applications and challenges. IEEE Vehic. Technol. Mag. 9, 1 (2014), 64--70.

[12]

S. A. Finney. 1997. Auditory feedback and musical keyboard performance. Music Percept.: Interdisc. J. 15, 2 (1997), 153--174.

[13]

I. Franco and M. M. Wanderley. 2016. Prynth: A framework for self-contained digital music instruments. In Proceedings of the International Symposium on Computer Music Multidisciplinary Research. Springer, 357--370.

[14]

S. Fujii, M. Hirashima, K. Kudo, T. Ohtsuki, Y. Nakamura, and S. Oda. 2011. Synchronization error of drum kit playing with a metronome at different tempi by professional drummers. Music Percept.: Interdisc. J. 28, 5 (2011), 491--503.

[15]

L. Gabrielli and S. Squartini. 2016. Wireless Networked Music Performance. Springer.

[16]

D. D. Gajski, S. Abdi, A. Gerstlauer, and G. Schirner. 2009. Embedded System Design: Modeling, Synthesis and Verification. Springer Science & Business Media.

[17]

F. Goltz. 2018. Ableton Link–A technology to synchronize music software. In Proceedings of the Linux Audio Conference. 39--42.

[18]

D. D. Haddad and J. A. Paradiso. 2019. The world wide web in an analog patchbay. In Proceedings of the Conference on New Interfaces for Musical Expression. 407–410.

[19]

R. H. Jack, A. Mehrabi, T. Stockman, and A. McPherson. 2018. Action-sound latency and the perceived quality of digital musical instruments: Comparing professional percussionists and amateur musicians. Music Percept.: Interdisc. J. 36, 1 (2018), 109--128.

[20]

X. Jiang, H. Shokri-Ghadikolaei, G. Fodor, E. Modiano, Z. Pang, M. Zorzi, and C. Fischione. 2018. Low-latency networking: Where latency lurks and how to tame it. Proc. IEEE 107, 2 (2018), 280--306.

[21]

D. Keller, C. Gomes, and L. Aliel. 2019. The handy metaphor: Bimanual, touchless interaction for the internet of musical things. J. New Music Res. 48, 4 (2019), 385--396.

[22]

D. Keller and V. Lazzarini. 2017. Ecologically grounded creative practices in ubiquitous music. Organised Sound 22, 1 (2017), 61--72.

[23]

V. Lazzarini, S. Yi, J. Heintz, Ø. Brandtsegg, and I. McCurdy. 2016. Csound: A Sound and Music Computing System. Springer.

[24]

C. N. Leider. 2004. Digital Audio Workstation. McGraw-Hill.

[25]

P. Levis, S. Madden, J. Polastre, R. Szewczyk, K. Whitehouse, A. Woo, D. Gay, J. Hill, M. Welsh, E. Brewer, and D. Culler. 2005. TinyOS: An operating system for sensor networks. In Ambient Intelligence. Springer, 115--148.

[26]

M. Maier, M. Chowdhury, B. P. Rimal, and D. P. Van. 2016. The tactile internet: Vision, recent progress, and open challenges. IEEE Commun. Mag. 54, 5 (2016), 138--145.

Digital Library

[27]

A. Manzalini and F. Marino. 2018. Operating systems for 5G services infrastructures: Convergence between IT and telecommunications industry structures. In Proceedings of the IEEE 87th Vehicular Technology Conference. IEEE, 1--5.

[28]

A. T. Marasco and J. Allison. 2019. Connecting web audio to cyber-hacked instruments in performance. In Proceedings of the Web Audio Conference.

[29]

J. Martinez-Avila, C. Greenhalgh, A. Hazzard, S. Benford, and A. Chamberlain. 2019. Encumbered interaction: A study of musicians preparing to perform. In Proceedings of the Conference on Human Factors in Computing Systems. ACM, 1--13.

[30]

B. Matuszewski and F. Bevilacqua. 2018. Toward a web of audio things. In Proceedings of the Sound and Music Computing Conference.

[31]

J. McCartney. 2002. Rethinking the computer music language: SuperCollider. Comput. Music J. 26, 4 (2002), 61--68.

Digital Library

[32]

A. P. McPherson, R. H. Jack, and G. Moro. 2016. Action-sound latency: Are our tools fast enough? In Proceedings of the Conference on New Interfaces for Musical Expression.

[33]

A. McPherson and V. Zappi. 2015. An environment for submillisecond-latency audio and sensor processing on BeagleBone black. In Proceedings of the Audio Engineering Society Convention 138. Audio Engineering Society. Retrieved from http://www.aes.org/e-lib/browse.cfm?elib=17755.

[34]

E. Meneses, J. Wang, S. Freire, and M. M. Wanderley. 2019. A comparison of open-source Linux frameworks for an augmented musical instrument implementation. In Proceedings of the Conference on New Interfaces for Musical Expression. 222--227.

[35]

F. Morreale, G. Moro, A. Chamberlain, S. Benford, and A. McPherson. 2017. Building a maker community around an open hardware platform. In Proceedings of the Conference on Human Factors in Computing Systems. ACM, 6948--6959.

[36]

Y. Orlarey, D. Fober, and S. Letz. 2009. FAUST: An efficient functional approach to DSP programming. In New Computational Paradigms for Computer Music, G. Assayag and A. Gerzso (Eds.). Editions Delatour, Paris, France, 65--96.

[37]

M. Puckette. 1997. Pure data. In Proceedings of the International Computer Music Conference.

[38]

Federico Reghenzani, Giuseppe Massari, and William Fornaciari. 2019. The real-time Linux kernel: A survey on PREEMPT_RT. ACM Comput. Surveys 52, 1 (2019), 1--36.

Digital Library

[39]

C. Rossitto, A. Rostami, J. Tholander, D. McMillan, L. Barkhuus, C. Fischione, and L. Turchet. 2018. Musicians’ initial encounters with a smart guitar. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. ACM, New York, NY., 13--24.

[40]

C. Rottondi, M. Buccoli, M. Zanoni, D. Garao, G. Verticale, and A. Sarti. 2015. Feature-based analysis of the effects of packet delay on networked musical interactions. J. Audio Eng. Soc. 63, 11 (2015), 864--875.

[41]

C. Rottondi, C. Chafe, C. Allocchio, and A. Sarti. 2016. An overview on networked music performance technologies. IEEE Access 4 (2016), 8823--8843.

[42]

Z. Sheng, S. Yang, Y. Yu, A. V. Vasilakos, J. A. McCann, and K. K. Leung. 2013. A survey on the IETF protocol suite for the internet of things: Standards, challenges, and opportunities. IEEE Wireless Commun. 20, 6 (2013), 91--98.

[43]

H. Shokri-Ghadikolaei, C. Fischione, P. Popovski, and M. Zorzi. 2016. Design aspects of short-range millimeter-wave networks: A MAC layer perspective. IEEE Netw. 30, 3 (2016), 88--96.

Digital Library

[44]

D. Soldani and A. Manzalini. 2015. Horizon 2020 and beyond: On the 5G operating system for a true digital society. IEEE Vehic. Technol. Mag. 10, 1 (2015), 32--42.

[45]

G. Tanev and A. Božinovski. 2014. Virtual studio technology inside music production. In ICT Innovations 2013, V. Trajkovik and M. Anastas (Eds.). Springer International Publishing, Heidelberg, 231--241.

[46]

L. Turchet. 2019. Smart musical instruments: Vision, design principles, and future directions. IEEE Access 7 (2019), 8944--8963.

[47]

L. Turchet, F. Antoniazzi, F. Viola, F. Giunchiglia, and G. Fazekas. 2020. The internet of musical things ontology. J. Web Semant. 60 (2020), 100548.

Digital Library

[48]

L. Turchet and M. Barthet. 2019. Co-design of musical haptic wearables for electronic music performer’s communication. IEEE Trans. Hum.-Mach. Syst. 49, 2 (2019), 183--193.

[49]

L. Turchet and M. Barthet. 2019. An ubiquitous smart guitar system for collaborative musical practice. J. New Music Res. 48, 4 (2019), 352--365.

[50]

L. Turchet, M. Benincaso, and C. Fischione. 2017. Examples of use cases with smart instruments. In Proceedings of Audio Mostly Conference. 47:1–47:5.

[51]

L. Turchet, G. Fazekas, M. Lagrange, H. Shokri Ghadikolaei, and C. Fischione. 2020. The Internet of Audio Things: State-of-the-art, vision, and challenges. IEEE Internet Things J. 7, 10 (2020), 10233--10249.

[52]

L. Turchet, C. Fischione, G. Essl, D. Keller, and M. Barthet. 2018. Internet of Musical Things: Vision and challenges. IEEE Access 6 (2018), 61994--62017.

[53]

L. Turchet, A. McPherson, and M. Barthet. 2018. Real-time hit classification in a Smart Cajón. Front. ICT 5, 16 (2018).

[54]

L. Turchet, J. Pauwels, C. Fischione, and G. Fazekas. 2020. Cloud-smart musical instrument interactions: Querying a large music collection with a smart guitar. ACM Trans. Internet of Things 1, 3 (2020), 1--29.

Digital Library

[55]

L. Turchet, T. West, and M. M. Wanderley. 2020. Touching the audience: Musical haptic wearables for augmented and participatory live music performances. J. Person. Ubiq. Comput. (2020), 1–21.

[56]

L. Turchet, S. J. Willis, G. Andersson, A. Gianelli, and M. Benincaso. 2020. On making physical the control of audio plugins: The case of the retrologue hardware synthesizer. In Proceedings of Audio Mostly Conference. 146--151.

[57]

P. Verma, A. I. Mezzay, C. Chafe, and C. Rottondi. 2020. A deep learning approach for low-latency packet loss concealment of audio signals in networked music performance applications. In Proceedings of the 27th Conference of Open Innovations Association (FRUCT’20). IEEE, 268--275.

[58]

L. Vignati, S. Zambon, and L. Turchet. 2020 (submitted). A comparison of real-time Linux-based architectures for embedded musical applications. J. Audio Eng. Soc. (2020).

[59]

D. Wessel and M. Wright. 2002. Problems and prospects for intimate musical control of computers. Comput. Music J. 26, 3 (2002), 11--22.

Digital Library

[60]

S. Wilson, D. Cottle, and N. Collins. 2011. The SuperCollider Book. The MIT Press.

[61]

M. Wright. 2005. Open sound control: An enabling technology for musical networking. Organised Sound 10, 3 (2005), 193--200.

Digital Library

Cited By

Turchet L(2024)Entangled Internet of Musical Things and People: A More-Than-Human Design Framework for Networked Musical EcosystemsIEEE Transactions on Technology and Society10.1109/TTS.2024.34435405:4(355-367)Online publication date: Dec-2024
https://doi.org/10.1109/TTS.2024.3443540
Turchet LKrstulović S(2024)DSP as a Service: Foundations and DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34646965(6212-6226)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3464696
Turchet LRinaldi CCentofanti CVignati LRottondi C(2024)5G-Enabled Internet of Musical Things Architectures for Remote Immersive Musical PracticesIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34077085(4691-4709)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3407708
Show More Cited By

Elk Audio OS: An Open Source Operating System for the Internet of Musical Things

Recommendations

Cloud-smart Musical Instrument Interactions: Querying a Large Music Collection with a Smart Guitar

Large online music databases under Creative Commons licenses are rarely recorded by well-known artists, therefore conventional metadata-based search is insufficient in their adaptation to instrument players’ needs. The emerging class of smart musical ...
On making physical the control of audio plugins: the case of the retrologue hardware synthesizer
AM '20: Proceedings of the 15th International Audio Mostly Conference

This paper reports the development of a prototype of smart musical instrument that uses a virtual analog audio plugin in conjunction with a dedicated tangible interface and a platform for embedded audio. The adopted design approach started from an ...
Demo of a smart musical instrument-based real time pattern detection system
AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures

This manuscript focuses on a real-time pattern detection system using smart musical instruments, and its importance in Internet of Musical Things (IoMusT) applications, where smart musical instruments equipped with wireless connectivity and embedded ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Internet of Things

ACM Transactions on Internet of Things Volume 2, Issue 2

May 2021

176 pages

EISSN:2577-6207

DOI:10.1145/3458923

Editors:
Schahram Dustdar
TU Wien, Austria
,
Gian Pietro Picco
University of Trento, Italy

Issue’s Table of Contents

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 27 March 2021

Accepted: 01 December 2020

Received: 01 August 2020

Published in TIOT Volume 2, Issue 2

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

45
Total Citations
View Citations
4,227
Total Downloads

Downloads (Last 12 months)832
Downloads (Last 6 weeks)73

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Turchet L(2024)Entangled Internet of Musical Things and People: A More-Than-Human Design Framework for Networked Musical EcosystemsIEEE Transactions on Technology and Society10.1109/TTS.2024.34435405:4(355-367)Online publication date: Dec-2024
https://doi.org/10.1109/TTS.2024.3443540
Turchet LKrstulović S(2024)DSP as a Service: Foundations and DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34646965(6212-6226)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3464696
Turchet LRinaldi CCentofanti CVignati LRottondi C(2024)5G-Enabled Internet of Musical Things Architectures for Remote Immersive Musical PracticesIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34077085(4691-4709)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3407708
Turchet LCasari P(2024)On the Impact of 5G Slicing on an Internet of Musical Things SystemIEEE Internet of Things Journal10.1109/JIOT.2024.342228711:19(32079-32088)Online publication date: 1-Oct-2024
https://doi.org/10.1109/JIOT.2024.3422287
Turchet LCasari P(2024)Latency and Reliability Analysis of a 5G-Enabled Internet of Musical Things SystemIEEE Internet of Things Journal10.1109/JIOT.2023.328881811:1(1228-1240)Online publication date: 1-Jan-2024
https://doi.org/10.1109/JIOT.2023.3288818
Genovese AGospodarek MNguyen ZPahle RRoginska A(2024)Locally Adapted Immersive Environments for Distributed Music Performances in Mixed Reality2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704217(1-10)Online publication date: 30-Sep-2024
https://doi.org/10.1109/IS262782.2024.10704217
Turchet LCasari P(2024)The Internet of Musical Things Meets Satellites: Evaluating Starlink Support for Networked Music Performances in Rural Areas2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704207(1-8)Online publication date: 30-Sep-2024
https://doi.org/10.1109/IS262782.2024.10704207
Grimm GDaeglau MHohmann VDebener S(2024)EEG Hyperscanning in the Internet of Sounds: Low-Delay Real-Time Multi-Modal Transmission Using the OVBOX2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704205(1-8)Online publication date: 30-Sep-2024
https://doi.org/10.1109/IS262782.2024.10704205
Ciapponi SPaissan FAncilotto AFarella E(2024)TinyVocos: Neural Vocoders on MCUs2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704173(1-10)Online publication date: 30-Sep-2024
https://doi.org/10.1109/IS262782.2024.10704173
Turchet LTomelleri JRuffo A(2024)MusicoNet: A Social Network for Musicians Based on the Internet of Musical Things and People Paradigm2024 IEEE 5th International Symposium on the Internet of Sounds (IS2)10.1109/IS262782.2024.10704117(1-9)Online publication date: 30-Sep-2024
https://doi.org/10.1109/IS262782.2024.10704117
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents