research-article

Ambient Rhythm: Melodic Sonification of Status Information for IoT-enabled Devices

Authors:

George Chernyshov,

Vontin Noriyasu,

Kai KunzeAuthors Info & Claims

IoT '16: Proceedings of the 6th International Conference on the Internet of Things

Pages 1 - 6

https://doi.org/10.1145/2991561.2991564

Published: 07 November 2016 Publication History

Abstract

In this paper we explore how to embed status information of IoT-enabled devices in the acoustic atmosphere using melodic ambient sounds while limiting obtrusiveness for the user. The user can use arbitrary sound samples to represent the devices he wants to monitor. Our system combines these sound samples into a melodic ambient rhythm that contains information on all the processes or variables that user is monitoring. We focus on continuous rather than binary information (e.g. "monitoring progress status" rather then "new message received"). We evaluate our system in a machine monitoring scenario focusing on 5 distinct machines/processes to monitor with 6 priority levels for each. 9 participants use our system to monitor these processes with an up to 92.44% detection rate, if several levels are combined. Participants had no previous experience with this or similar systems and had only 5-10 minute training session before the tests.

References

[1]

Gaetano Borriello, Alan Liu, Tony Offer, Christopher Palistrant, and Richard Sharp. 2005. WALRUS: wireless acoustic location with room-level resolution using ultrasound. In Proceedings of the 3rd international conference on Mobile systems, applications, and services. ACM, 191--203.

Digital Library

[2]

Andreas Butz and Ralf Jung. 2005. Seamless user notification in ambient soundscapes. In Proceedings of the 10th international conference on Intelligent user interfaces. ACM, 320--322.

Digital Library

[3]

Ádám Csapó and György Wersényi. 2013. Overview of auditory representations in human-machine interfaces. ACM Computing Surveys (CSUR) 46, 2 (2013), 19.

Digital Library

[4]

Anind K Dey, Gregory D Abowd, and Daniel Salber. 2001. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-computer interaction 16, 2 (2001), 97--166.

Digital Library

[5]

Greg T Elliott and Bill Tomlinson. 2006. PersonalSoundtrack: context-aware playlists that adapt to user pace. In CHI'06 extended abstracts on Human factors in computing systems. ACM, 736--741.

Digital Library

[6]

Zwicker E Fastl H. 2006. Psychoacoustics. Springer.

[7]

William W Gaver. 1986. Auditory icons: Using sound in computer interfaces. Human-computer interaction 2, 2 (1986), 167--177.

Digital Library

[8]

Anssi Kainulainen, Markku Turunen, and Jaakko Hakulinen. 2009. Awareness information with speech and sound. In Awareness Systems. Springer, 231--256.

[9]

Kent Lyons, Maribeth Gandy, and Thad Starner. 2000. Guided by voices: An audio augmented reality system. (2000).

[10]

Anil Madhavapeddy, David Scott, and Richard Sharp. 2003. Context-aware computing with sound. In UbiComp 2003: Ubiquitous Computing. Springer, 315--332.

[11]

Elizabeth D Mynatt, Maribeth Back, Roy Want, Michael Baer, and Jason B Ellis. 1998. Designing audio aura. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM Press/Addison-Wesley Publishing Co., 566--573.

Digital Library

[12]

Aditya Shekhar Nittala, Xing-Dong Yang, Scott Bateman, Ehud Sharlin, and Saul Greenberg. 2015. PhoneEar: interactions for mobile devices that hear high-frequency sound-encoded data. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. ACM, 174--179.

Digital Library

[13]

Spencer Russell, Gershon Dublon, and Joseph A Paradiso. 2016. HearThere: Networked Sensory Prosthetics Through Auditory Augmented Reality. In Proceedings of the 7th Augmented Human International Conference 2016. ACM, 20.

Digital Library

[14]

Nitin Sawhney and Chris Schmandt. 2000. Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments. ACM transactions on Computer-Human interaction (TOCHI) 7, 3 (2000), 353--383.

Digital Library

[15]

Timothy Sohn, William G Griswold, James Scott, Anthony LaMarca, Yatin Chawathe, Ian Smith, and Mike Chen. 2006. Experiences with place lab: an open source toolkit for location-aware computing. In Proceedings of the 28th international conference on Software engineering. ACM, 462--471.

Digital Library

Cited By

Al Muhander BWiese JRana OPerera C(2023)Interactive Privacy Management: Toward Enhancing Privacy Awareness and Control in the Internet of ThingsACM Transactions on Internet of Things10.1145/36000964:3(1-34)Online publication date: 21-Sep-2023
https://dl.acm.org/doi/10.1145/3600096
Garner TGarner T(2017)Current StatusEchoes of Other Worlds: Sound in Virtual Reality10.1007/978-3-319-65708-0_8(255-298)Online publication date: 2-Sep-2017
https://doi.org/10.1007/978-3-319-65708-0_8

Index Terms

Ambient Rhythm: Melodic Sonification of Status Information for IoT-enabled Devices
1. Human-centered computing

Recommendations

Continuous sonification enhances adequacy of interactions in peripheral process monitoring

As many users who are charged with process monitoring need to focus mainly on other work while performing monitoring as a secondary task, monitoring systems that purely rely on visual means are often not well suited for this purpose. Sonification, the ...
Lyricon Lyrics + Earcons Improves Identification of Auditory Cues
Proceedings, Part II, of the 4th International Conference on Design, User Experience, and Usability: Users and Interactions - Volume 9187

Auditory researchers have developed various non-speech cues in designing auditory user interfaces. A preliminary study of "lyricons" lyricsï ź+ï źearcons [1] has provided a novel approach to devising auditory cues in electronic products, by combining ...
Aesthetic strategies in sonification

Sound can be listened to in various ways and with different intentions. Multiple factors influence how and what we perceive when listening to sound. Sonification, the acoustic representation of data, is in essence just sound. It functions as ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IoT '16: Proceedings of the 6th International Conference on the Internet of Things

November 2016

186 pages

ISBN:9781450348140

DOI:10.1145/2991561

Conference Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Florian Michahelles
Siemens Corporate Technology, USA
,
Stefan Schneegass
University of Stuttgart, Germany
,
Program Chairs:
Mareike Kritzler
Siemens Corporate Technology, USA
,
Alexander Ilic
University of St. Gallen/ ETH Zurich, CH
,
Kai Kunze
Keio Media Design, JP

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

Universität Stuttgart: Universität Stuttgart

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

IoT'16

IoT'16: The 6th International Conference on the Internet of Things

November 7 - 9, 2016

Stuttgart, Germany

Acceptance Rates

Overall Acceptance Rate 28 of 84 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
190
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Al Muhander BWiese JRana OPerera C(2023)Interactive Privacy Management: Toward Enhancing Privacy Awareness and Control in the Internet of ThingsACM Transactions on Internet of Things10.1145/36000964:3(1-34)Online publication date: 21-Sep-2023
https://dl.acm.org/doi/10.1145/3600096
Garner TGarner T(2017)Current StatusEchoes of Other Worlds: Sound in Virtual Reality10.1007/978-3-319-65708-0_8(255-298)Online publication date: 2-Sep-2017
https://doi.org/10.1007/978-3-319-65708-0_8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents