Article

Explorations in sound for tilting-based interfaces

Authors:

Michael RohsAuthors Info & Claims

ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Pages 295 - 301

https://doi.org/10.1145/1180995.1181052

Published: 02 November 2006 Publication History

Abstract

Everyday experience as well as recent studies tell that information contained in ecological sonic feedback may improve human control of, and interaction with, a system. This notion is particularly worthwhile to consider in the context of mobile, tilting-based interfaces as have been proposed, developed and studied extensively. Two interfaces are used for this scope, the Ballancer, based on the metaphor of balancing a rolling ball on a track, and a more concretely application-oriented setup of a mobile phone with tilting-based input. First pilot studies have been conducted.

References

[1]

J. F. Bartlett. Rock 'n' scroll is here to stay. IEEE Comput. Graph. Appl., 20(3):40--45, 2000.

Digital Library

[2]

K. P. Fishkin, A. Gujar, B. L. Harrison, T. P. Moran, and R. Want. Embodied user interfaces for really direct manipulation. Commun. ACM, 43(9):74--80, 2000.

Digital Library

[3]

K. P. Fishkin, T. P. Moran, and B. L. Harrison. Embodied user interfaces: Towards invisible user interfaces. In Proceedings of the Seventh Working Conference on Engineering for Human-Computer Interaction, EHCI 98, pages 1--18, Heraklion, Crete, September 13-18 1999. Kluwer, B.V.

Digital Library

[4]

W. W. Gaver. Everyday listening and auditory icons. PhD thesis, University of California, San Diego, 1988.

Digital Library

[5]

W. W. Gaver. How Do We Hear in the World? Explorations in Ecological Acoustics. Ecological Psychology, 5(4):285--313, Apr. 1993.

[6]

W. W. Gaver. What in the world do we hear? an ecological approach to auditory event perception. Ecological Psychology, 5(1):1--29, 1993.

[7]

B. L. Harrison, K. P. Fishkin, A. Gujar, C. Mochon, and R. Want. Squeeze me, hold me, tilt me! an exploration of manipulative user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 17--24. ACM Press/Addison-Wesley Publishing Co., 1998.

Digital Library

[8]

K. Hinckley, J. Pierce, M. Sinclair, and E. Horvitz. Sensing techniques for mobile interaction. In Proceedings of the 13th annual ACM symposium on User interface software and technology, pages 91--100. ACM Press, 2000.

Digital Library

[9]

M. Rath. Gestural exploitation of ecological information in continuous sonic feedback - the case of balancing a rolling ball. In Proceedings of the 8th International Conference on Digital Audio Effects (DAFx'05), pages 98--103, Madrid, Spain, 2005.

[10]

Pure data, pd. http://www.pure-data.org.

[11]

M. Rath. An expressive real-time sound model of rolling. In Proceedings of the 6th "International Conference on Digital Audio Effects" (DAFx-03), London, United Kingdom, September 2003.

[12]

M. Rath. Interactive Realtime Sound Models for Human-Computer Interaction - A Sound Design Concept and Applications. PhD thesis, Department of Computer Science, University of Verona, 2004. available online under http://www.di.univr.it/dol/main?ent=pubbdip, "research reports".

[13]

M. Rath and D. Rocchesso. Informative sonic feedback for continuous human-machine interaction - controlling a sound model of a rolling ball. IEEE Multimedia Special on Interactive Sonification, pages 60--69, April 2005.

[14]

J. Rekimoto. Tilting operations for small screen interfaces. In Proceedings of the 9th annual ACM symposium on User interface software and technology, pages 167--168. ACM Press, 1996.

Digital Library

[15]

The Sounding Object (SOb). European research project (IST-25287, http//:www.soundobject.org) as part of the Disappearing Computer (DC) proactive initiative (http://www.disappearing-computer.org/).

[16]

N. J. Vanderveer. Ecological Acoustics: Human perception of environmental sounds. PhD thesis, Georgia Institute of Technology, 1979. Dissertation Abstracts International, 40, 4543B. (University Microfilms No. 80-04-002).

[17]

W. H. Warren and R. R. Verbrugge. Auditory perception of breaking and bouncing events: a case study in ecological acoustics. Journal of Experimental Psychology: Human Perception and Performance, 10(5):704--712, 1984.

[18]

D. Wigdor and R. Balakrishnan. TiltText: Using tilt for text input to mobile phones. In Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 81--90. ACM Press, 2003.

Digital Library

[19]

R. Wildes and W. Richards. Recovering material properties from sound. In W. Richards, editor, Natural Computation, pages 356--363. MIT Press, Cambridge, MA, 1988.

[20]

S. Zhai. User performance in relation to 3D input device design. SIGGRAPH Comput. Graph., 32(4):50--54, 1998.

Digital Library

[21]

S. Zhai, P. Milgram, and W. Buxton. The influence of muscle groups on performance of multiple degree-of-freedom input. In CHI '96: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 308--315, New York, NY, USA, 1996. ACM Press.

Digital Library

Cited By

Huang KSun CHuang DChen YChang RHsu SYang CChen BBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Glissade: Generating Balance Shifting Feedback to Facilitate Auxiliary Digital Pen InputProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376505(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376505
Sigrist RRauter GRiener RWolf P(2012)Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A reviewPsychonomic Bulletin & Review10.3758/s13423-012-0333-820:1(21-53)Online publication date: 7-Nov-2012
https://doi.org/10.3758/s13423-012-0333-8
Houri NArita HSakaguchi YInami MRekimoto JKoike HSaito H(2011)Audiolizing body movementProceedings of the 2nd Augmented Human International Conference10.1145/1959826.1959839(1-4)Online publication date: 13-Mar-2011
https://dl.acm.org/doi/10.1145/1959826.1959839
Show More Cited By

Index Terms

Explorations in sound for tilting-based interfaces

Recommendations

Decoding Auditory Feedback: Enhancing Usability with Sound Insights
ECCE '24: Proceedings of the European Conference on Cognitive Ergonomics 2024

This study compares the impact of conventional auditory earcons and enhanced auditory earcons on the usability of handheld devices for different scanning methods in Warehouse Management Systems (WMSs). Warehouses deal with labor shortages and ...
Examining effects of acoustic feedback on perception and modification of movement patterns in on-water rowing training
AM '11: Proceedings of the 6th Audio Mostly Conference: A Conference on Interaction with Sound

This paper describes a concept for providing acoustic feedback during on-water training to elite rowers and its implementation into the training process. The final aim was to improve the mean boat velocity by a reduction of intra-cyclic interruptions in ...
New approaches to intuitive auditory user interfaces
Proceedings of the 2007 conference on Human interface: Part I

This paper gives an overview of recent projects done at Fraunhofer IAO which take innovative approaches to the use of non-speech audio in human-computer interfaces. The examples illustrate the benefits that nonspeech sound - alone and in combination ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

November 2006

404 pages

ISBN:159593541X

DOI:10.1145/1180995

General Chairs:
Francis Quek
Virginia Tech, USA
,
Jie Yang
Carnegie Mellon University, USA
,
Program Chairs:
Dominic Massaro
University of California, Santa Cruz, USA
,
Abeer Alwan
University of California, Los Angeles, USA
,
Timothy J. Hazen
Massachusetts Institute of Technology, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI06

Sponsor:

ICMI06: 8th International Conference on Multimodal Interfaces 2006

November 2 - 4, 2006

Alberta, Banff, Canada

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
345
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang KSun CHuang DChen YChang RHsu SYang CChen BBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Glissade: Generating Balance Shifting Feedback to Facilitate Auxiliary Digital Pen InputProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376505(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376505
Sigrist RRauter GRiener RWolf P(2012)Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A reviewPsychonomic Bulletin & Review10.3758/s13423-012-0333-820:1(21-53)Online publication date: 7-Nov-2012
https://doi.org/10.3758/s13423-012-0333-8
Houri NArita HSakaguchi YInami MRekimoto JKoike HSaito H(2011)Audiolizing body movementProceedings of the 2nd Augmented Human International Conference10.1145/1959826.1959839(1-4)Online publication date: 13-Mar-2011
https://dl.acm.org/doi/10.1145/1959826.1959839
Rahman MGustafson SIrani PSubramanian SOlsen DArthur RHinckley KMorris MHudson SGreenberg S(2009)Tilt techniquesProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1518701.1518997(1943-1952)Online publication date: 4-Apr-2009
https://dl.acm.org/doi/10.1145/1518701.1518997
Ahmaniemi TLantz VMarila JDigalakis VPotamianos ATurk MPieraccini RIvanov Y(2008)Perception of dynamic audiotactile feedback to gesture inputProceedings of the 10th international conference on Multimodal interfaces10.1145/1452392.1452410(85-92)Online publication date: 20-Oct-2008
https://dl.acm.org/doi/10.1145/1452392.1452410
Ahmaniemi TLantz VMarila Jter Hofte HMulder I(2008)Dynamic audiotactile feedback in gesture interactionProceedings of the 10th international conference on Human computer interaction with mobile devices and services10.1145/1409240.1409283(339-342)Online publication date: 2-Sep-2008
https://dl.acm.org/doi/10.1145/1409240.1409283

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents