Article

Striking a c[h]ord: vocal interaction in assistive technologies, games, and more

Authors:

Adam J. Sporka,

Susumu Harada,

Sri H. KurniawanAuthors Info & Claims

CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing Systems

Pages 2869 - 2872

https://doi.org/10.1145/1240866.1241098

Published: 28 April 2007 Publication History

Get Access

Abstract

Vocal interaction research has primarily been focused on the use of systems for automatic speech recognition and synthesis. Whilst ASR has been successful in various domains, it can be impractical in some contexts of use such as in time-sensitive and continuous controls and in applications involving users with speech impairment. This workshop aims to discuss the state of the art in vocal interaction methods that go beyond word recognition by exploiting the information contained within non-verbal vocalizations (e.g. pitch, volume, or timbre). The overarching objective of this workshop is to sketch a research agenda on the topic of the emerging discipline of non-verbal vocal interaction and its implications for the design of interactive systems. The workshop will be of interest to researchers, designers, developers, and users that are interested or would benefit from use of the non-verbal interaction.

References

[1]

Al-Hashimi, S. Blowtter: A Voice-Controlled Plotter. To appear in Proc. HCI 2006 Engage.

Google Scholar

[2]

Bilmes, J., Malkin, J., Li, X., Harada, S., Kilanski, K., Kirchhoff, K., Wright, R., Subramanya, A., Landay, J., Dowden, P., Chizeck, H.: The Vocal Joystick. In Proc. IEEE Intl Conf Audio, Speech and Sig Proc. Toulouse, France, IEEE (2006).

Google Scholar

[3]

Deutscher, M., Hoskinson, R., Takashashi, S., Fels, S. Echology: an interactive spatial sound and video artwork. In Proc. MULTIMEDIA 2005. ACM Press (2005), 937--945.

Digital Library

Google Scholar

[4]

Goto, M., Itou, K., Akiba, T., Hayamizu, S.: Speech Completion: New Speech Interface with On-demand Completion Assistance. In Proc. HCI International 2001, Vol.1, pp. 198--202, August 2001.

Google Scholar

[5]

Goto, M., Itou, K., Kobayashi, T. Speech interface exploiting intentionally--controlled nonverbal speech information. In Proc. UIST 2005, ACM Press (2005), 35--36.

Google Scholar

[6]

Hamalainen, P., Maki-Patola, T., Pulkki, V., Airas, M. Musical computer games played by singing. In Proc 7th Intl Conf on Digital Audio Effects, Naples, Italy, 2004, 367--371.

Google Scholar

[7]

Igarashi, T., Hughes, J. F. Voice as sound: using non--verbal voice input for interactive control. In Proc UIST '01, ACM Press (2001), 155--156.

Digital Library

Google Scholar

[8]

Jacob, R. J. K., Leggett, J. J., Myers, B. A. and Pausch, R. Interaction styles and input/output devices. Behaviour & Information Technology 12, 2 (1993), 69--79.

Crossref

Google Scholar

[9]

Nakano, T., Goto, M., Ogata, J., Hiraga, Y. Voice drummer: a music notation interface of drum sounds using voice percussion input. In Proc. UIST 2000, ACM Press (2005), 49--50.

Google Scholar

[10]

Maglio, P., Matlock, T., Campbell, C., Zhai, S., Smith, B.A. Gaze and speech in attentive user interfaces. In Proc. ICMI 2000, ACM Press (2000), 1--7.

Digital Library

Google Scholar

[11]

Sporka, A. J., Kurniawan, S. H., Slavik, P. Whistling user interface (U3I). In Proc. UI4All 2004, LNCS 3196, Springer-Verlag (2004), 472--478.

Google Scholar

[12]

Sporka, A. J., Kurniawan, S. H., Slavik, P.: Non-speech Operated Emulation of Keyboard. In Clarkson J., Langdon, P., Robinson P. (eds) Designing Accessible Technology, Springer--Verlag (2006), 145--154.

Google Scholar

[13]

Vilimek, R., Hempel, T. Effects of Speech and Non-Speech Sounds on Short-Term Memory and Possible Implications for In-Vehicle Use. In Proc. ICAD'05.

Google Scholar

[14]

Welch, G. F., Howard, D. M., Rush, C. Real-time visual feedback in the development of vocal pitch accuracy in singing. Psychology of Music, 17(2), 146--157.

Crossref

Google Scholar

Cited By

View all

Williams SGračanin D(2024)A Relative Pitch Based Approach to Non-verbal Vocal Interaction as a Continuous and One-Dimensional ControllerHuman-Computer Interaction10.1007/978-3-031-60449-2_12(169-186)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60449-2_12
Lv ZEsteve CChirivella JGagliardo P(2015)A game based assistive tool for rehabilitation of dysphonic patients2015 3rd IEEE VR International Workshop on Virtual and Augmented Assistive Technology (VAAT)10.1109/VAAT.2015.7155403(9-14)Online publication date: Mar-2015
https://doi.org/10.1109/VAAT.2015.7155403
Sporka AMíkovec ZKlíma MSlavík P(2007)Accessibility research at the Czech Technical UniversityACM SIGACCESS Accessibility and Computing10.1145/1278234.1278239(29-35)Online publication date: 1-Jun-2007
https://dl.acm.org/doi/10.1145/1278234.1278239

Index Terms

Striking a c[h]ord: vocal interaction in assistive technologies, games, and more
1. Computing methodologies
  1. Artificial intelligence
    1. Philosophical/theoretical foundations of artificial intelligence
      1. Cognitive science
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. HCI theory, concepts and models
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Vocal interaction
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

Vocal interaction research has slowly been gaining popularity in the mainstream HCI, assistive technology, arts and game development communities. One main reason for the uptake of this interaction style is the potential of exploiting one of the most ...
A review of lumped-element models of voiced speech

Voiced speech is a highly complex process involving coupled interactions between the vocal fold structure, aerodynamics, and acoustic field. Reduced-order lumped-element models of the vocal fold structure, coupled with various aerodynamic and acoustic ...
Reconsidering the Voice Prinicple with Non-native Language Speakers
Abstract
Researchers have suggested that use of pedagogical agents speaking with a human voice increases social perception and enables deeper learning when compared against computer-generated voice. However, recent research (Craig & Schroeder, ...
Highlights
- The voice principle is more complex than human or computer voice.
- Technological ...

Comments

Information & Contributors

Information

Published In

CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing Systems

April 2007

1286 pages

ISBN:9781595936424

DOI:10.1145/1240866

Conference Chair:
Mary Beth Rosson
The Pennsylvania State University, USA
,
Program Chair:
David Gilmore
Intel, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI07

Sponsor:

CHI07: CHI Conference on Human Factors in Computing Systems

April 28 - May 3, 2007

CA, San Jose, USA

Acceptance Rates

CHI EA '07 Paper Acceptance Rate 212 of 582 submissions, 36%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
261
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Williams SGračanin D(2024)A Relative Pitch Based Approach to Non-verbal Vocal Interaction as a Continuous and One-Dimensional ControllerHuman-Computer Interaction10.1007/978-3-031-60449-2_12(169-186)Online publication date: 29-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-60449-2_12
Lv ZEsteve CChirivella JGagliardo P(2015)A game based assistive tool for rehabilitation of dysphonic patients2015 3rd IEEE VR International Workshop on Virtual and Augmented Assistive Technology (VAAT)10.1109/VAAT.2015.7155403(9-14)Online publication date: Mar-2015
https://doi.org/10.1109/VAAT.2015.7155403
Sporka AMíkovec ZKlíma MSlavík P(2007)Accessibility research at the Czech Technical UniversityACM SIGACCESS Accessibility and Computing10.1145/1278234.1278239(29-35)Online publication date: 1-Jun-2007
https://dl.acm.org/doi/10.1145/1278234.1278239

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Vocal interaction

A review of lumped-element models of voiced speech

Reconsidering the Voice Prinicple with Non-native Language Speakers