An experimental speech to graphics system
Pages 91 - 96
Abstract
Ever improving speech technology continues to revolutionise the way we interact with computers. This paper describes a speech-driven graphics system that allows the user to construct and manipulate 3-dimensional (3D) graphical images using only their voice, averting the need to learn a graphics programming language or the point-and-click options of a conventional graphics software interface. The system combines an inexpensive Java-based speech-to-text package with open-source Java packages for constructive solid geometry and text-to-speech generation to create a completely hands-off graphics application. These components are integrated with context-free input/output grammars modeled from observations about the language used when a person unfamiliar with computer graphics software directs an experienced user in the creation of 3D images. The result is a natural, conversation-style interface that allows anyone to make effective use of 3D-graphics packages regardless of their technical expertise.
References
[1]
Coyne, B., Sproat, R. (2001) "WordsEye: an automatic text-to-scene conversion system." International Conference on Computer Graphics and Interactive Techniques, pp. 487--496.
[2]
McTear, M. F. (2002) "Spoken dialogue technology: enabling the conversational user interface" ACM Computing Surveys 34(1): 90--169; March.
[3]
Myers, B., Hollan, J., Cruz, I., Bryson, S., Bulterman, D., Catarci, T., Citrin, W., Glinert, E., Grudin, J., Ioannidis, Y. (1996) "Strategic directions in human-computer interaction" ACM Computing Surveys 28(4): 794--809; December.
[4]
Myers, B., Hudson, S. E., Pausch, R. (2000) "Past, present, and future of user interface software tools." ACM Transactions in Computer-Human Interaction 7(1): 3--28; March.
[5]
Verner, S. T. "POVtalk: a Natural Language based 3-D scene generator", Honours thesis, University of Waikato, 1998.
[6]
Winograd, T "Procedural Model of Language Understanding". In (Grosz, B., Jones, K. and Webber, B. eds.) Natural Language Processing, Morgan Kaufman Publishers, LosAltos, California, pp. 249--266, 1986.
- An experimental speech to graphics system
Recommendations
Articulatory Speech Re-synthesis: Profiting from Natural Acoustic Speech Data
Cross-Modal Analysis of Speech, Gestures, Gaze and Facial ExpressionsThe quality of static phones (e.g. vowels, fricatives, nasals, laterals) generated by articulatory speech synthesizers has reached a high level in the last years. Our goal is to expand this high quality to dynamic speech, i.e. whole syllables, words, ...
Psycho-acoustics inspired automatic speech recognition
AbstractUnderstanding the human spoken language recognition process is still a far scientific goal. Nowadays, commercial automatic speech recognisers (ASRs) achieve high performance at recognising clean speech, but their approaches are poorly ...
Highlights- We propose a novel Automatic Speech Recognizer inspired by psycho-acoustic studies.
Effects of Speaking Rate on Speech and Silent Speech Recognition
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsSpeaking rate or the speed at which a person speaks is a fundamental user characteristic. This work investigates the rate in which users speak when interacting with speech and silent speech-based methods. Results revealed that native users speak about ...
Comments
Information & Contributors
Information
Published In
July 2002
111 pages
ISBN:0473085003
DOI:10.1145/2181216
- Conference Chair:
- Matt Jones,
- Program Chairs:
- Steve Jones,
- Masood Masoodian
Copyright © 2002 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- New Zealand Chapter of ACM SIGCHI
- Google Inc.
- The University of Waikato
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 July 2002
Check for updates
Author Tags
Qualifiers
- Research-article
Acceptance Rates
Overall Acceptance Rate 8 of 23 submissions, 35%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 33Total Downloads
- Downloads (Last 12 months)3
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in