Article

Free access

“Put-that-there”: Voice and gesture at the graphics interface

Author:

Richard A. BoltAuthors Info & Claims

SIGGRAPH '80: Proceedings of the 7th annual conference on Computer graphics and interactive techniques

July 1980

Pages 262 - 270

https://doi.org/10.1145/800250.807503

Published: 01 July 1980 Publication History

PDF eReader

Abstract

Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.

The work described herein involves the user commanding simple shapes about a large-screen graphics display surface. Because voice can be augmented with simultaneous pointing, the free usage of pronouns becomes possible, with a corresponding gain in naturalness and economy of expression. Conversely, gesture aided by voice gains precision in its power to reference.

References

[1]

Negroponte, N The Media Room. Report for ONR and DARPA. MIT, Architecture Machine Group, Cambridge, MA, December 1978.

Google Scholar

[2]

Bolt, R.A. Spatial Data-Management. DARPA Report. MIT, Architecture Machine Group, Cambridge, MA, March 1979.

Google Scholar

[3]

Reddy, D.R. Speech recognition by machine: a review. Proceeding of the IEEE, 64, 4 (April 1976), 501-531.

Crossref

Google Scholar

[4]

Robinson, A.L. More people are talking to computers as speech recognition enters the real world. (Research News) (First of two articles) Science, 203, (16 February 1979), 634-638.

Google Scholar

[5]

Sondeheimer, N.K. Spatial reference and natural-language machine control. International Journal of Man-Machine Studies, 8, (1976), 329-336.

Crossref

Google Scholar

[6]

Winston, P. Learning structural descriptions from examples. MIT Project MAC, TR-76, 1970.

Digital Library

Google Scholar

[7]

Olson, D.R. Language and thought: Aspects of a cognitive theory of semantics. Psychological Review, 77, (1970), 257-273.

Crossref

Google Scholar

Cited By

View all

Bahram SChakraborty ARavindran SSt. Amant R(2113)Intelligent Interaction in Accessible ApplicationsA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-5082-4_5(93-117)Online publication date: 26-Mar-2113
https://doi.org/10.1007/978-1-4471-5082-4_5
Bernardos AWang XBergesio LBesada JCasar J(2024)Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: An Empirical StudyJournal of Sensor and Actuator Networks10.3390/jsan1302002513:2(25)Online publication date: 9-Apr-2024
https://doi.org/10.3390/jsan13020025
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Show More Cited By

Index Terms

“Put-that-there”: Voice and gesture at the graphics interface
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Speech recognition
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Graphics input devices

Recommendations

“Put-that-there”: Voice and gesture at the graphics interface

Recent technological advances in connected-speech recognition and position sensing in space have encouraged the notion that voice and gesture inputs at the graphics interface can converge to provide a concerted, natural user modality.

The work described ...
Read More
“Put-that-there”: voice and gesture at the graphics interface
Readings in intelligent user interfaces
Read More
On the feasibility of voice input to an on-line computer processing system

An on-line digital computer processing system is considered in which an ordinary telephone is the complete terminal device, input to the computer being provided as a sequence of spoken words, and output to the user being audio responses from the ...
Read More

Comments

Information & Contributors

Information

Published In

SIGGRAPH '80: Proceedings of the 7th annual conference on Computer graphics and interactive techniques

July 1980

336 pages

ISBN:0897910214

DOI:10.1145/800250

ACM SIGGRAPH Computer Graphics Volume 14, Issue 3
July 1980
327 pages
ISSN:0097-8930
DOI:10.1145/965105
Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 1980

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

SIGGRAPH '80 Paper Acceptance Rate 52 of 140 submissions, 37%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Upcoming Conference

SIGGRAPH '24

Sponsor:
siggraph

Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 27 - August 1, 2024

Denver , CO , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,170
Total Citations
View Citations
9,631
Total Downloads

Downloads (Last 12 months)749
Downloads (Last 6 weeks)95

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bahram SChakraborty ARavindran SSt. Amant R(2113)Intelligent Interaction in Accessible ApplicationsA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-5082-4_5(93-117)Online publication date: 26-Mar-2113
https://doi.org/10.1007/978-1-4471-5082-4_5
Bernardos AWang XBergesio LBesada JCasar J(2024)Assessing the Acceptance of a Mid-Air Gesture Syntax for Smart Space Interaction: An Empirical StudyJournal of Sensor and Actuator Networks10.3390/jsan1302002513:2(25)Online publication date: 9-Apr-2024
https://doi.org/10.3390/jsan13020025
Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Carayon AMartinie CPalanque PBarboni ESteere S(2024)A Systematic Process to Engineer Dependable Integration of Frame-based Input Devices in a Multimodal Input Chain: Application to Rehabilitation in HealthcareProceedings of the ACM on Human-Computer Interaction10.1145/36646338:EICS(1-31)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664633
Cuadra ABreuch JEstrada SIhim DHung IAskaryar DHassanien MFessele KLanday J(2024)Digital Forms for All: A Holistic Multimodal Large Language Model Agent for Health Data EntryProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596248:2(1-39)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659624
Wang ZShi YWang YYao YYan KWang YJi LXu XYu C(2024)G-VOILA: Gaze-Facilitated Information Querying in Daily ScenariosProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596238:2(1-33)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659623
Barros FTeixeira ASilva S(2024)A First Step Towards Considering Nonverbal Communicative Cues in Dialog SystemsProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652058(125-129)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3652058
Wang KWang ZNakagaki KPerlin K(2024)“Push-That-There”: Tabletop Multi-robot Object Manipulation via Multimodal 'Object-level Instruction'Proceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661542(2497-2513)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661542
Hardy JThebault-Spieker J(2024)A Turn to Assets in Community-Based Computing Research: Tradeoffs, Deficits, and Neoliberalism in Technological DevelopmentProceedings of the ACM on Human-Computer Interaction10.1145/36372918:CSCW1(1-20)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637291
Rodriguez RSullivan BBarrera Machuca MBatmaz ATornatzky COrtega F(2024)An Artists' Perspectives on Natural Interactions for Virtual Reality 3D SketchingProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642758(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642758
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

“Put-that-there”: Voice and gesture at the graphics interface

“Put-that-there”: voice and gesture at the graphics interface

On the feasibility of voice input to an on-line computer processing system