Article

A voice-activated syntax-directed editor for manually disabled programmers

Authors:

Thomas J. Hubbell,

David D. Langan,

Thomas F. HainAuthors Info & Claims

Assets '06: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility

Pages 205 - 212

https://doi.org/10.1145/1168987.1169022

Published: 23 October 2006 Publication History

Abstract

This paper discusses a research project targeted at the design and implementation of an interface intended to allow manually disabled people to more easily perform the task of programming. It proposes a Speech User Interface (SUI) targeted for this task. Voice was selected as the means of input as an alternative to the keyboard and mouse. Traditional programming IDEs tend to be character and line oriented. It is argued that this orientation is not conducive to voice input, and so a syntaxdirected programming interface is proposed. To test the viability of this combination of voice with a syntax-directed approach, an editor named VASDE (Voice-Activated Syntax-Directed Editor) was implemented using ECLIPSE as the underlying platform for development. This paper describes the syntax-directed interface, VASDE, and some of the lessons learned from initial usability studies.

References

[1]

Arefi, Farah, Charles E. Hughes, and David A. Workman. "Automatically Generating Visual Syntax-Directed Editors." Communications of the ACM, Vol. 33, No. 3. ACM Press. New York, NY. 349--360. 1990.

Digital Library

[2]

Biddle, Robert, Ewan Tempero, and Glen Wallace. "Smarter Cut-and-Paste for Programming Text Editors". Proceedings of the 2nd Australasian Conference on User Interface. IEEE Computer Society Press. Queensland, Australia. 56-63. 2001.

Digital Library

[3]

Désilets, Alain. "Context Sensitive Magic Words for Programming by Voice". Proceedings of the 1st VoiceCode Design Session. Boston, MA. 2000. 21 August 2002. <http://voicecode.iit.nrc.ca/VoiceCode/VCode1stMeeting/Alain_Desilets/CSMWs/index.htm >

[4]

Désilets, Alain. "Miscellaneous Techniques for Programming-by-Voice". Proceedings of the 1st VoiceCode Design Session. Boston, MA. 2000. 21 August 2002. <http://voicecode.iit.nrc.ca/VoiceCode/VCode1stMeeting/Alain_Desilets/ misc_techniques/index.htm>

[5]

"Eclipse.org Main Page". 5 March 2005. The Eclipse Foundation. <http://www.eclipse.org>

[6]

Epstein, Jonathan. "Programming by Voice Using Continuous and Discrete Methods". Proceedings of the 1st Voice-Code Design Session. Boston, MA. 2000. 21 August 2002. <http://voicecode.iit.nrc.ca/VoiceCode/VCode1stMeeting/Jo nathan_Epstein/index.htm>

[7]

Froeseth, Julie. "A Model for Voice-Activated Visual GUI Editors", Masters thesis, University of South Alabama, December 2005

[8]

Heintzelman, Matt and Phil Pfeiffer. "Machines, statues, and people: strategies for promoting RSI awareness in computing curricula". Proceedings of the twenty-eighth SIGCSE technical symposium on Computer science education. San Jose, CA. 296--300. 1997.

Digital Library

[9]

Hennessy, Sean. "Computer Code Voice Transcription". 6 January 2005. 7 March 2005. <http://www.hdm.com/resources/HappyHands_Java/hh_paper_short_technical.html>

[10]

Horwitz, Susan and Tim Teitelbaum. "Generating Editing Environments Based on Relations and Attributes." ACM Transactions on Programming Languages and Systems. New York, NY. 557--608, 1986.

Digital Library

[11]

"Java Speech API Programmer's Guide". Version 1.0. 26 October 1998. Sun Microsystems, Inc. <http://java.sun.com/products/javamedia/speech/forDevelopers/jsapi-guide/>

[12]

Johansson, Eric. "Speech Driven Coding". 10 March 1998. 21 August 2002. <http://www.connact.com/~esj/voice_coding/voicecoding2.PPT>

[13]

"Lost-worktime Injuries and Illnesses: Characteristics and Resulting Time Away from Work, 2000". Bureau of Labor Statistics. 10 April 2002. 12 October 2002. <http://www.bls.gov/news.release/osh2.nr0.htm>

[14]

Oviatt, Sharon L., Philip R. Cohen, and Michelle Wang. "Toward Interface Design for Human Language Technology: Modality and Structure as Determinants of Linguistic Complexity." Speech Communication, 15 (3-4). European Speech Communication Association. 283--300. 1994.

Digital Library

[15]

Reiss, Steven P. "Pecan: Program Development Systems That Support Multiple Views." Proceedings of the 7th International Conference on Software Engineering. Orlando, FL. 324--333. 1984.

Digital Library

[16]

Shmerling, Robert. "Harvard Commentary: Computer Use and Carpal Tunnel Syndrome". InteliHealth. 27 August 2001. 12 October 2002. <http://www.intelihealth.com/IH/ihtIH/WSIHW000/20813/20888/332014.html?d=dmtJHNewsArchive>

[17]

Steindl, Christoph. "Benefits of a Data Flow-Aware Programming Environment". Proceedings of the ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering. ACM Press. Toulouse, France. 105--109. 1999.

Digital Library

[18]

VoiceCode White Paper. National Research Council of Canada. 23 February 2005. <http://voicecode.iit.nrc.ca/VoiceCode/public/wiki.cgi?VoiceCode_white_paper>

Cited By

Zan THu Z(2023)VoiceJava: A Syntax-Directed Voice Programming Language for JavaElectronics10.3390/electronics1201025012:1(250)Online publication date: 3-Jan-2023
https://doi.org/10.3390/electronics12010250
Wang LZan TLi WLu S(2023)A Syntax-directed Voice-activated Programming Environment for Java2023 13th International Conference on Information Technology in Medicine and Education (ITME)10.1109/ITME60234.2023.00050(205-209)Online publication date: 24-Nov-2023
https://doi.org/10.1109/ITME60234.2023.00050
Hindle ABarr EGabel MSu ZDevanbu P(2016)On the naturalness of softwareCommunications of the ACM10.1145/290236259:5(122-131)Online publication date: 26-Apr-2016
https://dl.acm.org/doi/10.1145/2902362
Show More Cited By

Index Terms

A voice-activated syntax-directed editor for manually disabled programmers
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
      2. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Syntax directed graphical interaction
SIGPLAN '83: Proceedings of the 1983 ACM SIGPLAN symposium on Programming language issues in software systems

This paper describes SYNGRAPH (SYNtax) directed GRAPHics) which is a user interface generator for interactive system graphics. This system applies the principles of syntax analysis, parser generation and data abstraction to the development of man-...
Syntax-Directed Pretty Printing A First Step Towards a Syntax-Directed Editor

A language-independent syntax-directed pretty printer has been implemented as the first step towards building a language-independent syntax-directed editor. The syntax-directed pretty printer works in two phases: the grammar processing phase and the ...
Flexible shortcuts: designing a new speech user interface for command execution
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

This paper proposes a new speech user interface for command execution called "Flexible Shortcuts." With this approach, users can select any commands by using "continuous keyword input," a voice input method using a series of keywords related to the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

Assets '06: Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility

October 2006

316 pages

ISBN:1595932909

DOI:10.1145/1168987

General Chair:
Simeon Keates
IBM T.J. Watson Research Center, USA
,
Program Chair:
Simon Harper
University of Manchester, UK

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ASSETS06

Sponsor:

ASSETS06: The 8th International ACM SIGACCESS Conference on Computers and Accessibility

October 23 - 25, 2006

Oregon, Portland, USA

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
407
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zan THu Z(2023)VoiceJava: A Syntax-Directed Voice Programming Language for JavaElectronics10.3390/electronics1201025012:1(250)Online publication date: 3-Jan-2023
https://doi.org/10.3390/electronics12010250
Wang LZan TLi WLu S(2023)A Syntax-directed Voice-activated Programming Environment for Java2023 13th International Conference on Information Technology in Medicine and Education (ITME)10.1109/ITME60234.2023.00050(205-209)Online publication date: 24-Nov-2023
https://doi.org/10.1109/ITME60234.2023.00050
Hindle ABarr EGabel MSu ZDevanbu P(2016)On the naturalness of softwareCommunications of the ACM10.1145/290236259:5(122-131)Online publication date: 26-Apr-2016
https://dl.acm.org/doi/10.1145/2902362
Alam ABush V(2016)HASKEU: An editor to support visual and textual programming in tandem2016 SAI Computing Conference (SAI)10.1109/SAI.2016.7556071(805-814)Online publication date: Jul-2016
https://doi.org/10.1109/SAI.2016.7556071
Hindle ABarr ESu ZGabel MDevanbu PGlinz MMurphy GPezzè M(2012)On the naturalness of softwareProceedings of the 34th International Conference on Software Engineering10.5555/2337223.2337322(837-847)Online publication date: 2-Jun-2012
https://dl.acm.org/doi/10.5555/2337223.2337322
Hindle ABarr ESu ZGabel MDevanbu P(2012)On the naturalness of software2012 34th International Conference on Software Engineering (ICSE)10.1109/ICSE.2012.6227135(837-847)Online publication date: Jun-2012
https://doi.org/10.1109/ICSE.2012.6227135
Hu RZhu SFeng JSears A(2011)Use of Speech Technology in Real Life EnvironmentUniversal Access in Human-Computer Interaction. Applications and Services10.1007/978-3-642-21657-2_7(62-71)Online publication date: 2011
https://doi.org/10.1007/978-3-642-21657-2_7

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents