research-article

Evaluating existing audio CAPTCHAs and an interface optimized for non-visual use

Authors:

Jeffrey P. Bigham,

Anna C. CavenderAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1829 - 1838

https://doi.org/10.1145/1518701.1518983

Published: 04 April 2009 Publication History

Abstract

Audio CAPTCHAs were introduced as an accessible alternative for those unable to use the more common visual CAPTCHAs, but anecdotal accounts have suggested that they may be more difficult to solve. This paper demonstrates in a large study of more than 150 participants that existing audio CAPTCHAs are clearly more difficult and time-consuming to complete as compared to visual CAPTCHAs for both blind and sighted users. In order to address this concern, we developed and evaluated a new interface for solving CAPTCHAs optimized for non-visual use that can be added in-place to existing audio CAPTCHAs. In a subsequent study, the optimized interface increased the success rate of blind participants by 59% on audio CAPTCHAs, illustrating a broadly applicable principle of accessible design: the most usable audio interfaces are often not direct translations of existing visual interfaces.

References

[1]

Alexa web search - data services, 2008. http://www.alexa.com.

[2]

R. Atterer, M. Wnuk, and A. Schmidt. Knowing the user's every move - user activity tracking for website usability evaluation and implicit interaction. In Proc. of the 15th Intl. Conf. on World Wide Web (WWW '06), pages 203--212, New York, NY, 2006.

Digital Library

[3]

J. P. Bigham, M. B. Aller, J. T. Brudvik, J. O. Leung, L. A. Yazzolino, and R. Ladner. Inspiring blind high school students to pursue computer science with instant messenging chatbots. In Proc. of the 39th SIGCSE Tech. Symp. on Computer Science Education (SIGCSE '08), pages 449--453, Portland, OR, USA, 2008.

Digital Library

[4]

J. P. Bigham, A. C. Cavender, J. T. Brudvik, J. O. Wobbrock, and R. E. Ladner. Webinsitu: A comparative analysis of blind and sighted browsing behavior. In Proc. of the 9th Intl. ACM SIGACCESS Conf. on Computers and Accessibility (ASSETS '07), pages 51--58, Tempe, AZ, USA, 2008.

Digital Library

[5]

J. P. Bigham, T. Lau, and J. Nichols. TrailBlazer: Enabling blind web users to blaze trails through the web. In Proc. of the 12th Intl. Conf. on Intelligent User Interfaces (IUI '09), Sanibel Island, FL, USA, 2009.

Digital Library

[6]

K. Chellapilla, K. Larson, P. Y. Simard, and M. Czerwinski. Designing human friendly human interaction proofs (HIPS). In Proc. of Computer Human Interaction (CHI '05), pages 711--720, 2005.

Digital Library

[7]

P. B. Godfrey. Text-based captcha algorithms. In First Workshop on Human Interactive Proofs. Unpublished Manuscript, 2002. http://www.adaddin.cs.cmu.edu/hips/events/abs/godfreybabstract.pdf.

[8]

J. Holman, J. Lazar, J. H. Feng, and J. D'Arcy. Developing usable captchas for blind users. In Proc. of the 9th Intl. ACM SIGACCESS Conf. on Computers and accessibility (ASSETS '07), pages 245--246, New York, NY, USA, 2007.

Digital Library

[9]

G. Kochanski, D. Lopresti, and C. Shih. A reverse turing test using speech. In Proc. of the Intl. Conf. on Spoken Language Processing (ICSLP '02), pages 1357--1360, 2002.

[10]

R. C. Littell, G. A. Milliken, W. W. Stroup, and R. D. Wolnger. SAS System for Mixed Models. SAS Institute, Inc., Cary, North Carolina, USA, 1996.

[11]

J. Mahmud, Y. Borodin, and I. V. Ramakrishnan. CSurf: A context-driven non-visual web-browser. In Proc. of the Intl. Conf. on the World Wide Web (WWW '07), pages 31--40.

Digital Library

[12]

H. Miyashita, D. Sato, H. Takagi, and C. Asakawa. AiBrowser for multimedia: introducing multimedia content accessibility for visually impaired users. In Proc. of the 9th Intl. ACM SIGACCESS Conf. on Computers and accessibility (ASSETS '07), pages 91--98, New York, NY, USA, 2007.

Digital Library

[13]

Petrie, F. Hamilton, N. King, and P. Pavan. Remote usability evaluations with disabled people. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI '06), pages 1133--1141, New York, NY, USA, 2006.

Digital Library

[14]

M. Pilgrim, editor. Greasemonkey Hacks: Tips&Tools for Remixing the Web with Firefox. O'Reilly Media, 2005.

Digital Library

[15]

I. V. Ramakrishnan, A. Stent, and G. Yang. Hearsay: Enabling audio browsing on hypertext content. In Proc. of the 13th Intl. Conf. on the World Wide Web (WWW '04), pages 80--89, New York, NY, USA 2004.

Digital Library

[16]

T. V. Raman. Auditory User Interfaces: Toward the Speaking Computer. Kluwer Academic Publishers, Boston, MA, 1997.

Digital Library

[17]

T. V. Raman. Emacspeak - A Speech Interface. In Proc. of the SIGCCHI Conf. on Human Factors in Computer Systems (CHI '96), pages 66--71, Vancouver, BC, Canada, 1996.

Digital Library

[18]

G. Sauer, H. Hochheiser, J. Feng, and J. Lazar. Towards a universally usable captcha. In Proc. of the 4th Symp. On Usable Privacy and Security (SOUPS '08), Pittsburgh, PA, USA, 2008.

[19]

C. Schuster and A. Von Eye. The relationship of ANOVA models with random effects and repeated measurement designs. Journal of Adolescent Research, 16(2):205--220, 2001.

[20]

J. Tam, J. Simsa, D. Huggins-Daines, L. von Ahn, and M. Blum. Improving audio captchas. In Proc. of the 4th Symp. on Usability, Privacy and Security (SOUPS '08), Pittsburgh, PA, USA, July 2008.

[21]

J. Thatcher, P. Bohman, M. Burks, S. L. Henry, B. Regan, S. Swierenga, M. D. Urban, and C. D. Waddell. Constructing Accessible Web Sites. glasshaus Ltd., Birmingham, UK, 2002.

Digital Library

[22]

L. von Ahn, M. Blum, and J. Langford. Telling humans and computers apart automatically: How lazy cryptographers do AI. Communications of the ACM, 47(2):57--60, February 2004.

Digital Library

[23]

T. Watanabe. Experimental evaluation of usability and accessibility of heading elements. In Proc. of the Intl. Cross-Disciplinary Conf. on Web Accessibility (W4A '07), pages 157--164, 2007.

Digital Library

[24]

WebVisum Firefox Extension, 2008. http://www.webvisum.com/.

[25]

Yahoo Accessibility Improvement Petition, 2008. http://www.petitiononline.com/yabvipma/.

Cited By

Shirali-Shahreza SPenn G(2024)An Ecologically Valid Approach to Evaluating Online GatekeepersInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2398890(1-16)Online publication date: 12-Sep-2024
Myers B(2024)Pick, Click, Flick!undefinedOnline publication date: 14-Mar-2024
Searles ANakatsuka YOzturk EPaverd ATsudik GEnkoji ACalandrino JTroncoso C(2023)An empirical study & evaluation of modern CAPTCHAsProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620410(3081-3097)Online publication date: 9-Aug-2023
Show More Cited By

Index Terms

Evaluating existing audio CAPTCHAs and an interface optimized for non-visual use
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Recommendations

The SoundsRight CAPTCHA: an improved approach to audio human interaction proofs for blind users
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper we describe the development of a new audio CAPTCHA called the SoundsRight CAPTCHA, and the evaluation of the CAPTCHA with 20 blind users. Blind users cannot use visual CAPTCHAs, and it has been documented in the research literature that ...
Constructing Secure Audio CAPTCHAs by Exploiting Differences between Humans and Machines
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

To prevent abuses of Internet services, CAPTCHAs are used to distinguish humans from programs where an audio-based scheme is beneficial to support visually impaired people. Previous studies show that most audio CAPTCHAs, albeit hard to solve for humans, ...
Toward Improved Audio CAPTCHAs Based on Auditory Perception and Language Understanding

A so-called completely automated public Turing test to tell computers and humans apart (CAPTCHA) represents a challenge-response test that is widely used on the Internet to distinguish human users from fraudulent computer programs, often referred to as ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

93
Total Citations
View Citations
1,006
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shirali-Shahreza SPenn G(2024)An Ecologically Valid Approach to Evaluating Online GatekeepersInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2398890(1-16)Online publication date: 12-Sep-2024
Myers B(2024)Pick, Click, Flick!undefinedOnline publication date: 14-Mar-2024
Searles ANakatsuka YOzturk EPaverd ATsudik GEnkoji ACalandrino JTroncoso C(2023)An empirical study & evaluation of modern CAPTCHAsProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620410(3081-3097)Online publication date: 9-Aug-2023
Iqbal ZKumaresh SSatapathy SAsha S(2023)Captcha Generator for Visually Impaired (Colour-Blind)2023 World Conference on Communication & Computing (WCONF)10.1109/WCONF58270.2023.10235076(1-4)Online publication date: 14-Jul-2023
Lee KHong JJarjue EMensah EKacorri HAhmetovic DYaneva V(2022)From the lab to people's homeProceedings of the 19th International Web for All Conference10.1145/3493612.3520448(1-11)Online publication date: 25-Apr-2022
Alnfiai MAlassery F(2022)TapCAPTCHA: non-visual CAPTCHA on touchscreens for visually impaired peopleJournal on Multimodal User Interfaces10.1007/s12193-022-00394-216:4(385-398)Online publication date: 31-Oct-2022
Chithra PSathya K(2022)CAPTCHAs against meddler image identification based on a convolutional neural networkMultimedia Tools and Applications10.1007/s11042-022-11961-w81:6(8633-8652)Online publication date: 1-Mar-2022
Schmeelk SPetrie H(2022)Digital Authentication for Visually Disabled People: Initial Results of an Online SurveyComputers Helping People with Special Needs10.1007/978-3-031-08645-8_6(41-50)Online publication date: 11-Jul-2022
Hernández-Castro CLiu ZSerban ATsingenopoulos IJoosen W(2022)Adversarial Machine LearningSecurity and Artificial Intelligence10.1007/978-3-030-98795-4_12(287-312)Online publication date: 8-Apr-2022
Wang YPrice C(2022)Accessible PrivacyModern Socio-Technical Perspectives on Privacy10.1007/978-3-030-82786-1_13(293-313)Online publication date: 9-Feb-2022
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents