research-article

The design of human-powered access technology

Authors:

Jeffrey P. Bigham,

Richard E. Ladner,

Yevgen BorodinAuthors Info & Claims

ASSETS '11: The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility

Pages 3 - 10

https://doi.org/10.1145/2049536.2049540

Published: 24 October 2011 Publication History

Abstract

People with disabilities have always overcome accessibility problems by enlisting people in their community to help. The Internet has broadened the available community and made it easier to get on-demand assistance remotely. In particular, the past few years have seen the development of technology in both research and industry that uses human power to overcome technical problems too difficult to solve automatically. In this paper, we frame recent developments in human computation in the historical context of accessibility, and outline a framework for discussing new advances in human-powered access technology. Specifically, we present a set of 13 design principles for human-powered access technology motivated both by historical context and current technological developments. We then demonstrate the utility of these principles by using them to compare several existing human-powered access technologies. The power of identifying the 13 principles is that they will inspire new ways of thinking about human-powered access technologies.

References

[1]

Amazon's Mechanical Turk. http://mturk.com.

[2]

Bookshare. http://bookshare.org.

[3]

ChaCha. http://www.chacha.com.

[4]

Dragon Naturally Speaking. http://www.nuance.com/talk/.

[5]

Facebook. http://www.facebook.com.

[6]

Facebook Stats. http:// facebook.com/press/info.php?statistics.

[7]

IQ Engines. http://iqengines.com.

[8]

Open Street Map. http://www.openstreetmap.org.

[9]

Twitter. http://www.twitter.com.

[10]

Adlam, T., Carey-Smith, B., Evans, N., Orpwood, R., Boger, J., & Mihailidis, A., Implementing Monitoring and Technological Interventions in Smart Homes for People with Dementia: Case Studies, in Behaviour Monitoring and Interpretation - BMI: Smart Environments. 2009, IOS Press.

[11]

Azenkot, S., Prasain, S., Borning, A., Fortuna, E., Ladner, R.E., Wobbrock, J.O, Enhancing Independence and Safety for Blind and Deaf-Blind Public Transit Riders, in CHI 2011: Vancouver, BC.

Digital Library

[12]

Baillie, M. and J.M. Jose, An Audio-Based Sports Video Segmentation and Event Detection Algorithm, in CVAVI 2004.

[13]

Bernstein, M., Miller, R.C., Little, G., Ackerman, M., Hartmann, B., Karger, D.R., and Panovich, K., Soylent: A Word Processor with a Crowd Inside., in UIST 2010.

Digital Library

[14]

Beyer, H. and K. Holtzblatt, Contextual design: defining customer-centered systems. 1998, San Francisco: Morgan Kaufmann.

Digital Library

[15]

Bigham, J.P., et al., VizWiz::LocateIt - Enabling Blind People to Locate Objects in their Environment, in CVAVI 2010.

[16]

Borodin, Y., et al., More than meets the eye: a survey of screen-reader browsing strategies, in W4A 2010. p. 1--10.

Digital Library

[17]

Borodin, Y., et al., What's new?: making web page updates accessible, in ASSETS. 2008, p. 145--152.

Digital Library

[18]

Carmien, S., et al., Increasing workplace independence for people with cognitive disabilities by leveraging distributed cognition among caregivers and clients, in GROUP 2003, p. 95--104.

Digital Library

[19]

Cavender, A.C., et al., ASL-STEM Forum: enabling sign language to grow through online collaboration, in CHI 2010, p. 2075--2078.

Digital Library

[20]

Chu, W.-T., W.-H. Cheng, and J.-L. Wu, Semantic context detection using audio event fusion: camera-ready version. EURASIP J. Appl. Signal Process. 2006: p. 181--181.

Digital Library

[21]

Cowling, M. and R. Sitte, Comparison of techniques for environmental sound recognition. Pattern Recogn. Lett., 2003. 24(15): p. 2895--2907.

Digital Library

[22]

Dawe, M., Desperately seeking simplicity: how young adults with cognitive disabilities and their families adopt assistive technologies, in CHI 2006, p. 1143--1152.

Digital Library

[23]

Ferres, L., Proc. of the International Cross-Disciplinary Conf. on Web Accessibility. 2011.

[24]

Goette, T., Factors leading to the successful use of voice recognition technology, in ASSETS 1998, p. 189--196.

Digital Library

[25]

Horowitz, D. and S.D. Kamvar, The anatomy of a large-scale social search engine, in W4A 2010, p. 431--440.

Digital Library

[26]

Howe, J., Why the Power of the Crowd Is Driving the Future of Business. 2009: Crown Business.

Digital Library

[27]

J. Sudol, O.D., C. Blanchard and T. Dorcey, LookTel -- A Comprehensive Platform for Computer-Aided Visual Assistance, in CVAVI 2010.

[28]

Jeffrey P. Bigham, C.J., Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samuel White, and Tom Yeh, Vizwiz: Nearly Real-time Answers to Visual Questions, in UIST 2010.

Digital Library

[29]

Kassirer JP, G.G., Clinical problem solving: A behavioral analysis. Ann Internal Medicine, 1978. 89: p. 245--255.

[30]

Kawanaka, S., et al., Accessibility commons: a metadata infrastructure for web accessibility, in ASSETS 2008, p. 153--160.

Digital Library

[31]

Kittur, A., E.H. Chi, and B. Suh, Crowdsourcing user studies with Mechanical Turk, in CHI 2008, p. 453--456.

Digital Library

[32]

Ladner, R.E., et al., Automating tactile graphics translation, in ASSETS 2005, p. 150--157.

Digital Library

[33]

Manduchi, R., J. Coughlan, and V. Ivanchenko, Search Strategies of Visually Impaired Persons Using a Camera Phone Wayfinding System, in ICCHP 2008, p. 1135--1140.

Digital Library

[34]

Miyoshi, S., et al., Support Technique for Real-Time Captionist to Use Speech Recognition Software, in Computers Helping People with Special Needs, K. Miesenberger, et al., p. 647--650.

Digital Library

[35]

Phillips, B. and H. Zhao, Predictors of Assistive Technology Abandonment. Assistive Technology, 1993. 5.1: p. 36--45.

[36]

Porrero, P., Improving the Quality of Life for the European Citizen: Technology for Inclusive Design and Equality. 1998, IOS Press.

[37]

Richard, O.G.a.G., Automatic transcription of drum sequences using audiovisual features, in ICASSP 2005, p. 205--208.

[38]

Samuel White, H.J., and Jeffrey P. Bigham, EasySnap: Enabling Blind People to Take Photographs, in UIST 2010 - Demos.

[39]

Snyder, J., Audio description: The visual made verbal. International Congress Series, 2005. 1282: p. 935--939.

[40]

Stinson, M., Eisenberg, S., Horn, C., Larson, J., Levitt, H., Stuckless, R. Real-Time Speech-to-Text Services: A report of the National Task Force on Quality of Services in the Postsecondary Education of Deaf and Hard of Hearing Students. 1999; Available from: http://netac.rit.edu/publication/taskforce/realtime.

[41]

Takagi, H., et al., Collaborative web accessibility improvement: challenges and possibilities, in ASSETS 2009, p. 195--202.

Digital Library

[42]

Tara Matthews, S.C., Carol Pai, Janette Fong, and Jennifer Mankoff, Scribe4me: Evaluating a mobile sound translation tool for the deaf, in Ubicomp 2006, p. 159--176.

Digital Library

[43]

Union, I.T., Trends in Telecommunication Reform 2007: The Road to NGN. 2007.

[44]

Viegas, F.B., et al., Talk Before You Type: Coordination in Wikipedia, in Proc. of the 40th Annual Hawaii International Conf. on System Sciences. 2007, IEEE Computer Society. p. 78.

Digital Library

[45]

Wald, M., et al., Correcting automatic speech recognition captioning errors in real time. International Journal of Speech Technology, 2007. 10(1): p. 1--15.

Cited By

Herskovitz J(2024)DIY Assistive Software: End-User Programming for Personalized Assistive TechnologyACM SIGACCESS Accessibility and Computing10.1145/3654768.3654772(1-1)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1145/3654768.3654772
Wang R(2024)Netizen A11y: Engaging Internet Users in Making Visual Media AccessibleCompanion Proceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640544.3645247(159-162)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640544.3645247
Gao HNg EDeng BChau M(2024)Are real-time volunteer apps really helping visually impaired people? A social justice perspectiveInformation and Management10.1016/j.im.2024.10400761:6Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.im.2024.104007
Show More Cited By

Index Terms

The design of human-powered access technology
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Tactile graphics with a voice: using QR codes to access text in tactile graphics
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility

Textbook figures are often converted into a tactile format for access by blind students. These figures are not truly accessible unless the text within the figures is also made accessible. A common solution to access text in a tactile image is to use ...
Tactile graphics with a voice demonstration
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility

Textbook images are converted into tactile graphics to be made accessible to blind and low vision students. The text labels on these graphics are an important part of the image and must be made accessible as well. The graphics usually have the labels ...
The total access system
CHI EA '01: CHI '01 Extended Abstracts on Human Factors in Computing Systems

In this paper, we describe the Total Access System (TAS) developed by the Archimedes Project at Stanford University's Center for the Study of Language and Information. The purpose of the TAS is to ensure everybody is able to access information ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '11: The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility

October 2011

348 pages

ISBN:9781450309202

DOI:10.1145/2049536

General Chair:
Kathleen F. McCoy
University of Delaware, USA
,
Program Chair:
Yeliz Yesilada
Middle East Technical University Northern Cyprus Campus, Cyprus

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ASSETS '11

Sponsor:

SIGACCESS

ASSETS '11: The 13th International ACM SIGACCESS Conference on Computers and Accessibility

October 24 - 26, 2011

Dundee, Scotland, UK

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
762
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Herskovitz J(2024)DIY Assistive Software: End-User Programming for Personalized Assistive TechnologyACM SIGACCESS Accessibility and Computing10.1145/3654768.3654772(1-1)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1145/3654768.3654772
Wang R(2024)Netizen A11y: Engaging Internet Users in Making Visual Media AccessibleCompanion Proceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640544.3645247(159-162)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640544.3645247
Gao HNg EDeng BChau M(2024)Are real-time volunteer apps really helping visually impaired people? A social justice perspectiveInformation and Management10.1016/j.im.2024.10400761:6Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1016/j.im.2024.104007
Labbé DEisenberg YSnyder DShanley JHammel JFroehlich J(2023)Multiple-Stakeholder Perspectives on Accessibility Data and the Use of Socio-Technical Tools to Improve Sidewalk AccessibilityDisabilities10.3390/disabilities30400403:4(621-638)Online publication date: 28-Nov-2023
https://doi.org/10.3390/disabilities3040040
Tang XChang XChen NNi YLC RTong X(2023)Community-Driven Information Accessibility: Online Sign Language Content Creation within d/Deaf CommunitiesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581286(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581286
Herskovitz JXu AAlharbi RGuo A(2023)Hacking, Switching, Combining: Understanding and Supporting DIY Assistive Technology Design by Blind PeopleProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581249(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581249
Stangl AShiroma KDavis NXie BFleischmann KFindlater LGurari D(2022)Privacy Concerns for Visual Assistance TechnologiesACM Transactions on Accessible Computing10.1145/351738415:2(1-43)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3517384
Muehlbradt AKane S(2022)What's in an ALT Tag? Exploring Caption Content Priorities through Collaborative CaptioningACM Transactions on Accessible Computing10.1145/350765915:1(1-32)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3507659
Colley MKränzle TRukzio E(2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519701
Rodrigues ASantos AMontague KGuerreiro T(2021)Promoting Self-Efficacy Through an Effective Human-Powered Nonvisual Smartphone Task AssistantProceedings of the ACM on Human-Computer Interaction10.1145/34491885:CSCW1(1-19)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449188
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents