research-article

Public Access

Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility

Authors:

Jennifer MankoffAuthors Info & Claims

ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 131 - 142

https://doi.org/10.1145/3234695.3236349

Published: 08 October 2018 Publication History

Abstract

The absence of tactile cues such as keys and buttons makes touchscreens difficult to navigate for people with visual impairments. Increasing tactile feedback and tangible interaction on touchscreens can improve their accessibility. However, prior solutions have either required hardware customization or provided limited functionality with static overlays. Prior investigation of tactile solutions for large touchscreens also may not address the challenges on mobile devices. We therefore present Interactiles, a low cost, portable, and unpowered system that enhances tactile interaction on Android touchscreen phones. Interactiles consists of 3D-printed hardware interfaces and software that maps interaction with that hardware to manipulation of a mobile app. The system is compatible with the built-in screen reader without requiring modification of existing mobile apps. We describe the design and implementation of Interactiles, and we evaluate its improvement in task performance and the user experience it enables with people who are blind or have low vision.

Supplementary Material

suppl.mov (fp044.mp4)

Supplemental video

Download
15.55 MB

References

[1]

Afb.org. Statistical Snapshots from the American Foundation for the Blind. Retrieved from http://www.afb.org/info/blindness-statistics/2

[2]

Apple. Accessibility. Retrieved from http://www.apple.com/accessibility/osx/voiceover/

[3]

Shiri Azenkot, Cynthia L. Bennett, and Richard E. Ladner. 2013. DigiTaps: Eyes-Free Number Entry on Touchscreens with Minimal Audio Feedback. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2013), 85--90.

Digital Library

[4]

Mark S. Baldwin, Gillian R. Hayes, Oliver L. Haimson, Jennifer Mankoff, and Scott E. Hudson. 2017. The Tangible Desktop. ACM Transactions on Accessible Computing (TACCESS) 10, 3: 1--28.

Digital Library

[5]

Olivier Bau, Ivan Poupyrev, Ali Israr, and Chris Harrison. 2010. TeslaTouch: Electrovibration for Touch Surfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2010), 283--292.

Digital Library

[6]

Blitab. Blitab | Feelings Get Visible. Retrieved from http://blitab.com/

[7]

Tzu-wen Chang, Neng-Hao Yu, Sung-Sheng Tsai, Mike Y. Chen, and Yi-Ping Hung. 2012. Clip-on Gadgets: Expandable Tactile Controls for Multi-touch Devices. In Proceedings of the International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2012), 163--166.

Digital Library

[8]

Yasmine N. El-Glaly, Francis Quek, Tonya Smith-Jackson, and Gurjot Dhillon. 2013. Touch-screens Are Not Tangible. In Proceedings of the International Conference on Tangible, Embedded and Embodied Interaction (TEI 2013), 245--253.

Digital Library

[9]

Google. Get started on Android with TalkBack. Retrieved from https://support.google.com/accessibility/android/answer/6283677?hl=en

[10]

Google. Dashboards | Android Developers. Retrieved from https://developer.android.com/about/dashboards/index.html

[11]

Google. AccessibilityEvent. Retrieved from https://developer.android.com/reference/android/view/accessibility/AccessibilityEvent.html

[12]

Tiago Guerreiro, Hugo Nicolau, Joaquim Jorge, and Daniel Gonçalves. 2009. NavTap: a Long Term Study with Excluded Blind Users. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2009), 99--106.

Digital Library

[13]

Anhong Guo, Jeeeun Kim, Xiang "Anthony" Chen, Tom Yeh, Scott E. Hudson, Jennifer Mankoff, and Jeffrey P. Bigham. 2017. Facade: Auto-generating Tactile Interfaces to Appliances. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017), 5826--5838.

Digital Library

[14]

A T Guys. Tactile Screen Protector for iPhone 5C Phone Otterbox Case. Retrieved from http://www.atguys.com/store/index.php?main_page=product_info&products_id=172

[15]

Liang He, Zijian Wan, Stacy Biloa, Leah Findlater, and Jon E. Froehlich. 2017. TacTILE: a Preliminary Toolchain for Creating Accessible Graphics with 3D-printed Overlays and Auditory Annotations. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2017), 397--398.

Digital Library

[16]

Humanware. Victor Reader Stream. Retrieved from https://store.humanware.com/hus/victor-reader-stream-new-generation.html

[17]

Shaun K. Kane, Jeffrey P. Bigham, and Jacob O. Wobbrock. 2008. Slide Rule: Making Mobile Touch Screens Accessible to Blind People using Multi-touch Interaction Techniques. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2008), 73--80.

Digital Library

[18]

Shaun K. Kane, Chandrika Jayant, Jacob O. Wobbrock, and Richard E. Ladner. 2009. Freedom to Roam: A Study of Mobile Device Adoption and Accessibility for People with Visual and Motor Disabilities. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2009), 115--122.

Digital Library

[19]

Shaun K. Kane, Meredith Ringel Morris, Annuska Z. Perkins, Daniel Wigdor, Richard E. Ladner, Jacob O. Wobbrock, and Meredith Ringel Morris. 2011. Access Overlays: Improving Non-Visual Access to Large Touch Screens for Blind Users. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2011), 273--282.

Digital Library

[20]

Shaun K Kane, Meredith Ringel Morris, and Jacob O. Wobbrock. 2013. Touchplates: Low-cost Tactile Overlays for Visually Impaired Touch Screen Users. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2013).

Digital Library

[21]

Lifewire. Review: Touchfire Keyboard for the iPad. Retrieved from https://www.lifewire.com/review-touchfire-keyboard-ipad-1994430

[22]

David McGookin, Stephen Brewster, and WeiWei Jiang. 2008. Investigating Touchscreen Accessibility for People with Visual Impairments. In Proceedings of the Nordic Conference on Human-Computer Interaction: Building Bridges (NordiCHI 2008), 298--307.

Digital Library

[23]

Nuance. T9 Text Input. Retrieved from https://www.nuance.com/mobile/mobile-solutions/text-input-solutions/t9.html

[24]

World Health Organization. 2011. World Report on Disability. Retrieved from http://www.who.int/disabilities/world_report/2011/en/

[25]

OwnFone. Make Your OwnFone. Retrieved from https://www.myownfone.com/make-your-ownfone

[26]

Mario Romero, Brian Frey, Caleb Southern, and Gregory D. Abowd. 2011. BrailleTouch: Designing a Mobile Eyes-free Soft Keyboard. In Proceedings of the International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2011), 707--709.

Digital Library

[27]

Statista. 2016. Number of Available Applications in the Google Play Store. Retrieved from http://www.statista.com/statistics/266210/number-of-available-applications-in-the-google-play-store/

[28]

Stevezhanggeek. CHI2017Demo. Retrieved from https://github.com/appaccess/CHI2017Demo

[29]

Brandon Taylor, Anind Dey, Dan Siewiorek, and Asim Smailagic. 2016. Customizable 3D Printed Tactile Maps as Interactive Overlays. In Proceedings of the ACM Conference on Computers and Accessibility (ASSETS 2016), 71--79.

Digital Library

[30]

Touchfire. Touchfire Ultra-Protective Magnetic Case and 3D Keyboard. Retrieved from https://touchfire.com/

[31]

Daniel Trindade, André Rodrigues, Tiago Guerreiro, and Hugo Nicolau. 2018. Hybrid-Brailler: Combining Physical and Gestural Interaction for Mobile Braille Input and Editing. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2018).

Digital Library

[32]

Xiaoyi Zhang, Anne Ross, Anat Caspi, James Fogarty, and Jacob O. Wobbrock. 2017. Interaction Proxies for Runtime Repair and Enhancement of Mobile Application Accessibility. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017), 6024--6037.

Digital Library

Cited By

Milallos ROh TPeiris R(2024)Exploring the Effectiveness of Electrotactile Feedback for Data Visualization for Blind and Visually Impaired UsersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60884-1_28(413-428)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60884-1_28
Huang TYu CShi WWang BYang DZhu YLi ZShi Y(2023)Interaction Proxy ManagerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109297:3(1-39)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610929
Lee WHung CTing CChi PChen B(2023)TacNote: Tactile and Audio Note-Taking for Non-Visual AccessProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606784(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606784
Show More Cited By

Index Terms

Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility
1. Human-centered computing
  1. Accessibility
    1. Accessibility systems and tools

Recommendations

An evaluation of BrailleTouch: mobile touchscreen text entry for the visually impaired
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services

We present the evaluation of BrailleTouch, an accessible keyboard for blind users on touchscreen smartphones. Based on the standard Perkins Brailler, BrailleTouch implements a six-key chorded braille soft keyboard. Eleven blind participants typed for ...
TacTILE: A Preliminary Toolchain for Creating Accessible Graphics with 3D-Printed Overlays and Auditory Annotations
ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Tactile overlays with audio annotations can increase the accessibility of touchscreens for blind users; however, preparing these overlays is complex and labor intensive. We introduce TacTILE, a novel toolchain to more easily create tactile overlays with ...
Braille Touch: mobile touchscreen text entry for the visually impaired
MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion

We present a demonstration of BrailleTouch, an accessible keyboard for blind users on a touchscreen smartphone (see Figure 1). Based on the standard Perkins Brailler, BrailleTouch implements a six-key chorded braille soft keyboard [1]. We will briefly ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

October 2018

508 pages

ISBN:9781450356503

DOI:10.1145/3234695

General Chair:
Faustina Hwang
University of Reading, UK
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
David Flatla
University of Guelph, Canada

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Institute on Disability, Independent Living and Rehabilitation Research
National Science Foundation
Google

Conference

ASSETS '18

Sponsor:

SIGACCESS

ASSETS '18: The 20th International ACM SIGACCESS Conference on Computers and Accessibility

October 22 - 24, 2018

Galway, Ireland

Acceptance Rates

ASSETS '18 Paper Acceptance Rate 28 of 108 submissions, 26%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
734
Total Downloads

Downloads (Last 12 months)121
Downloads (Last 6 weeks)24

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Milallos ROh TPeiris R(2024)Exploring the Effectiveness of Electrotactile Feedback for Data Visualization for Blind and Visually Impaired UsersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60884-1_28(413-428)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60884-1_28
Huang TYu CShi WWang BYang DZhu YLi ZShi Y(2023)Interaction Proxy ManagerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109297:3(1-39)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610929
Lee WHung CTing CChi PChen B(2023)TacNote: Tactile and Audio Note-Taking for Non-Visual AccessProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606784(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606784
Dominguez-Reyes RMoreno LMunoz-Sanchez ARuiz Mezcua BSavoini B(2023)Modular 3-D-Printed Education Tool for Blind and Visually Impaired Students Oriented to Net StructuresIEEE Transactions on Education10.1109/TE.2022.318324466:1(55-61)Online publication date: Feb-2023
https://doi.org/10.1109/TE.2022.3183244
Kong JZhong MFogarty JWobbrock J(2022)Quantifying Touch: New Metrics for Characterizing What Happens During a TouchProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544804(1-13)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544804
Hofmann MMack KBirchfield JCao JHughes AKurpad SLum KWarnock ECaspi AHudson SMankoff J(2022)Maptimizer: Using Optimization to Tailor Tactile Maps to Users NeedsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517436(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517436
Lei WFan MThang J(2022)“I Shake The Package To Check If It’s Mine”Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502063(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502063
Colley MKränzle TRukzio E(2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519701
Barvir RVondrakova ABrus J(2021)Efficient Interactive Tactile Maps: A Semi-Automated Workflow Using the TouchIt3D Technology and OpenStreetMap DataISPRS International Journal of Geo-Information10.3390/ijgi1008050510:8(505)Online publication date: 27-Jul-2021
https://doi.org/10.3390/ijgi10080505
Oh UJoh HLee Y(2021)Image Accessibility for Screen Reader Users: A Systematic Review and a Road MapElectronics10.3390/electronics1008095310:8(953)Online publication date: 16-Apr-2021
https://doi.org/10.3390/electronics10080953
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents