research-article

Public Access

RoboGraphics: Dynamic Tactile Graphics Powered by Mobile Robots

Authors:

Darren Guinness,

Annika Muehlbradt,

Shaun K. KaneAuthors Info & Claims

ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Pages 318 - 328

https://doi.org/10.1145/3308561.3353804

Published: 24 October 2019 Publication History

Abstract

Tactile graphics are a common way to present information to people with vision impairments. Tactile graphics can be used to explore a broad range of static visual content but aren't well suited to representing animation or interactivity. We introduce a new approach to creating dynamic tactile graphics that combines a touch screen tablet, static tactile overlays, and small mobile robots. We introduce a prototype system called RoboGraphics and several proof-of-concept applications. We evaluated our prototype with seven participants with varying levels of vision, comparing the RoboGraphics approach to a flat screen, audio-tactile interface. Our results show that dynamic tactile graphics can help visually impaired participants explore data quickly and accurately.

Supplementary Material

SRT File (fp038vfc.srt)

Video figure captions

Download
3.84 KB

MP4 File (fp038vf.mp4)

Supplemental video

Download
48.32 MB

References

[1]

Parastoo Abtahi and Sean Follmer. 2018. Visuo-Haptic Illusions for Improving the Perceived Performance of Shape Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Paper 150, 13 pages.

Digital Library

[2]

Alphaboxes -- Teaching braille characters and phonetic awareness of letter sounds using a six-compartment box, 2019. https://www.tsbvi.edu/fall-2011-items/3308-alphaboxes

[3]

Catherine M. Baker, Lauren R. Milne, Ryan Drapeau, Jeffrey Scofield, Cynthia L. Bennett, and Richard E. Ladner. 2016. Tactile Graphics with a Voice. ACM Trans. Access. Comput. 8, 1, Article 3 (January 2016), 22 pages.

Digital Library

[4]

Emeline Brule, Gilles Bailly, Anke Brock, Frederic Valentin, Grégoire Denis, and Christophe Jouffrais. 2016. MapSense: Multi-Sensory Interactive Maps for Children Living with Visual Impairments. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 445--457.

Digital Library

[5]

Julie Ducasse, Marc J-M Macé, Marcos Serrano, and Christophe Jouffrais. 2016. Tangible Reels: Construction and Exploration of Tangible Maps by Visually Impaired Users. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2186--2197.

Digital Library

[6]

Aluna Everitt and Jason Alexander. 2017. PolySurface: A Design Approach for Rapid Prototyping of Shape-Changing Displays Using Semi-Solid Surfaces. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 1283--1294.

Digital Library

[7]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. In Proceedings of the 26th annual ACM symposium on User interface software and technology (UIST '13). ACM, New York, NY, USA, 417--426.

Digital Library

[8]

Darren Guinness, Annika Muehlbradt, Daniel Szafir, and Shaun K. Kane. 2018. The Haptic Video Player: Using Mobile Robots to Create Tangible Video Annotations. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). ACM, New York, NY, USA, 203--211.

Digital Library

[9]

Darren Guinness, Daniel Szafir, and Shaun K. Kane. 2017. GUI Robots: Using Off-the-Shelf Robots as Tangible Input and Output Devices for Unmodified GUI Applications. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 767--778.

Digital Library

[10]

How tech helped blind students 'watch' the solar eclipse, 2017. https://www.cnet.com/news/how-tech-helped-blind-students-watch-the-solar-eclipse/

[11]

Joseph Jacobs, ed. The fables of Aesop. Hurst, 1902.

[12]

Shaun K. Kane, Meredith Ringel Morris, Annuska Z. Perkins, Daniel Wigdor, Richard E. Ladner, and Jacob O. Wobbrock. 2011. Access overlays: improving non-visual access to large touch screens for blind users. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, New York, NY, USA, 273--282.

Digital Library

[13]

Shaun K. Kane, Meredith Ringel Morris, and Jacob O. Wobbrock. 2013. Touchplates: low-cost tactile overlays for visually impaired touch screen users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 22, 8 pages.

Digital Library

[14]

Lawrence H. Kim and Sean Follmer. 2019. SwarmHaptics: Haptic Display with Swarm Robots. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Paper 688, 13 pages.

Digital Library

[15]

Lawrence H. Kim and Sean Follmer. 2017. UbiSwarm: Ubiquitous Robotic Interfaces and Investigation of Abstract Motion as a Display. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 66 (September 2017), 20 pages.

Digital Library

[16]

Nicolai Marquardt, Miguel A. Nacenta, James E. Young, Sheelagh Carpendale, Saul Greenberg, and Ehud Sharlin. 2009. The Haptic Tabletop Puck: tactile feedback for interactive tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09). ACM, New York, NY, USA, 85--92.

Digital Library

[17]

Ayberk Özgür, Séverin Lemaignan, Wafa Johal, Maria Beltran, Manon Briod, Léa Pereyre, Francesco Mondada, and Pierre Dillenbourg. 2017. Cellulo: Versatile Handheld Robots for Education. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI '17). ACM, New York, NY, USA, 119--127.

Digital Library

[18]

Mathieu Le Goc, Lawrence H. Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 97--109.

Digital Library

[19]

Lei Shi, Yuhang Zhao, and Shiri Azenkot. 2017. Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 493--506.

Digital Library

[20]

Abigale Stangl, Jeeeun Kim, and Tom Yeh. 2014. 3D printed tactile picture books for children with visual impairments: a design probe. In Proceedings of the 2014 conference on Interaction design and children (IDC '14). ACM, New York, NY, USA, 321--324.

Digital Library

[21]

Ryo Suzuki, Abigale Stangl, Mark D. Gross, and Tom Yeh. 2017. FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 190--199.

Digital Library

[22]

The Magic School Bus -- Scholastic, 2019. https://kids.scholastic.com/kids/books/the-magic-school-bus/

[23]

TinyBop Mammals -- Mammals education app for kids by TinyBop, 2019. https://tinybop.com/apps/mammals

[24]

Brianna J. Tomlinson, R. Michael Winters, Christopher Latina, Smruthi Bhat, Milap Rane, & Bruce N. Walker. 2017. Solar System Sonification: Exploring Earth and its Neighbors through Sound Georgia Tech Center for Music Technology ( GTCMT ) 2, Georgia Institute of Technology, Atlanta, USA, (Icad), 128--134.

[25]

Yu,Wai, and Stephen Brewster. "Comparing two haptic interfaces for multimodal graph rendering." In Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002, pp. 3--9. IEEE, 2002.

[26]

Steven Wall and Stephen Brewster. 2006. Feeling what you hear: tactile feedback for navigation of audio graphs. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), Rebecca Grinter, Thomas Rodden, Paul Aoki, Ed Cutrell, Robin Jeffries, and Gary Olson (Eds.). ACM, New York, NY, USA, 1123--1132. DOI=http://dx.doi.org/10.1145/1124772.1124941

Digital Library

[27]

YouDescribe -- Audio Descriptions for YouTube videos, 2019. https://youdescribe.org

Cited By

Raynal MDucasse JMacé MOriola BJouffrais C(2024)The FlexiBoard: Tangible and Tactile Graphics for People with Vision ImpairmentsMultimodal Technologies and Interaction10.3390/mti80300178:3(17)Online publication date: 27-Feb-2024
https://doi.org/10.3390/mti8030017
Jiang CFan YXie JKuang EZhang KFan M(2024)Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending ChartsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642546(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642546
Chundury PReyazuddin YJordan JLazar JElmqvist N(2024)TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen AccessibilityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332693730:1(836-846)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3326937
Show More Cited By

Index Terms

RoboGraphics: Dynamic Tactile Graphics Powered by Mobile Robots
1. Human-centered computing
  1. Accessibility
    1. Accessibility systems and tools

Recommendations

RoboGraphics: Using Mobile Robots to Create Dynamic Tactile Graphics
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Tactile graphics are a common way to present information to people with vision impairments. Tactile graphics can be used to explore a broad range of content including presenting data, telling stories, and conveying map information, but aren't well ...
The Haptic Video Player: Using Mobile Robots to Create Tangible Video Annotations
ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

Video and animation are common ways of delivering concepts that cannot be easily communicated through text. This visual information is often inaccessible to blind and visually impaired people, and alternative representations such as Braille and audio ...
Touch-screens are not tangible: fusing tangible interaction with touch glass in readers for the blind
TEI '13: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction

In this paper we introduce the idea of making touch surfaces of mobile devices (e.g. touch phones and tablets) truly tangible for Individuals with Blindness or Severe Visual Impairment (IBSVI). We investigate how to enable IBSVI to fuse tangible ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

October 2019

730 pages

ISBN:9781450366762

DOI:10.1145/3308561

General Chair:
Jeffrey P. Bigham
Carnegie Mellon University., USA
,
Program Chairs:
Shiri Azenkot
Cornell Tech, USA
,
Shaun K. Kane
University of Colorado Boulder, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

ASSETS '19

Sponsor:

SIGACCESS

ASSETS '19: The 21st International ACM SIGACCESS Conference on Computers and Accessibility

October 28 - 30, 2019

PA, Pittsburgh, USA

Acceptance Rates

ASSETS '19 Paper Acceptance Rate 41 of 158 submissions, 26%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
823
Total Downloads

Downloads (Last 12 months)134
Downloads (Last 6 weeks)19

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Raynal MDucasse JMacé MOriola BJouffrais C(2024)The FlexiBoard: Tangible and Tactile Graphics for People with Vision ImpairmentsMultimodal Technologies and Interaction10.3390/mti80300178:3(17)Online publication date: 27-Feb-2024
https://doi.org/10.3390/mti8030017
Jiang CFan YXie JKuang EZhang KFan M(2024)Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending ChartsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642546(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642546
Chundury PReyazuddin YJordan JLazar JElmqvist N(2024)TactualPlot: Spatializing Data as Sound Using Sensory Substitution for Touchscreen AccessibilityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332693730:1(836-846)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3326937
Milallos ROh TPeiris R(2024)Exploring the Effectiveness of Electrotactile Feedback for Data Visualization for Blind and Visually Impaired UsersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60884-1_28(413-428)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60884-1_28
De Silva MGoodwin SHolloway LButler M(2023)Understanding Challenges and Opportunities in Body Movement Education of People who are Blind or have Low VisionProceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3597638.3608409(1-19)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1145/3597638.3608409
Kim JSrinivasan AKim NKim Y(2023)Exploring Chart Question Answering for Blind and Low Vision UsersProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581532(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581532
Chang RYong SLiao FTsao CChen B(2023)Understanding (Non-)Visual Needs for the Design of Laser-Cut ModelsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580684(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580684
Xu ZWilliams KWall E(2023)Let’s Get Vysical: Perceptual Accuracy in Visual & Tactile Encodings2023 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS54172.2023.00012(16-20)Online publication date: 21-Oct-2023
https://doi.org/10.1109/VIS54172.2023.00012
Tlapa-Monge LMontané-Jiménez L(2023)A Systematic Mapping Study on Accessibility in Data Visualizations for Visually Impaired Users2023 11th International Conference in Software Engineering Research and Innovation (CONISOFT)10.1109/CONISOFT58849.2023.00032(186-196)Online publication date: 6-Nov-2023
https://doi.org/10.1109/CONISOFT58849.2023.00032
Soares MFurukawa CCagnin MPaiva D(2023)Accessible learning objects: a systematic literature reviewUniversal Access in the Information Society10.1007/s10209-023-01025-723:4(1931-1945)Online publication date: 4-Aug-2023
https://doi.org/10.1007/s10209-023-01025-7
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents