Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3640543.3645175acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

Published: 05 April 2024 Publication History

Abstract

In a world driven by data visualization, ensuring the inclusive accessibility of charts for Blind and Visually Impaired (BVI) individuals remains a significant challenge. Charts are usually presented as raster graphics without textual and visual metadata needed for an equivalent exploration experience for BVI people. Additionally, converting these charts into accessible formats requires considerable effort from sighted individuals. Digitizing charts with metadata extraction is just one aspect of the issue; transforming it into accessible modalities, such as tactile graphics, presents another difficulty. To address these disparities, we propose Chart4Blind, an intelligent user interface that converts bitmap image representations of line charts into universally accessible formats. Chart4Blind achieves this transformation by generating Scalable Vector Graphics (SVG), Comma-Separated Values (CSV), and alternative text exports, all comply with established accessibility standards. Through interviews and a formal user study, we demonstrate that even inexperienced sighted users can make charts accessible in an average of 4 minutes using Chart4Blind, achieving a System Usability Scale rating of 90%. In comparison to existing approaches, Chart4Blind provides a comprehensive solution, generating end-to-end accessible SVGs suitable for assistive technologies such as embossed prints (papers and laser cut), 2D tactile displays, and screen readers. For additional information, including open-source codes and demos, please visit our project page https://moured.github.io/chart4blind/.

Supplemental Material

MP4 File
Short demo video for our Chart4blin, and the supplementary materials from our user study.
PDF File
Short demo video for our Chart4blin, and the supplementary materials from our user study.

References

[1]
Md Zubair Ibne Alam, Shehnaz Islam, and Enamul Hoque. 2023. SeeChart: Enabling Accessible Visualizations Through Interactive Natural Language Interface For People with Visual Impairments. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 46–64.
[2]
Helmut Alt and Michael Godau. 1995. Computing the Fréchet distance between two polygonal curves. International Journal of Computational Geometry & Applications 5, 01n02 (1995), 75–91.
[3]
Kerstin Altmanninger and Wolfram Wöß. 2006. Dynamically generated scalable vector graphics (SVG) for barrier-free web-applications. In Computers Helping People with Special Needs: 10th International Conference, ICCHP 2006, Linz, Austria, July 11-13, 2006. Proceedings 10. Springer, 128–135.
[4]
Kosuke Araki, Tetsuya Watanabe, and Kazunori Minatani. 2014. Development of Tactile Graph Generation Software Using the R Statistics Software Environment. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (Rochester, New York, USA) (ASSETS ’14). Association for Computing Machinery, New York, NY, USA, 251–252.
[5]
Filip Bajić and Josip Job. 2023. Review of chart image detection and classification. International Journal on Document Analysis and Recognition (IJDAR) (2023), 1–22.
[6]
Abhijit Balaji, Thuvaarakkesh Ramanathan, and Venkateshwarlu Sonathi. 2018. Chart-text: A fully automated chart image descriptor. arXiv preprint arXiv:1812.10636 (2018).
[7]
[7] Safwane Benbba. 2021. Comparison of D3. js and Chart. js as visualisation tools. B.S. thesis.
[8]
Jeffrey P. Bigham, Ryan S. Kaminsky, Richard E. Ladner, Oscar M. Danielsson, and Gordon L. Hempton. 2006. WebInSight: Making Web Images Accessible. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Portland, Oregon, USA) (Assets ’06). Association for Computing Machinery, New York, NY, USA, 181–188.
[9]
Matthew Blanco, Jonathan Zong, and Arvind Satyanarayan. 2022. Olli: An extensible visualization library for screen reader accessibility. IEEE VIS Posters 6 (2022).
[10]
Egil Bru, Thomas Trautner, and Stefan Bruckner. 2023. Line Harp: Importance-Driven Sonification for Dense Line Charts. arXiv preprint arXiv:2307.16589 (2023).
[11]
Matthew Butler, Leona M Holloway, Samuel Reinders, Cagatay Goncu, and Kim Marriott. 2021. Technology Developments in Touch-Based Accessible Graphics: A Systematic Review of Research 2010-2020. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 278, 15 pages.
[12]
Arindam Chaudhuri, Krupa Mandaviya, Pratixa Badelia, Soumya K Ghosh, Arindam Chaudhuri, Krupa Mandaviya, Pratixa Badelia, and Soumya K Ghosh. 2017. Optical character recognition systems. Springer.
[13]
Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov, and Rohit Girdhar. 2022. Masked-attention Mask Transformer for Universal Image Segmentation. CVPR.
[14]
Zhi-Qi Cheng, Qi Dai, Siyao Li, Jingdong Sun, Teruko Mitamura, and Alexander G Hauptmann. 2023. ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules. arXiv preprint arXiv:2304.02173 (2023).
[15]
Jinho Choi, Sanghun Jung, Deok Gun Park, Jaegul Choo, and Niklas Elmqvist. 2019. Visualizing for the non-visual: Enabling the visually impaired to use visualization. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 249–260.
[16]
Software Freedom Conservancy. 2023. Inkscape: Open Source Scalable Vector Graphics Editor. Retrieved January 18, 2024 from https://inkscape.org
[17]
World Wide Web Consortium 1999. Web content accessibility guidelines 1.0. (1999).
[18]
Heather Devine, Andres Gonzalez, and Matthew Hardy. 2011. Making accessible PDF documents. In Proceedings of the 11th ACM symposium on Document engineering. 275–276.
[19]
Polly Edman. 1992. Tactile graphics. American Foundation for the Blind.
[20]
Christin Engel, Emma Franziska Müller, and Gerhard Weber. 2019. SVGPlott: an accessible tool to generate highly adaptable, accessible audio-tactile charts for and from blind and visually impaired people. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 186–195.
[21]
Christin Engel and Gerhard Weber. 2017. Improve the accessibility of tactile charts. In Human-Computer Interaction-INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25–29, 2017, Proceedings, Part I 16. Springer, 187–195.
[22]
Christin Engel and Gerhard Weber. 2018. A user study to evaluate tactile charts with blind and visually impaired people. In Computers Helping People with Special Needs: 16th International Conference, ICCHP 2018, Linz, Austria, July 11-13, 2018, Proceedings, Part II 16. Springer, 177–184.
[23]
Ali Mazraeh Farahani, Peyman Adibi, Mohammad Saeed Ehsani, Hans-Peter Hutter, and Alireza Darvishy. 2023. Automatic Chart Understanding: A Review. IEEE Access 11 (2023), 76202–76221.
[24]
Jon Ferraiolo, Fujisawa Jun, and Dean Jackson. 2000. Scalable vector graphics (SVG) 1.0 specification. iuniverse Bloomington.
[25]
The Document Foundation. 2020. LibreOffice Draw. Retrieved January 18, 2024 from https://www.libreoffice.org/discover/draw/
[26]
The Document Foundation. 2023. LibreOffice. Retrieved January 18, 2024 from https://www.libreoffice.org
[27]
Gillian Gale. 2005. Guidelines on Conveying Visual Information. Round Table on Information Access for People with Print Disabilities Inc. Available from http://printdisability. org/guidelines/guidelines-on-conveying-visual-information-2005 (2005).
[28]
A Jonathan R Godfrey and M Theodor Loots. 2014. Statistical software (R, SAS, SPSS, and Minitab) for blind students and practitioners. Journal of Statistical Software 58 (2014), 1–25.
[29]
Cagatay Goncu and Kim Marriott. 2008. Tactile Chart Generation Tool. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Halifax, Nova Scotia, Canada) (Assets ’08). Association for Computing Machinery, New York, NY, USA, 255–256.
[30]
Muhammad Yusuf Hassan, Mayank Singh, 2023. LineEX: Data Extraction From Scientific Line Charts. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 6213–6221.
[31]
Thomas Hermann, Andy Hunt, John G Neuhoff, 2011. The sonification handbook. Vol. 1. Logos Verlag Berlin.
[32]
Leona M Holloway, Cagatay Goncu, Alon Ilsar, Matthew Butler, and Kim Marriott. 2022. Infosonics: Accessible infographics for people who are blind using sonification and voice. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–13.
[33]
Joseph A Huwaldt and S Steinhorst. 2023. Plot digitizer. Retrieved January 18, 2024 from http://plotdigitizer. sourceforge. net
[34]
Web Accessibility Initiative. 2023. W3C. Retrieved January 18, 2024 from https://www.w3.org/WAI/tutorials/images/
[35]
Chandrika Jayant, Matt Renzelmann, Dana Wen, Satria Krisnandi, Richard Ladner, and Dan Comden. 2007. Automated Tactile Graphics Translation: In the Field. In Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (Tempe, Arizona, USA) (Assets ’07). Association for Computing Machinery, New York, NY, USA, 75–82.
[36]
Patrick W Jordan, Bruce Thomas, Ian Lyall McClelland, and Bernard Weerdmeester. 1996. Usability evaluation in industry. CRC Press.
[37]
Daekyoung Jung, Wonjae Kim, Hyunjoo Song, Jeong-in Hwang, Bongshin Lee, Bohyoung Kim, and Jinwook Seo. 2017. ChartSense: Interactive Data Extraction from Chart Images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6706–6717.
[38]
Shankar Kantharaj, Rixie Tiffany Ko Leong, Xiang Lin, Ahmed Masry, Megh Thakkar, Enamul Hoque, and Shafiq Joty. 2022. Chart-to-Text: A Large-Scale Benchmark for Chart Summarization. arxiv:2203.06486 [cs.CL]
[39]
Anthony Kay. 2007. Tesseract: an open-source optical character recognition engine. Linux Journal 2007, 159 (2007), 2.
[40]
Stephen E. Krufka and Kenneth E. Barner. 2005. Automatic Production of Tactile Graphics from Scalable Vector Graphics. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Baltimore, MD, USA) (Assets ’05). Association for Computing Machinery, New York, NY, USA, 166–172.
[41]
Jay Lal, Aditya Mitkari, Mahesh Bhosale, and David Doermann. 2023. LineFormer: Rethinking Line Chart Data Extraction as Instance Segmentation. arxiv:2305.01837 [cs.CV]
[42]
D.J. Leiner. 2019. SoSci Survey – the Solution for Professional Online Questionnaires. Retrieved October 6, 2023 from https://www.soscisurvey.de/en/index
[43]
Jingyi Li, Son Kim, Joshua A Miele, Maneesh Agrawala, and Sean Follmer. 2019. Editing spatial layouts through tactile templates for people with visual impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.
[44]
Alan Lundgard and Arvind Satyanarayan. 2021. Accessible visualization via natural language descriptions: A four-level model of semantic content. IEEE transactions on visualization and computer graphics 28 (2021), 1073–1083.
[45]
Alan Lundgard and Arvind Satyanarayan. 2022. Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2022), 1073–1083.
[46]
Damien Masson, Sylvain Malacria, Daniel Vogel, Edward Lank, and Géry Casiez. 2023. ChartDetective: Easy and Accurate Interactive Data Extraction from Complex Vector Charts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 147, 17 pages.
[47]
Damien Masson, Sylvain Malacria, Daniel Vogel, Edward Lank, and Géry Casiez. 2023. ChartDetective: Easy and Accurate Interactive Data Extraction from Complex Vector Charts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.
[48]
Omar Moured, Sara Alzalabny, Thorsten Schwarz, Bastian Rapp, and Rainer Stiefelhagen. 2023. Accessible Document Layout: An Interface for 2D Tactile Displays. In Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments. 265–271.
[49]
Omar Moured, Jiaming Zhang, Alina Roitberg, Thorsten Schwarz, and Rainer Stiefelhagen. 2023. Line Graphics Digitization: A Step Towards Full Automation. In International Conference on Document Analysis and Recognition. Springer, 438–453.
[50]
H Nagao and S Hatanaka. 2005. Braille Books and Translation of Illustration by Using PCs. Dokusho Kobo, Tokyo (2005).
[51]
George Nagy, Thomas A. Nartker, and Stephen V. Rice. 1999. Optical character recognition: an illustrated guide to the frontier. In Document Recognition and Retrieval VII, Daniel P. Lopresti and Jiangying Zhou (Eds.). Vol. 3967. International Society for Optics and Photonics, SPIE, 58 – 69.
[52]
Braille Authority of North America. 2010. Guidelines and Standards for Tactile Graphics. Retrieved January 17, 2024 from https://www.brailleauthority.org/tg/web-manual/index.html
[53]
Round Table on Information Access for People with Print Disabilities. 2022. Guidelines for producing accessible graphics / Round Table on Information Access for People with Print Disabilities Inc. (2022). Retrieved January 18, 2024 from https://printdisability.org/guidelines/graphics-2022/
[54]
Denise Prescher, Jens Bornschein, and Gerhard Weber. 2014. Production of accessible tactile graphics. In Computers Helping People with Special Needs: 14th International Conference, ICCHP 2014, Paris, France, July 9-11, 2014, Proceedings, Part II 14. Springer, 26–33.
[55]
Ankit Rohatgi. 2014. WebPlotDigitizer user manual version 3.4. (2014), 1–18. Retrieved January 18, 2024 from https://automeris.io/WebPlotDigitizer/userManual.pdf
[56]
J Serrano, GM Bruscas, JV Abellán, and R Lázaro. 2021. Study of additive manufacturing techniques to obtain tactile graphics. In IOP Conference Series: Materials Science and Engineering. IOP Publishing, 012117.
[57]
Ather Sharif, Olivia H. Wang, Alida T. Muongchan, Katharina Reinecke, and Jacob O. Wobbrock. 2022. VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 478, 19 pages.
[58]
Linda Sheppard and Frances K Aldrich. 2001. Tactile graphics in school education: perspectives from teachers. British Journal of Visual Impairment 19, 3 (2001), 93–97.
[59]
Ben Shneiderman. 1996. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings 1996 IEEE symposium on visual languages. IEEE, 336–343.
[60]
Mandhatya Singh, Muhammad Suhaib Kanroo, Hadia Showkat Kawoosa, and Puneet Goyal. 2023. Towards accessible chart visualizations for the non-visuals: Research, applications and gaps. Computer Science Review 48 (2023), 100555.
[61]
Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, and Patrick Baudisch. 2016. Linespace: A Sensemaking Platform for the Blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2175–2185.
[62]
Benny Tang, Angie Boggust, and Arvind Satyanarayan. 2023. VisText: A Benchmark for Semantically Rich Chart Captioning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Toronto, Canada, 7268–7298.
[63]
Petroc Taylor. 2023. Amount of data created, consumed, and stored 2010-2020, with forecasts to 2025. Retrieved January 18, 2024 from https://www.statista.com/statistics/871513/worldwide-data-created/
[64]
John R Thompson, Jesse J Martinez, Alper Sarikaya, Edward Cutrell, and Bongshin Lee. 2023. Chart Reader: Accessible Visualization Experiences Designed with Screen Reader Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.
[65]
B. Tummers. 2006. DataThief III. Retrieved January 18, 2024 from https://datathief.org/
[66]
Russ Unger and Carolyn Chandler. 2012. A Project Guide to UX Design: For user experience designers in the field or in the making. New Riders.
[67]
Shai Vaingast. 2014. im2graph. Retrieved January 18, 2024 from https://www.im2graph.co.il/
[68]
Tetsuya Watanabe, Toshimitsu Yamaguchi, and Masaki Nakagawa. 2012. Development of software for automatic creation of embossed graphs: Comparison of non-visual data presentation methods and development up-to-date. In Computers Helping People with Special Needs: 13th International Conference, ICCHP 2012, Linz, Austria, July 11-13, 2012, Proceedings, Part I 13. Springer, 174–181.
[69]
Cong Yao, Jianan Wu, Xinyu Zhou, Chi Zhang, Shuchang Zhou, Zhimin Cao, and Qi Yin. 2015. Incidental scene text understanding: Recent progresses on icdar 2015 robust reading competition challenge 4. arXiv preprint arXiv:1511.09207 (2015).
[70]
Lu Ying, Yun Wang, Haotian Li, Shuguang Dou, Haidong Zhang, Xinyang Jiang, Huamin Qu, and Yingcai Wu. 2023. Reviving Static Charts into Live Charts. arXiv preprint arXiv:2309.02967 (2023).
[71]
Hong Zou and Jutta Treviranus. 2015. ChartMaster: A tool for interacting with stock market charts using a screen reader. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 107–116.

Cited By

View all
  • (2024)ChartFormer: A Large Vision Language Model for Converting Chart Images into Tactile Accessible SVGsComputers Helping People with Special Needs10.1007/978-3-031-62846-7_36(299-305)Online publication date: 5-Jul-2024

Index Terms

  1. Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IUI '24: Proceedings of the 29th International Conference on Intelligent User Interfaces
    March 2024
    955 pages
    ISBN:9798400705083
    DOI:10.1145/3640543
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 April 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Accessible Charts
    2. Chart
    3. Data Visualization
    4. Digitization
    5. Embossed Paper

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Data Availability

    Short demo video for our Chart4blin, and the supplementary materials from our user study. https://dl.acm.org/doi/10.1145/3640543.3645175#IUI24_final_demo.mp4
    Short demo video for our Chart4blin, and the supplementary materials from our user study. https://dl.acm.org/doi/10.1145/3640543.3645175#Chart4Blind_IUI_24_Supplementary_Materials.pdf

    Funding Sources

    Conference

    IUI '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 746 of 2,811 submissions, 27%

    Upcoming Conference

    IUI '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)129
    • Downloads (Last 6 weeks)27
    Reflects downloads up to 18 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)ChartFormer: A Large Vision Language Model for Converting Chart Images into Tactile Accessible SVGsComputers Helping People with Special Needs10.1007/978-3-031-62846-7_36(299-305)Online publication date: 5-Jul-2024

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media