research-article

Public Access

Helping Those with Visual Impairments Read Mathematics: A Spatial Approach

Authors:

Glen Hordemann,

Francis QuekAuthors Info & Claims

PETRA '22: Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments

Pages 286 - 293

https://doi.org/10.1145/3529190.3529193

Published: 11 July 2022 Publication History

All formats PDF

Abstract

Though many tools have been designed for low vision mathematics readers, mathematical literacy among individuals with blindness or severe visual impairment (IBSVI) remains astonishingly low. In this paper we present a novel system to facilitate access to mathematical expressions for IBSVI using a common smartphone device augmented with a tactile overlay. Using this system, participants were given fourteen mathematical expressions ranging in difficulty from elementary to middle school-level mathematics. We found users quickly learned to use the system to accurately read mathematical expressions. Using a situated analysis approach, we showed that IBSVI mathematics readers, when given access to the spatial layout of the expression, engaged in a range of interaction strategies to explore, reaccess and read mathematical expressions in a manner which most suited their inherent abilities and needs.

References

[1]

M. Bitter, ""Braille in mathematics education," Radboud University Nijmegan, 2013.

[2]

J. Blackorby, "The academic performance of secondary school students with disabilities," The achievements of youth with disabilities during secondary school, 2003.

[3]

J. Blackorby and R. Cameto, "Chances in the School Engagement and Academic Performance of Students with Disabilities," Wave 1 Wave 2 Overview, 2004.

[4]

J. McAfoose and B. Baune, "Exploring Visual–Spatial Working Memory: A Critical Review of Concepts and Models," Neuropsychology, 2009.

[5]

M. van Asselen, R. Kessels, S. Neggers, L. Kappelle, C. Frijns and Postma, "Brain areas involved in spatial working memory," Neuropsychologia, 2006.

[6]

E. Awh and J. Jonides, "Overlapping mechanisms of attention and spatial working memory," Trends in cognitive sciences, 2001.

[7]

A. Karshmer, G. Gupta and E. Pontelli, "Mathematics and accessibility: A Survey," Proc. 9th international conference on computers helping people with special needs, 2007.

[8]

C. Rasmussen and J. Bisanz, "Representation and working memory in early arithmetic," Journal of Experimental Child Psychology, 2005.

[9]

D. Berg, "Working memory and arithmetic calculation in children: The contributory roles of processing speed, short-term memory, and reading," Journal of Experimental Child Psychology, 2008.

[10]

L. Rosenblum and S. Amato, "Preparation in and Use of the Nemeth Braille Code for Mathematics by Teachers of Students with Visual Impairments," Journal of Visual Impairment & Blindness, 2004.

[11]

C. Navy, "The History of the Nemeth Code: An Interview with Dr. Abraham Nemeth," [Online]. Available: https://nfb.org//images/nfb/publications/fr/fr28/fr280110.htm.

[12]

K. O'Hara and A. Sellen, "A comparison of reading paper and on-line documents," CHI '97: Proceedings of the ACM SIGCHI Conference on Human factors in computing systems, 1997.

[13]

H. Cohen, P. Voss, F. Lepore and P. Scherzer, "The Nature of Working Memory for Braille," Health and Medicine, 2010.

[14]

M. Hegarty and M. Kozhevnikov, "Types of Visual-Spatial Representations and Mathematical Problem Solving," Journal of Educational Psychology, 1999.

[15]

J. Gradner, "2003 Cofnerence Proceedings," 2003. [Online]. Available: http://www.csun.edu/∼hfdss006/conf/2003/proceedings/284.htm.

[16]

J. Gardner, "Dotsplus - Better than Braille?," ACM Sigcaph, 1995.

[17]

J. Gradner, "Access by blind students and professionals to mainstream math and science," International Conference on Computers for Handicapped Persons, 2002.

[18]

J. Gardner, L. Ungier and J. Boyer, "Braille math made easy with the tiger formatter," ICCHP 2006: Computers Helping People with Special Needs, pp. 1215-1222, 2006.

[19]

J. Loomis, "On the tangibility of letters and braille," Perception & Psychophysic, pp. 37-46, 1981.

[20]

Y. El-Glaly, "Spatial reading system for individuals with blindness," Virginia Polytechnic Institute and State University, 2013.

[21]

E. Hansen, V. Shute and S. Landau, "An Assessment-for-Learning System in Mathematics for Individuals with Visual Impairments," Journal of Visual Impairment & Blindness, 2010.

[22]

B. Sadia, A. A. M. Sadic and C. Basdogan, "Exploration strategies for tactile graphics displayed by electrovibration on a touchscreen," International Journal of Human-Computer Studies, 2022.

[23]

R. Klatzky and S. Lederman, "There's More to Touch Than Meets the Eye: The Salience of Object Attributes for Haptics With and Without Vision," Journal of Experimental Psychology, pp. 356-369, 1987.

[24]

S. Lederman and R. Klatzky, "Extracting objects’ properties by haptic exploration," Acta Psychologica, pp. 29-40, 1993.

[25]

F. Bara, "Exploratory Procedures Employed by Visually Impaired Children During Joint Book Reading," Journal of Developmental and Physical Disabilities, pp. 151-170, 2013.

[26]

M. Bahrin, H. Yusof and S. Sidek, "Tactile Graphics Exploration Studies Using Fingertip Tracking Based On Colour Markers Detection For Visually Impaired People," 7th International Conference on Mechatronics Engineering (ICOM), 2019.

[27]

J. Tennison and Gorlweicz, "Non-visual Perception of Lines on a Multimodal Touchscreen Tablet," ACM Transactions on Applied Perception, 2019.

[28]

J. Tekli, Y. Issa and R. Chbeir, "Evaluating touch-screen vibration modality for blind users to access simple shapes and graphics," International Journal of Human-Computer Studies, pp. 115-133, 2018.

[29]

A. McKerracher and V. Morash, "The Relationship between tactile graphics and mathematics for students with visual impairments," Terra Haptica, 2015.

[30]

D. Smith and S. Smothers, " Derrick W. Smith, Ed.D., COMS, Sinikka M. Smothers, Ed.D., NBCTFirst Published January 7, 2019 Research Article https://doi.org/10.1177/0145482X1210600905 Article information No Access Abstract Introduction The purpose of the study presented here was to," The Role and Characteristics of Tactile Graphics in Secondary Mathematics and Science Textbooks in Braille, 2019.

[31]

"Blind Math Gems Students | NCBYS," 2004. [Online]. Available: https://blindscience.org/blindmath-gems-students.

[32]

M. Wuerthele, "Inside the iPhone 7: Apple's Taptic Engine, explained," 27 September 2016. [Online]. Available: https://appleinsider.com/articles/16/09/27/inside-the-iphone-7-apples-taptic-engine-explained.

[33]

T. E. Agency, "Mathematics Texas Essential Knowledge and Skills | Texas Education Agency," 2020. [Online]. Available: https://tea.texas.gov/academics/curriculum-standards/teks-review/mathematics-texas-essential-knowledge-and-skills.

[34]

R. Brooks, "Intelligence without representation," Artificially Intelligence, pp. 139-159, 1991.

[35]

B. Challis and A. Edwards, "Design Principles for Tactile Interaction," International Workshop on Haptic Human-Computer Interaction, pp. 17-24, 2000.

[36]

D. McGookin and S. Brewster, "Graph builder: Constructing non-visual visualizations," People and Computers XX — Engage, pp. 263-278, 2007.

[37]

S. Hart, "Nasa-Task Load Index (NASA-TLX); 20 Years Later," Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2006.

[38]

J. Holton, The SAGE Handbook of Grounded Theory, SAGE Publications, 2007.

[39]

R. Zanibba, D. Blostein and J. Cordy, "Baseline Structure Analysis of Handwritten Mathematics Notation," Proceedings of Sixth International Conference on Document Analysis and Recognition., 2001.

[40]

D. Gillan, P. Barraza and A. P. S. Karshmer, "Cognitive Analysis of Equation Reading: Application to the Development of the Math Genie," Computers Helping People with Special Needs, pp. 630-637, 2004.

[41]

C. Shoeb, "Math, visual impairment and linearity," 2008. [Online]. Available: https://blogs.swarthmore.edu/its/2018/05/07/math-sounds/.

[42]

J. Gradner, "Access by Blind Students and Professionals to Mainstream Math and Science," International Conference on Computers for Handicapped Persons, 2002.

Cited By

Howell JChan AHordemann GQuek F(2023)Mathematics as Interactive Multimedia2023 IEEE International Symposium on Multimedia (ISM)10.1109/ISM59092.2023.00029(160-167)Online publication date: 11-Dec-2023
https://doi.org/10.1109/ISM59092.2023.00029
Howell JQuek F(2023)Math for Those with Severe Low Vision: From the Particulars to the Gestalt (And Back Again)2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343509(1-9)Online publication date: 18-Oct-2023
https://doi.org/10.1109/FIE58773.2023.10343509

Index Terms

Helping Those with Visual Impairments Read Mathematics: A Spatial Approach
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Social and professional topics
  1. User characteristics

Index terms have been assigned to the content through auto-classification.

Recommendations

Investigating touchscreen accessibility for people with visual impairments
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

Touchscreen computing devices such as the iPhone are becoming more common. However this technology is largely inaccessible to people with visual impairments. We present the results of a requirements capture study that illustrates the problems with ...
Assistive technology-based solutions in learning mathematics for visually-impaired people: exploring issues, challenges and opportunities
Abstract
In the absence of vision, visually impaired and blind people rely upon the tactile sense and hearing to obtain information about their surrounding environment. These senses cannot fully compensate for the absence of vision, so visually impaired ...
Social Predictors of Assistive Technology Proficiency Among Teachers of Students with Visual Impairments

Assistive technology (AT) is critical for K-12 students who have visual impairments to engage with their education and is predictive of positive postsecondary outcomes and future employment. Teachers of students with visual impairments (TVIs) act as the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '22: Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments

June 2022

704 pages

ISBN:9781450396318

DOI:10.1145/3529190

Conference Chair:
Fillia Makedon

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

PETRA '22

PETRA '22: The15th International Conference on PErvasive Technologies Related to Assistive Environments

June 29 - July 1, 2022

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
348
Total Downloads

Downloads (Last 12 months)183
Downloads (Last 6 weeks)27

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Howell JChan AHordemann GQuek F(2023)Mathematics as Interactive Multimedia2023 IEEE International Symposium on Multimedia (ISM)10.1109/ISM59092.2023.00029(160-167)Online publication date: 11-Dec-2023
https://doi.org/10.1109/ISM59092.2023.00029
Howell JQuek F(2023)Math for Those with Severe Low Vision: From the Particulars to the Gestalt (And Back Again)2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343509(1-9)Online publication date: 18-Oct-2023
https://doi.org/10.1109/FIE58773.2023.10343509

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten