research-article

Public Access

Exploring Auditory Graphing Software in the Classroom: The Effect of Auditory Graphs on the Classroom Environment

Authors:

Brianna J. Tomlinson,

Jared Batterman,

Yee Chieh Chew,

Bruce N. WalkerAuthors Info & Claims

ACM Transactions on Accessible Computing (TACCESS), Volume 9, Issue 1

Article No.: 3, Pages 1 - 27

https://doi.org/10.1145/2994606

Published: 18 November 2016 Publication History

Abstract

Students who are visually impaired make up a population with unique needs for learning. Some tools have been developed to support these needs in the classroom. One such tool, the Graph and Number line Input and Exploration software (GNIE), was developed by the Georgia Institute of Technology Sonification Lab. GNIE was deployed for use in a middle school math classroom at the Georgia Academy for the Blind (GAB) for 2 years starting in fall 2012. We interviewed the middle school math teacher throughout the deployment to learn about the challenges faced when teaching: lesson planning, execution, and review. We also observed how these changed when using GNIE compared to traditional teaching materials. During these 2 years, we conducted interviews and focus groups with students to learn about their attitudes toward tactile graphs compared to auditory graphs. With these in mind, we present lessons learned from the use of GNIE in a real-world classroom and implications for design of software to aid graphical learning for students with vision impairments.

References

[1]

Gerald Abner and Elizabeth Lahm. 2002. Implementation of assistive technology with students who are visually impaired: Teachers’ readiness. J. Vis. Impair. Blind. 96, 02 (2002), 98--105.

[2]

Francis J. Anscombe. 1973. Graphs in statistical analysis. Am. Stat. 27, 1 (1973), 17--21.

[3]

Jodi Aronson. 1995. A pragmatic view of thematic analysis. Qual. Rep. 2, 1 (1995), 1--3.

[4]

Assistive Technology Partnership. 2008. Assistive Technology in Education: A Guide for the Delivery of Assistive Technology Services for Students with Disabilities.

[5]

Sasha Barab. 2006. Design-based research: A methodological toolkit for the learning scientist. In The Cambridge Handbook of: The Learning Sciences. New York, NY: Cambridge University Press, 153--169.

[6]

Jared M. Batterman and Bruce N. Walker. 2012. Displaying error 8 uncertainty in auditory graphs. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS’12). New York, NY: ACM Press, 285.

Digital Library

[7]

Stephen Brewster. 2002. Visualization tools for blind people using multiple modalities. Disabil. Rehabil. 24, 11--12 (2002), 613--621.

[8]

Lorna Brown, Stephen Brewster, Ramesh Ramloll, Wai Yu, and Beate Riedel. 2002. Browsing modes for exploring sonified line graphs. In Proceedings of British Human-Computer Interaction Conference, 2. Citeseer, 6--9.

[9]

Hennie Brugman, Albert Russel, and Xd Nijmegen. 2004. Annotating multi-media/multi-modal resources with ELAN. In LREC.

[10]

Anthony P. Carnevale, Nicole Smith, and Michelle Melton. 2011. STEM: Science technology engineering mathematics. Georget. Univ. Cent. Educ. Workforce.

[11]

Center for the Study of Mathematics Curriculum. 2012. The Future of STEM Curriculum and Instructional Design: A Research and Development Agenda for Learning Designers.

[12]

Yee Chieh Chew, Brianna J. Tomlinson, and Bruce N. Walker. 2013. Graph and Number line Input and Exploration (GNIE) Tool Technical Report.

[13]

Yee Chieh Chew and Bruce N. Walker. 2013. What did you say? Visually impaired students using bonephones in math class. In 15th International ACM SIGACCESS Conference on Computers and Accessibility. Bellevue, WA: ACM, 3--4.

Digital Library

[14]

Michael Curran and James Teh. 2015. NVDA. NV Access.

[15]

Benjamin K. Davison. 2012. Evaluating auditory graphs with blind students in a classroom. ACM SIGACCESS Access. Comput. 102 (January 2012), 4--7.

Digital Library

[16]

John M. Downes and Penny Bishop. 2012. Educators engage digital natives and learn from their experiences with technology. Middle School Journal 43, 5 (2012), 6--15.

[17]

Delia Duffey and Christine Fox. 2012. National educational technology trends 2012. State Leadership Empowers Educators, Transforms Teaching and Learning. State Educational Technology Directors Association (SETDA). Washington, D.C.

[18]

Duxbury Systems. 2015. Duxbury Braille Translator. Duxbury Systems.

[19]

Edmentum. n.d. Study Island. Edmentum.

[20]

W. T. Fitch and G. Kramer. 1994. Sonifying the body electric: Superiority of an auditory over a visual display in a complex, multivariate system. St. FE Inst. Stud. Sci. Complex.-Proc. 18 (1994), 307.

[21]

John H. Flowers. 2005. Thirteen years of reflection on auditory graphing: Promises, pitfalls, and potential new directions. Fac. Publ. Dep. Psychol. (2005), 430.

[22]

Teresa Franklin and Li-Wei Peng. 2008. Mobile math: Math educators and students engage in mobile learning. J. Comput. High. Educ. 20, 2 (2008), 69--80.

[23]

Freedom Scientific. n.d. JAWS for Windows.

[24]

John A. Gardner. 2002. Access by blind students and professionals to mainstream math and science. In International Conference on Computers for Handicapped Persons. Springer Berlin Heidelberg, 502--507.

Digital Library

[25]

Georgia Department of Education. 2012. Common Core GPS Mathematics. https://www.georgiastandards.org/Common-Core/Pages/Math.aspx.

[26]

Linda Godzicki, Nicole Godzicki, Mary Krofel, and Rachel Michaels. 2013. Increasing motivation and engagement in elementary and middle school students through technology-supported learning environments. Online Submission.

[27]

GW Micro. n.d. Windows-Eyes. GW Micro.

[28]

Stacy M. Kelly. 2009. Use of assistive technology by students with visual impairments: Findings from a national survey. J. Vis. Impair. Blind. 103, 8 (2009), 470.

[29]

Gregory Kramer, Bruce Walker, Terri Bonebright, Perry Cook, John H. Flowers, Nadine Miner, and John Neuhoff. 2010. Sonification report: Status of the field and research agenda. Faculty Publications, Department of Psychology. Paper 444. http://digitalcommons.unl.edu/psychfacpub/444.

[30]

Rensis Likert. 1932. A technique for the measurement of attitudes. Arch. Psychol. 140 (1932), 1--55.

[31]

MacKichan Software. 2015. Scientific Notebook. MacKichan Software.

[32]

Douglass L. Mansur, Merra M. Blattner, and Kenneth I. Joy. 1985. Sound graphs: A numerical data analysis method for the blind. J. Med. Syst. 9, 3 (1985), 163--174.

[33]

NASA Information Access Lab. 2004. NASA LTP information access lab: MDE graphing calculator demonstration (Beta 2.0).

[34]

National Federation of the Blind. n.d. Fact Sheet: Blindness and Low Vision. National Federation of the Blind.

[35]

Michael A. Nees and Bruce N. Walker. 2009. Auditory interfaces and sonification. In The Universal Access Handbook. New York, NY: Lawrence Erlbaum Associates, 507--521.

[36]

Kirsten Rassmus-Gröhn, Charlotte Magnusson, and Haakan Eftring. 2007. Ahead-audio-haptic drawing editor and explorer for education. In IEEE International Workshop on Haptic, Audio and Visual Environments and Games, 2007 (HAVE’07). IEEE, 62--66.

[37]

Terri Duggan Schwartzbeck and Mary Ann Wolf. 2012. The digital learning imperative: How technology and teaching meet today's education challenges. Alliance for Excellent Education.

[38]

Daniel R. Smith and Bruce N. Walker. 2005. Effects of auditory context cues and training on performance of a point estimation sonification task. Appl. Cogn. Psychol. 19, 8 (December 2005), 1065--1087.

[39]

Daniel R. Smith and Bruce N. Walker. 2002. Tick-marks, axes, and labels: The effects of adding context to auditory graphs. In International Conference on Auditory Display. Kyoto, Japan, 1--6.

[40]

Sun Microsystems Laboratories. 2001. FreeTTS 1.2 - A speech synthesizer written entirely in the JavaTM programming language. Sun Microsystems Laboratories.

[41]

Triumph Learning. 2011. Crosswalk Coach for the Common Core State Standards, Mathematics. Triumph Learning.

[42]

Robert Upson. 2002. Educational sonification exercises: Pathways for mathematics and musical achievement. In International Conference on Auditory Display. Kyoto, Japan, 1--6.

[43]

Robert Upson. 2001. Sonifications as mathematics teaching tools. In Proceedings of the 7th International Conference on Auditory Display (ICAD’01). Citeseer, 222--226.

[44]

U.S. Department of Education. 2004. Building the Legacy: IDEA 2004. U.S. Department of Education.

[45]

Frances Van Scoy, Don McLaughlin, and Angela Fullmer. 2005. Auditory augmentation of haptic graphs: Developing a graphic tool for teaching precalculus skill to blind students. In Proceedings of the 11th International Conference on Auditory Display (ICAD’05).

[46]

Andrew A. Zucker. 2006. Development and testing of math insight software. J. Educ. Technol. Syst. 34, 4 (2006), 371--386.

Cited By

Damsma P(2024)Hearing a circle: An exploratory study of accessible sonification for young children with blindness and low visionBritish Journal of Visual Impairment10.1177/02646196241253534Online publication date: 21-May-2024
https://doi.org/10.1177/02646196241253534
Vargas PTrevisan D(2024)Revisiting visual accessibility with non-textual content: challenges and solutions for human-computer interactionProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702105(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702105
Wang YSrinivasan AKim Y(2024)Enabling Tabular Data Exploration for Blind and Low-Vision UsersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661609(1218-1233)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661609
Show More Cited By

Index Terms

Exploring Auditory Graphing Software in the Classroom: The Effect of Auditory Graphs on the Classroom Environment
1. Human-centered computing
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

An RSS-feed auditory aggregator using earcons
AM '11: Proceedings of the 6th Audio Mostly Conference: A Conference on Interaction with Sound

In this work we present a data sonification framework based on parallel/concurrent sonic earcons' representations for monitoring in real-time information related to stock market. The information under consideration is conveyed through the well-known ...
Learning outside of the classroom: the Northeastern University research co-op fellowship program
WCAE '00: Proceedings of the 2000 workshop on Computer architecture education

Northeastern University has developed an educational philosophy that recognizes that the total educational experience extends well beyond the four walls of the classroom. Cooperative education is a model that educates students both within the academic ...
Auditory weather reports: demonstrating listener comprehension of five concurrent variables
AM '14: Proceedings of the 9th Audio Mostly: A Conference on Interaction With Sound

Displaying multiple variables or data sets within a single sonification has been identified as a challenge for the field of auditory display research. We discuss our recent study that evaluates the usability of a sonification that contains multiple ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Accessible Computing

ACM Transactions on Accessible Computing Volume 9, Issue 1

March 2017

92 pages

ISSN:1936-7228

EISSN:1936-7236

DOI:10.1145/3011862

Editors:
Matt Huenerfauth
Rochester Institute of Technology, USA
,
Kathleen F. McCoy
University of Delaware, USA

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 November 2016

Accepted: 01 September 2016

Revised: 01 August 2016

Received: 01 December 2015

Published in TACCESS Volume 9, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
753
Total Downloads

Downloads (Last 12 months)129
Downloads (Last 6 weeks)19

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Damsma P(2024)Hearing a circle: An exploratory study of accessible sonification for young children with blindness and low visionBritish Journal of Visual Impairment10.1177/02646196241253534Online publication date: 21-May-2024
https://doi.org/10.1177/02646196241253534
Vargas PTrevisan D(2024)Revisiting visual accessibility with non-textual content: challenges and solutions for human-computer interactionProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702105(1-18)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3702038.3702105
Wang YSrinivasan AKim Y(2024)Enabling Tabular Data Exploration for Blind and Low-Vision UsersProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661609(1218-1233)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661609
He SYu L(2024)Charting Beyond Sight with DataStory: Sensory Substitution and Storytelling in Visual Literacy Education for Visually Impaired ChildrenExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650800(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650800
Wimer BSouth LWu KSzafir DBorkin MMetoyer R(2024)Beyond Vision Impairments: Redefining the Scope of Accessible Data RepresentationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335656630:12(7619-7636)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3356566
Guiotto Nai Fovino LZanella ADi Mascolo LGinolfi MCarpita NTrovato Manuncola FGrassi M(2024)Evaluating the effectiveness of sonification in science education using EdukoiPersonal and Ubiquitous Computing10.1007/s00779-024-01809-528:5(693-711)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s00779-024-01809-5
Braun RTfirn MFord R(2024)Listening to life: Sonification for enhancing discovery in biological researchBiotechnology and Bioengineering10.1002/bit.28729121:10(3009-3019)Online publication date: 28-Apr-2024
https://doi.org/10.1002/bit.28729
Joyner SRiegelhuth AGarrity KKim YKim N(2022)Visualization Accessibility in the Wild: Challenges Faced by Visualization DesignersProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517630(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517630
Holloway LGoncu CIlsar AButler MMarriott K(2022)Infosonics: Accessible Infographics for People who are Blind using Sonification and VoiceProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517465(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517465
Das MPiper AGergle D(2022)Design and Evaluation of Accessible Collaborative Writing Techniques for People with Vision ImpairmentsACM Transactions on Computer-Human Interaction10.1145/348016929:2(1-42)Online publication date: 16-Jan-2022
https://dl.acm.org/doi/10.1145/3480169
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents