Cited By
View all- Rubab SZaman MRashid UYu LWu Y(2024)Audio-visual training and feedback to learn touch-based gesturesJournal of Visualization10.1007/s12650-024-01012-xOnline publication date: 17-Jun-2024
Multi-touch exploration and sonification of line segments
Article No.: 3, Pages 1 - 5
Abstract
We present SoundLines, a mobile app designed to support children with visual impairments in exercising spatial exploration skills. This is achieved through multi-touch discovery of line segments on touchscreen, coupled with sonification feedback. SoundLines is implemented as a game in which a kitten is guided to find its mother cat by tracing the line connecting them on touchscreen.
User study with 4 visually impaired adults assessed the app accessibility and the feasibility of multi-touch exploration, compared to single-touch. While there were limited differences between single-and multi-touch modalities, results indicate that proprioceptive sensing is predominant in multi-touch exploration and that audio feedback provides benefits mostly in single-touch exploration.
References
[1]
Dragan Ahmetovic, Cristian Bernareggi, Mattia Ducci, Andrea Gerino, and Sergio Mascetti. 2021. Remote Usage Data Collection and Analysis for Mobile Accessibility Applications. In International Conference on Pervasive Computing and Communications (PerCom) - Mobile and Pervasive Assistive Technologies Workshop (MPAT). IEEE.
[2]
Dragan Ahmetovic, Cristian Bernareggi, João Guerreiro, Sergio Mascetti, and Anna Capietto. 2019. AudioFunctions.web: Multimodal Exploration of Mathematical Function Graphs. In Web For All Conference. ACM.
[3]
Dragan Ahmetovic, Nahyun Kwon, Uran Oh, Cristian Bernareggi, and Sergio Mascetti. 2021. Touch Screen Exploration of Visual Artwork for Blind People. In The Web Conference (WWW). ACM.
[4]
Robin Brewer, Lisa Anthony, Quincy Brown, Germaine Irwin, Jaye Nias, and Berthel Tate. 2013. Using gamification to motivate children to complete empirical studies in lab environments. In Proceedings of the 12th international conference on interaction design and children. 388--391.
[5]
Craig Brown and Amy Hurst. 2012. VizTouch: automatically generated tactile visualizations of coordinate spaces. In International Conference on Tangible, Embedded and Embodied Interaction. ACM.
[6]
Steven M Casey. 1978. Cognitive mapping by the blind. Journal of Visual Impairment & Blindness (1978).
[7]
Thomas Dick and Evelyn Kubiak. 1997. Issues and aids for teaching mathematics to the blind. The Mathematics Teacher 90, 5 (1997), 344--349.
[8]
John A. Gardner and Vladimir Bulatov. 2006. Scientific Diagrams Made Easy with IVEOTM. In Int. Conf. on Computers Helping People with Special Needs. Springer.
[9]
Andrea Gerino, Nicolò Alabastro, Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2014. Mathmelodies: inclusive design of a didactic game to practice mathematics. In International Conference on Computers Helping People with Special Needs (ICCHP). Springer.
[10]
João Guerreiro, André Rodrigues, Kyle Montague, Tiago Guerreiro, Hugo Nicolau, and Daniel Gonçalves. 2015. Tablets get physical: non-visual text entry on tablet devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 39--42.
[11]
Robert M Kitchin, Mark Blades, and Reginald G Golledge. 1997. Understanding spatial concepts at the geographic scale without the use of vision. Progress in Human Geography (1997).
[12]
Gregory Kramer. 2000. Auditory display: sonification, audification and auditory interfaces. Addison-Wesley Longman Publishing Co., Inc.
[13]
Cheng-Lung Lee, Chih-Yung Chen, Peng-Cheng Sung, and Shih-Yi Lu. 2014. Assessment of a simple obstacle detection device for the visually impaired. Applied ergonomics 45, 4 (2014), 817--824.
[14]
Susanna Millar. 1994. Understanding and representing space: Theory and evidence from studies with blind and sighted children. Clarendon Press/Oxford University Press.
[15]
World Health Organization. 2018. International classification of diseases for mortality and morbidity statistics (11th Revision). https://icd.who.int/
[16]
Linda Pring. 2008. Psychological characteristics of children with visual impairments: learning, memory and imagery. British Journal of Visual Impairment (2008).
[17]
Isao Sakamaki, Kim Adams, Maria Fernanda Gomez Medina, Javier Leonardo Castellanos Cruz, Nooshin Jafari, Mahdi Tavakoli, and Heidi Janz. 2018. Preliminary testing by adults of a haptics-assisted robot platform designed for children with physical impairments to access play. Assistive Technology (2018).
[18]
Andrew Sears and Vicki Hanson. 2011. Representing users in accessibility research. In Proceedings of the SIGCHI conference on Human factors in computing systems. 2235--2238.
[19]
Michael R Sheldon, Michael J Fillyaw, and W Douglas Thompson. 1996. The use and interpretation of the Friedman test in the analysis of ordinal-scale data in repeated measures designs. Physiotherapy Research International 1, 4 (1996), 221--228.
[20]
Derrick W Smith and Sinikka M Smothers. 2012. The role and characteristics of tactile graphics in secondary mathematics and science textbooks in braille. Journal of Visual Impairment & Blindness (2012).
[21]
Denise Ann Sumikawa. 1985. Guidelines for the integration of audio cues into computer user interfaces. Technical Report. Lawrence Livermore National Lab., CA (USA).
[22]
Maarten WA Wijntjes, Thijs Van Lienen, Ilse M Verstijnen, and Astrid ML Kappers. 2008. The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception 37, 4 (2008), 602--614.
[23]
Tsubasa Yoshida, Kris M Kitani, Hideki Koike, Serge Belongie, and Kevin Schlei. 2011. EdgeSonic: image feature sonification for the visually impaired. In Proceedings of the 2nd Augmented Human International Conference. 1--4.
Index Terms
- Multi-touch exploration and sonification of line segments
Recommendations
SoundLines: Exploration of Line Segments through Sonification and Multi-touch Interaction
ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and AccessibilityWe demonstrate SoundLines, a mobile app designed to support children with visual impairments in exercising spatial exploration skills. This is achieved through multi-touch discovery of line segments on touchscreen, supported by sonification feedback. ...
Keep in Touch: Combining Touch Interaction with Thumb-to-Finger µGestures for People with Visual Impairment
ICMI '22: Proceedings of the 2022 International Conference on Multimodal InteractionWe present a set of 8 thumb-to-finger microgestures (TTF µGestures) that can be used as an additional modality to enrich touch interaction in eyes-free situations. TTF µGestures possess characteristics especially suited for people with visual impairment ...
Multi-touch interaction for tasking robots
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interactionThe objective is to develop a mobile human-robot interface that is optimized for multi-touch input. Our existing interface was designed for mouse and keyboard input and was later adopted for voice and touch interaction. A new multi-touch interface ...
Comments
Information & Contributors
Information
Published In
April 2021
224 pages
ISBN:9781450382120
DOI:10.1145/3430263
- General Chairs:
- Silvia Rodriguez Vazquez,
- Ted Drake,
- Program Chairs:
- Dragan Ahmetovic,
- Victoria Yaneva
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 May 2021
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
W4A '21
Acceptance Rates
Overall Acceptance Rate 171 of 371 submissions, 46%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 53Total Downloads
- Downloads (Last 12 months)8
- Downloads (Last 6 weeks)1
Reflects downloads up to 09 Aug 2024
Other Metrics
Citations
Cited By
View all- Rubab SZaman MRashid UYu LWu Y(2024)Audio-visual training and feedback to learn touch-based gesturesJournal of Visualization10.1007/s12650-024-01012-xOnline publication date: 17-Jun-2024
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in