demonstration

SoundLines: Exploration of Line Segments through Sonification and Multi-touch Interaction

Authors:

Dragan Ahmetovic,

Cristian Bernareggi,

Sergio Mascetti,

Federico PiniAuthors Info & Claims

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 96, Pages 1 - 3

https://doi.org/10.1145/3373625.3418041

Published: 29 October 2020 Publication History

Get Access

Abstract

We demonstrate SoundLines, a mobile app designed to support children with visual impairments in exercising spatial exploration skills. This is achieved through multi-touch discovery of line segments on touchscreen, supported by sonification feedback. The approach is implemented as a game in which the child needs to guide a kitten to find its mother cat by following with a finger the line connecting them.

References

[1]

Dragan Ahmetovic, Cristian Bernareggi, João Guerreiro, Sergio Mascetti, and Anna Capietto. 2019. AudioFunctions.web: Multimodal Exploration of Mathematical Function Graphs. In Web For All Conference. ACM.

Digital Library

Google Scholar

[2]

Robin Brewer, Lisa Anthony, Quincy Brown, Germaine Irwin, Jaye Nias, and Berthel Tate. 2013. Using gamification to motivate children to complete empirical studies in lab environments. In Proceedings of the 12th international conference on interaction design and children. 388–391.

Digital Library

Google Scholar

[3]

Craig Brown and Amy Hurst. 2012. VizTouch: automatically generated tactile visualizations of coordinate spaces. In International Conference on Tangible, Embedded and Embodied Interaction. ACM.

Digital Library

Google Scholar

[4]

Elaine Cohen and Richard F Riesenfeld. 1982. General matrix representations for Bézier and B-spline curves. Computers in Industry 3, 1-2 (1982), 9–15.

Crossref

Google Scholar

[5]

Thomas Dick and Evelyn Kubiak. 1997. Issues and aids for teaching mathematics to the blind. The Mathematics Teacher 90, 5 (1997), 344–349.

Crossref

Google Scholar

[6]

Jon Ferraiolo, Fujisawa Jun, and Dean Jackson. 2000. Scalable vector graphics (SVG) 1.0 specification. iuniverse Bloomington.

Google Scholar

[7]

Andrea Gerino, Nicolò Alabastro, Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2014. Mathmelodies: inclusive design of a didactic game to practice mathematics. In International Conference on Computers Helping People with Special Needs (ICCHP). Springer.

Crossref

Google Scholar

[8]

Andrea Gerino, Lorenzo Picinali, Cristian Bernareggi, and Sergio Mascetti. 2015. Eyes-free exploration of shapes with invisible puzzle. In Conference on Computers & Accessibility. ACM.

Digital Library

Google Scholar

[9]

Gregory Kramer. 2000. Auditory display: sonification, audification and auditory interfaces. Addison-Wesley Longman Publishing Co., Inc.

Google Scholar

[10]

Cheng-Lung Lee, Chih-Yung Chen, Peng-Cheng Sung, and Shih-Yi Lu. 2014. Assessment of a simple obstacle detection device for the visually impaired. Applied ergonomics 45, 4 (2014), 817–824.

Google Scholar

[11]

Linda Pring. 2008. Psychological characteristics of children with visual impairments: learning, memory and imagery. British Journal of Visual Impairment(2008).

Google Scholar

[12]

Derrick W Smith and Sinikka M Smothers. 2012. The role and characteristics of tactile graphics in secondary mathematics and science textbooks in braille. Journal of Visual Impairment & Blindness(2012).

Google Scholar

[13]

Maarten WA Wijntjes, Thijs Van Lienen, Ilse M Verstijnen, and Astrid ML Kappers. 2008. The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception 37, 4 (2008), 602–614.

Crossref

Google Scholar

[14]

Tsubasa Yoshida, Kris M Kitani, Hideki Koike, Serge Belongie, and Kevin Schlei. 2011. EdgeSonic: image feature sonification for the visually impaired. In Proceedings of the 2nd Augmented Human International Conference. 1–4.

Digital Library

Google Scholar

Cited By

View all

Ahmetovic DBernareggi CLeporini BMascetti S(2023)WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment through a Mobile AppACM Transactions on Accessible Computing10.1145/356502916:1(1-19)Online publication date: 29-Mar-2023
https://dl.acm.org/doi/10.1145/3565029
Chundury PPatnaik BReyazuddin YTang CLazar JElmqvist N(2022)Towards Understanding Sensory Substitution for Accessible Visualization: An Interview StudyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311482928:1(1084-1094)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1109/TVCG.2021.3114829
Jung JSon SLee SKim YLee GKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)ThroughHand: 2D Tactile Interaction to Simultaneously Recognize and Touch Multiple ObjectsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445530(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445530

Index Terms

SoundLines: Exploration of Line Segments through Sonification and Multi-touch Interaction
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Multi-touch exploration and sonification of line segments
W4A '21: Proceedings of the 18th International Web for All Conference

We present SoundLines, a mobile app designed to support children with visual impairments in exercising spatial exploration skills. This is achieved through multi-touch discovery of line segments on touchscreen, coupled with sonification feedback. ...
Keep in Touch: Combining Touch Interaction with Thumb-to-Finger µGestures for People with Visual Impairment
ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction

We present a set of 8 thumb-to-finger microgestures (TTF µGestures) that can be used as an additional modality to enrich touch interaction in eyes-free situations. TTF µGestures possess characteristics especially suited for people with visual impairment ...
Multi-touch interaction for tasking robots
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction

The objective is to develop a mobile human-robot interface that is optimized for multi-touch input. Our existing interface was designed for mouse and keyboard input and was later adopted for voice and touch interaction. A new multi-touch interface ...

Comments

Information & Contributors

Information

Published In

ASSETS '20: Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility

October 2020

764 pages

ISBN:9781450371032

DOI:10.1145/3373625

Editors:
Tiago Guerreiro
University of Lisbon, Portugal
,
Hugo Nicolau
INESC-ID, Portugal
,
Karyn Moffatt
McGill University, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2020

Check for updates

Author Tags

Qualifiers

Demonstration
Research
Refereed limited

Conference

ASSETS '20

Sponsor:

SIGACCESS

ASSETS '20: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility

October 26 - 28, 2020

Virtual Event, Greece

Acceptance Rates

ASSETS '20 Paper Acceptance Rate 46 of 167 submissions, 28%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
123
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ahmetovic DBernareggi CLeporini BMascetti S(2023)WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment through a Mobile AppACM Transactions on Accessible Computing10.1145/356502916:1(1-19)Online publication date: 29-Mar-2023
https://dl.acm.org/doi/10.1145/3565029
Chundury PPatnaik BReyazuddin YTang CLazar JElmqvist N(2022)Towards Understanding Sensory Substitution for Accessible Visualization: An Interview StudyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311482928:1(1084-1094)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1109/TVCG.2021.3114829
Jung JSon SLee SKim YLee GKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)ThroughHand: 2D Tactile Interaction to Simultaneously Recognize and Touch Multiple ObjectsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445530(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445530

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Multi-touch exploration and sonification of line segments

Keep in Touch: Combining Touch Interaction with Thumb-to-Finger µGestures for People with Visual Impairment

Multi-touch interaction for tasking robots

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations