AI-Driven Support for People with Speech & Language Difficulties
Authors: 
Aayushi Dangol, Yun Huang, 
Srirangaraj Setlur, Adele Smolansky, Hariharan Subramonyam, Hyewon Suh, Jinjun Xiong, 
Julie A. KientzAuthors Info & Claims
Aayushi Dangol, Yun Huang, Srirangaraj Setlur, Adele Smolansky, Hariharan Subramonyam, Hyewon Suh, Jinjun Xiong, Julie A. KientzAuthors Info & ClaimsArticle No.: 573, Pages 1 - 4
Abstract
Speech and language difficulties present significant challenges to effective communication, impacting individuals’ ability to express themselves and engage in meaningful interactions. Recent advances in AI technologies, particularly in natural language processing (NLP) and machine learning, have the potential to assist individuals with speech and language difficulties in improving their communication outcomes. However, given the probabilistic nature of AI models, there is a need to adopt and advance human-centered AI design methodologies to support the prototyping of AI user experiences. This Special Interest Group (SIG) aims to bring together researchers, practitioners, and designers from the fields of AI, accessibility, speech pathology, AI ethics, and HCI to facilitate high-level discussions around designing and evaluating reliable, safe, and human-centered AI-driven support and interventions for supporting individuals with speech and language difficulties.
References
[1]
American Speech-Language-Hearing Association. 2022. Speech-Language Pathologists. https://www.asha.org/students/speech-language-pathologists/
[2]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N Bennett, Kori Inkpen, 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 chi conference on human factors in computing systems. 1–13.
[3]
Emily M Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big?. In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. 610–623.
[4]
Dorothy VM Bishop. 2014. Ten questions about terminology for children with unexplained language problems. International journal of language & communication disorders 49, 4 (2014), 381–415.
[5]
Humphrey Curtis, Zihao You, William Deary, Miruna-Ioana Tudoreanu, and Timothy Neate. 2023. Envisioning the (In) Visibility of Discreet and Wearable AAC Devices. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–19.
[6]
Jiamin Dai, Karyn Moffatt, Jinglan Lin, and Khai Truong. 2022. Designing for Relational Maintenance: New Directions for AAC Research. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–15.
[7]
Giuseppe Desolda, Rosa Lanzilotti, Antonio Piccinno, and Veronica Rossano. 2021. A system to support children in speech therapies at home. In CHItaly 2021: 14th Biannual Conference of the Italian SIGCHI Chapter. 1–5.
[8]
Joseph R Duffy. 2016. Motor speech disorders: where will we be in 10 years?. In Seminars in speech and language, Vol. 37. Thieme Medical Publishers, 219–224.
[9]
Jared Duval, Zachary Rubin, Elena Márquez Segura, Natalie Friedman, Milla Zlatanov, Louise Yang, and Sri Kurniawan. 2018. SpokeIt: building a mobile speech therapy experience. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–12.
[10]
Mauricio Fontana de Vargas, Jiamin Dai, and Karyn Moffatt. 2022. AAC with Automated Vocabulary from Photographs: Insights from School and Speech-Language Therapy Settings. In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility. 1–18.
[11]
Matthew K Hong, Adam Fourney, Derek DeBellis, and Saleema Amershi. 2021. Planning for natural language failures with the ai playbook. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–11.
[12]
Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 159–166.
[13]
Angeliki Kerasidou. 2020. Artificial intelligence and the ongoing need for empathy, compassion and trust in healthcare. Bulletin of the World Health Organization 98, 4 (2020), 245.
[14]
Allison Koenecke, Andrew Nam, Emily Lake, Joe Nudell, Minnie Quartey, Zion Mengesha, Connor Toups, John R Rickford, Dan Jurafsky, and Sharad Goel. 2020. Racial disparities in automated speech recognition. Proceedings of the National Academy of Sciences 117, 14 (2020), 7684–7689.
[15]
Bridget Murray Law. 2020. AI: A New Window Into Communication Disorders?Leader Live (2020).
[16]
Barbara G MacLachlan and Robin S Chapman. 1988. Communication breakdowns in normal and language learning-disabled children’s conversation and narration. Journal of speech and Hearing disorders 53, 1 (1988), 2–7.
[17]
Jane McCormack, Sharynne McLeod, Lindy McAllister, and Linda J Harrison. 2010. My speech problem, your listening problem, and my frustration: The experience of living with childhood speech impairment. (2010).
[18]
Ray M Merrill, Nelson Roy, and Jessica Lowe. 2013. Voice-related symptoms and their effects on quality of life. Annals of Otology, Rhinology & Laryngology 122, 6 (2013), 404–411.
[19]
Paul L Morgan, George Farkas, Marianne M Hillemeier, Richard Mattison, Steve Maczuga, Hui Li, and Michael Cook. 2015. Minorities are disproportionately underrepresented in special education: Longitudinal evidence across five disability conditions. Educational Researcher 44, 5 (2015), 278–292.
[20]
Megan A Morris, Sarah K Meier, Joan M Griffin, Megan E Branda, and Sean M Phelan. 2016. Prevalence and etiologies of adult communication disabilities in the United States: Results from the 2012 National Health Interview Survey. Disability and health journal 9, 1 (2016), 140–144.
[21]
U.S. News. 2022. New Federal Data Shows Pandemic’s Effects on Teaching Profession. https://www.usnews.com/news/education-news/articles/2022-03-02/new-federal-data-shows-pandemics-effects-on-teaching-profession Accessed: 2022-04-08.
[22]
Mmachi God’sglory Obiorah, Anne Marie Marie Piper, and Michael Horn. 2021. Designing AACs for people with aphasia dining in restaurants. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–14.
[23]
Emily A Ondondo. 2015. Acquired language disorders as barriers to effective communication. (2015).
[24]
Rhea Paul. 1996. Clinical implications of the natural history of slow expressive language development. American Journal of Speech-Language Pathology 5, 2 (1996), 5–21.
[25]
Pavithra Ramamurthy and Tingyu Li. 2018. Buddy: a speech therapy robot companion for children with cleft lip and palate (cl/p) disorder. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. 359–360.
[26]
Gregory C Robinson and Pamela C Norton. 2019. A decade of disproportionality: A state-level analysis of African American students enrolled in the primary disability category of speech or language impairment. Language, Speech, and Hearing Services in Schools 50, 2 (2019), 267–282.
[27]
V Robles-Bykbaev, M Guamán-Heredia, Y Robles-Bykbaev, J Lojano-Redrován, F Pesántez-Avilés, D Quisi-Peralta, M López-Nores, and J Pazos-Arias. 2017. Onto-speltra: A robotic assistant based on ontologies and agglomerative clustering to support speech-language therapy for children with disabilities. In Advances in Computing: 12th Colombian Conference, CCC 2017, Cali, Colombia, September 19-22, 2017, Proceedings 12. Springer, 343–357.
[28]
Ahmed Farag Seddik, Mohamed El Adawy, and Ahmed Ismail Shahin. 2013. A computer-aided speech disorders correction system for Arabic language. In 2013 2nd International Conference on Advances in Biomedical Engineering. IEEE, 18–21.
[29]
Doreen Spilton and Lee C Lee. 1977. Some determinants of effective communication in four-year-olds. Child Development (1977), 968–977.
[30]
Jonathan M Sykes and Travis T Tollefson. 2005. Management of the cleft lip deformity. Facial Plastic Surgery Clinics 13, 1 (2005), 157–167.
[31]
Stephanie Valencia, Richard Cave, Krystal Kallarackal, Katie Seaver, Michael Terry, and Shaun K Kane. 2023. “The less I type, the better”: How AI Language Models can Enhance or Impede Communication for AAC Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–14.
[32]
Laura Wagner, Cynthia G Clopper, and John K Pate. 2014. Children’s perception of dialect variation. Journal of child language 41, 5 (2014), 1062–1084.
[33]
Julie A Washington, Lee Branum-Martin, Congying Sun, and Ryan Lee-James. 2018. The impact of dialect density on the growth of language and reading in African American children. Language, speech, and hearing services in schools 49, 2 (2018), 232–247.
[34]
Robert Wolfe and Aylin Caliskan. 2022. Detecting Emerging Associations and Behaviors With Regional and Diachronic Word Embeddings. In 2022 IEEE 16th International Conference on Semantic Computing (ICSC). IEEE, 91–98.
[35]
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 chi conference on human factors in computing systems. 1–13.
[36]
Jason C Yip, Kiley Sobel, Xin Gao, Allison Marie Hishikawa, Alexis Lim, Laura Meng, Romaine Flor Ofiana, Justin Park, and Alexis Hiniker. 2019. Laughing is scary, but farting is cute: A conceptual model of children’s perspectives of creepy technologies. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–15.
Index Terms
- AI-Driven Support for People with Speech & Language Difficulties
Recommendations
Opportunities and Challenges for AI-Based Support for Speech-Language Pathologists
CHIWORK '24: Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for WorkSpeech-Language Pathologists (SLPs) are professionals who work with children and adults in the prevention, assessment, diagnosis, and intervention for speech, language, and communication difficulties. This research investigates the experiences and ...
Speech recognition for Kazakh language: a research paper
AbstractIn recent years, the research pertaining to speech recognition technology in the Kazakh language has gained significant importance. This is due to the increasing demand for natural language processing applications in the region where Kazakh is ...
Designing speech and language interactions
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsSpeech and natural language remain our most natural forms of interaction; yet the HCI community have been very timid about focusing their attention on designing and developing spoken language interaction techniques. While significant efforts are spent ...
Comments
Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Funding Sources
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 244Total Downloads
- Downloads (Last 12 months)244
- Downloads (Last 6 weeks)34
Reflects downloads up to 01 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format