Interactive Design with Autistic Children using LLM and IoT for Personalized Training: The Good, The Bad and The Challenging
Pages 1000 - 1003
Abstract
The advent of generative artificial intelligence technologies, such as Large Language Models (LLMs) and Large Vision Models (LVMs), has shown promising results in both academic and industrial sectors, leading to widespread adoption. However, there has been limited focus on applying these technologies to assist children with special needs like Autism Spectrum Disorder (ASD). Meanwhile, conventional personalized training with interactive design for children with special needs continues to face significant challenges with traditional approaches. This workshop aims to provide a platform for researchers, software developers, medical practitioners, and designers to discuss and evaluate the benefits and drawbacks of using LLMs and the Internet of Things (IoT) for the diagnosis and personalized training of autistic children. Through a series of activities, including oral presentations, demonstrations, and panel discussions, this half-day workshop seeks to foster a network of experts dedicated to improving the lives of children with special needs and to inspire further research on leveraging emerging ubiquitous technologies for these underprivileged users, their caregivers and special education teachers.
References
[1]
Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, Wei Ye, Yue Zhang, Yi Chang, Philip S. Yu, Qiang Yang, and Xing Xie. 2024. A Survey on Evaluation of Large Language Models. ACM Transactions on Intelligent Systems and Technology (Jan. 2024), 1--45. https://doi.org/10.1145/3641289
[2]
Yujin Cho, Mingeon Kim, Seojin Kim, Oyun Kwon, Ryan Donghan Kwon, Yoonha Lee, and Dohyun Lim. 2023. Evaluating the Efficacy of Interactive Language Therapy Based on LLM for High-Functioning Autistic Adolescent Psychological Counseling. arXiv preprint arXiv:2311.09243 (2023).
[3]
Yogesh K Dwivedi, Nir Kshetri, Laurie Hughes, Emma Louise Slade, Anand Je- yaraj, Arpan Kumar Kar, Abdullah M Baabdullah, Alex Koohang, Vishnupriya Raghavan, Manju Ahuja, et al. 2023. 'So what if ChatGPT wrote it?? Multidisci- plinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management 71 (2023), 102642.
[4]
Christopher Frauenberger, Judith Good, and Alyssa Alcorn. 2012. Challenges, opportunities and future perspectives in including children with disabilities in the design of interactive technology. In Proceedings of the 11th International Conference on Interaction Design and Children. 367--370.
[5]
Xin Gao and Syazwani Drani. 2024. Parent-implemented interventions in Chinese families of children with autism spectrum disorder. Humanities and Social Sciences Communications 11, 1 (2024), 1--8.
[6]
Yuqian Hu, Feng Zhang, Chenshu Wu, Beibei Wang, and KJ Ray Liu. 2020. A WiFi-based passive fall detection system. In ICASSP 2020--2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1723--1727.
[7]
Gierad Laput, Karan Ahuja, Mayank Goel, and Chris Harrison. 2018. Ubicoustics: Plug-and-play acoustic activity recognition. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 213--224.
[8]
Prasenjit Mukherjee, RS Gokul, Sourav Sadhukhan, Manish Godse, and Baisakhi Chakraborty. 2023. Detection of Autism Spectrum Disorder (ASD) from Natu- ral Language Text using BERT and ChatGPT Models. International Journal of Advanced Computer Science and Applications 14, 10 (2023).
[9]
Mingyue Tang, Guimin Dong, Jamie Zoellner, Brendan Bowman, Emaad Abel- Rahman, and Mehdi Boukhechba. 2022. Using ubiquitous mobile sensing and temporal sensor-relation graph neural network to predict fluid intake of end stage kidney patients. In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 298--309.
[10]
Tiffany Y Tang and D Flatla. 2016. Autism awareness and technology-based intervention research in China: the good, the bad, and the challenging. In Pro- ceedings of Workshop on Autism and Technology-Beyond Assistance & Intervention, in Conjunction with the CHI.
[11]
Tiffany Y Tang, Relic Yongfu Wang, Yuhui You, Leila Zeqian Huang, and Chris- tine Piao Chen. 2015. Supporting collaborative play via an affordable touching singing plant for children with autism in China. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers. 373--376.
[12]
Tiffany Y Tang and Pinata Winoto. 2018. An interactive picture exchange com- munication system (PECS) embedded with augmented aids enabled by IoT and sensing technologies for chinese individuals with autism. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 299--302.
[13]
Tiffany Y Tang, Jiasheng Xu, and Pinata Winoto. 2019. Automatic object recogni- tion in a light-weight augmented reality-based vocabulary learning application for children with autism. In Proceedings of the 2019 3rd international conference on innovation in artificial intelligence. 65--68.
[14]
Ke Wang, Chongying Wang, Dehua Guo, Marlies van Wijngaarden, and Sander Begeer. 2018. Children with autism spectrum disorder from China and the Netherlands: Age of diagnosis, gender and comorbidities. Research in autism spectrum disorders 54 (2018), 76--82.
[15]
Yingxiao Wu, Haocheng Ni, Changlin Mao, Jianping Han, and Wenyao Xu. 2023. Non-intrusive Human Vital Sign Detection Using mmWave Sensing Technologies: A Review. ACM Transactions on Sensor Networks 20, 1 (2023), 1--36.
[16]
Jinan Zeidan, Eric Fombonne, Julie Scorah, Alaa Ibrahim, Maureen S Durkin, Shekhar Saxena, Afiqah Yusuf, Andy Shih, and Mayada Elsabbagh. 2022. Global prevalence of autism: A systematic review update. Autism research 15, 5 (2022), 778--790.
[17]
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, and Zican Dong. 2023. A survey of large language models. arXiv preprint arXiv:2303.18223 (2023). https://arxiv.org/ abs/2303.18223
Index Terms
- Interactive Design with Autistic Children using LLM and IoT for Personalized Training: The Good, The Bad and The Challenging
Recommendations
Position Paper: A Personalized Large Language Model (LLM)-Based Chat Companion for Autistic Children Early Intervention
UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous ComputingAutism Spectrum Disorder (ASD) is a lifelong neurodevelopmental disorder characterized by restricted and repetitive sensory-motor behaviors and social communication deficits. Though in the recent decade, a rising interest has been demonstrated among the ...
Position Paper: An Emoji-Based Interactive App to Aid Emotion Expression for Autistic Children
UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous ComputingAutism spectrum disorder (ASD) is a neurodevelopmental condition typically characterized by two core characteristics as restricted, repetitive behaviors and impairment in social communication. As such, a large portion of the technology studies within the ...
Facilitating Pretend Play in Autistic Children: Results from an Augmented Reality App Evaluation
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and AccessibilityAutistic children find pretend play difficult. Previous work suggests Augmented Reality (AR) has potential in eliciting pretend play in children with autism. This paper presents the evaluation of an Augmented Reality app to help autistic children engage ...
Comments
Information & Contributors
Information
Published In
October 2024
1032 pages
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 October 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
UbiComp '24: The 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing
October 5 - 9, 2024
Melbourne VIC, Australia
Acceptance Rates
Overall Acceptance Rate 764 of 2,912 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 162Total Downloads
- Downloads (Last 12 months)162
- Downloads (Last 6 weeks)46
Reflects downloads up to 06 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in