research-article

Public Access

A Gaze-Contingent Adaptive Virtual Reality Driving Environment for Intervention in Individuals with Autism Spectrum Disorders

Authors:

Zachary Warren, and

Nilanjan SarkarAuthors Info & Claims

ACM Transactions on Interactive Intelligent Systems (TiiS), Volume 6, Issue 1

Article No.: 3, Pages 1 - 23

https://doi.org/10.1145/2892636

Published: 17 March 2016 Publication History

Abstract

In addition to social and behavioral deficits, individuals with Autism Spectrum Disorder (ASD) often struggle to develop the adaptive skills necessary to achieve independence. Driving intervention in individuals with ASD is a growing area of study, but it is still widely under-researched. We present the development and preliminary assessment of a gaze-contingent adaptive virtual reality driving simulator that uses real-time gaze information to adapt the driving environment with the aim of providing a more individualized method of driving intervention. We conducted a small pilot study of 20 adolescents with ASD using our system: 10 with the adaptive gaze-contingent version of the system and 10 in a purely performance-based version. Preliminary results suggest that the novel intervention system may be beneficial in teaching driving skills to individuals with ASD.

References

[1]

Hanadi H. Alqahtani and Naomi A. Schoenfeld. 2014. Teaching cooking skills to young women with mild intellectual disability: The effectiveness of internet websites. Curr. Issues Educ. 17, 2 (2014).

[2]

Christa J. Anderson, John Colombo, and Jill D. Shaddy. 2006. Visual scanning and pupillary responses in young children with autism spectrum disorder. J. Clin. Exp. Neuropsychol. 28, 7 (2006), 1238--1256.

[3]

American Psychiatric Association. 2013. DSM-V Diagnostic and Statistical Manual of Mental Disorders (5th ed.). American Psychiatric Association.

[4]

Michel Bédard, Marie Parkkari, Bruce Weaver, Julie Riendeau, and Mike Dahlquist. 2010. Assessment of driving performance using a simulator protocol: Validity and reproducibility. Am. J. Occupat. Ther. 64, 2 (2010), 336--340.

[5]

Esubalew Bekele, Uttama Lahiri, Julie Davidson, Zachary Warren, and Nilanjan Sarkar. 2011. Development of a novel robot-mediated adaptive response system for joint attention task for children with autism. In Proceedings of the International Symposium on Robot and Human Interactive Communication (RO-MAN), 2011 IEEE. IEEE, Washington, DC, 276--281.

[6]

Esubalew Bekele, Zhi Zheng, Amy Swanson, Julie Crittendon, Zachary Warren, and Nilanjan Sarkar. 2013. Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Trans. Visual. Comput. Graphics 19, 4 (2013), 711--720.

Digital Library

[7]

Scott Bellini, Jessica K. Peters, Lauren Benner, and Andrea Hopf. 2007. A meta-analysis of school-based social skills interventions for children with autism spectrum disorders. Remed. Spec. Educ. 28, 3 (2007), 153--162.

[8]

Dayi Bian, Joshua Wade, Amy Swanson, Zachary Warren, and Nilanjan Sarkar. 2015. Physiology-based affect recognition during driving in virtual environment for autism intervention. In Proceedings of the 2nd International Conference on Physiological Computing Systems (PhyCS-2015). 137--145.

Digital Library

[9]

Dayi Bian, Joshua W. Wade, Lian Zhang, Esubalew Bekele, Amy Swanson, Julie Ana Crittendon, Medha Sarkar, Zachary Warren, and Nilanjan Sarkar. 2013. A novel virtual reality driving environment for autism intervention. Universal Access in Human-Computer Interaction: User and Context Diversity. Springer, Berlin 474--483.

[10]

Matthias Buntins, Jens W. Schicke, Frank Eggert, and Ursula Goltz. 2013. Hybrid Automata as a Modelling Approach in the Behavioural Sciences. Electron. Not. Theor. Comput. Sci. 297 (2013), 47--59.

Digital Library

[11]

Ariane V. S. Buescher, Zuleyha Cidav, Martin Knapp, and David S. Mandell. 2014. Costs of autism spectrum disorders in the United Kingdom and the United States. J. Am. Med. Assoc. Ped. 168, 8 (2014), 721--728.

[12]

John T. Cacioppo, Louis G. Tassinary, and Gary Berntson. 2007. Handbook of Psychophysiology. Cambridge University Press, Cambridge.

[13]

Sherrilene Classen and Miriam Monahan. 2013. Evidence-based review on interventions and determinants of driving performance in teens with attention deficit hyperactivity disorder or autism spectrum disorder. Traffic Injury Prevent. 14, 2 (2013), 188--193.

[14]

Sherrilene Classen, Miriam Monahan, and Stephanie Hernandez. 2013. Indicators of Simulated Driving Skills in Adolescents with Autism Spectrum Disorder. Open J. Occupat. Ther. 1, 4 (2013), 2:1--13.

[15]

J. Constantino and C. Gruber. 2012. Social Responsiveness Scale, Second Edition. Western Psychological Services, Los Angeles, CA.

[16]

Neill B. Cox, Ronald E. Reeve, Stephany M. Cox, and Daniel J. Cox. 2012. Brief Report: Driving and young adults with ASD: Parents’ experiences. J. Autism Dev. Disord 42, 10 (2012), 2257--2262.

[17]

Brian P. Daly, Elizabeth G. Nicholls, Kristina E. Patrick, Danielle D. Brinckman, and Maria T. Schultheis. 2014. Driving behaviors in adults with Autism Spectrum Disorders. J. Autism Dev. Disord. 44, 12 (2014), 3119--3128.

[18]

Jing Fan, Joshua W. Wade, Dayi Bian, Alexandra P. Key, Zachary E. Warren, Lorraine C. Mion, and Nilanjan Sarkar. 2015. A step towards EEG-based Brain computer interface for autism intervention. In Proceedings of the 37th Annual International Conference of the IEEE, Engineering in Medicine and Biology Society (EMBC).

[19]

Luke Fletcher and Alexander Zelinsky. 2009. Driver inattention detection based on eye gaze—road event correlation. The Int. J. Robot. Res. 28, 6 (2009), 774--801.

Digital Library

[20]

Matthew S. Goodwin. 2008. Enhancing and accelerating the pace of autism research and treatment. Focus Autism Dev. Disabil. 23, 2 (2008), 125--128.

[21]

Cristy Ho, Nick Reed, and Charles Spence. 2006. Assessing the effectiveness of “intuitive” vibrotactile warning signals in preventing front-to-rear-end collisions in a driving simulator. Accident Anal. Prevent. 38, 5 (2006), 988--996.

[22]

B. Jensen, B. Keehn, L. Brenner, S. P. Marshall, A. J. Lincoln, and R. A. Müller. 2009. Increased eye-blink rate in autism spectrum disorder may reflect dopaminergic abnormalities. In Proceedings of the International Meeting for Autism Research (IMFAR).

[23]

Amy Klin, David J. Lin, Phillip Gorrindo, Gordon Ramsay, and Warren Jones. 2009. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature 459, 7244 (2009), 257--261.

[24]

Edward A. Lee and Sanjit A. Seshia. 2011. Introduction to Embedded Systems: A Cyber-Physical Systems Approach. Lee & Seshia.

[25]

Catherine Lord, Susan Risi, Linda Lambrecht, Edwin H. Cook Jr., Bennett L. Leventhal, Pamela C. DiLavore, Andrew Pickles, and Michael Rutter. 2000. The autism diagnostic observation schedule—generic: A standard measure of social and communication deficits associated with the spectrum of autism. J. Autism Dev. Disord. 30, 3 (2000), 205--223.

[26]

Keith Rayner. 1998. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 3 (1998), 372--422.

[27]

Bryan Reimer, Ronna Fried, Bruce Mehler, Gagan Joshi, Anela Bolfek, Kathryn M. Godfrey, Nan Zhao, Rachel Goldin, and Joseph Biederman. 2013. Brief report: Examining driving behavior in young adults with high functioning autism spectrum disorders: A pilot study using a driving simulation paradigm. J. Autism Dev. Disord. 43, 9 (2013), 2211--2217.

[28]

Mahdi Rezaei and Reinhard Klette. 2014. Look at the driver, look at the road: No distraction&excl; No accident&excl; In Proceedings of the IEEE Conference Computer Vision and Pattern Recognition (CVPR). IEEE, 129--136.

[29]

Anke Schwarze, Matthias Buntins, Jens Schicke-Uffmann, Ursula Goltz, and Frank Eggert. 2013. Modelling driving behaviour using hybrid automata. IET Intell. Transport Syst. 7, 2 (2013), 251--256.

[30]

Atsushi Senju, Yshikuni Tojo, Kiyoshi Yaguchi, and Toshikazu Hasegawa. 2005. Deviant gaze processing in children with autism: an ERP study. Neuropsychologia 43, 9 (2005), 1297--1306.

[31]

Paul T. Shattuck, Sarah C. Narendorf, Benjamin Cooper, Paul R. Sterzing, Mary Wagner, and Julie L. Taylor. 2012. Postsecondary education and employment among youth with an autism spectrum disorder. Pediatrics 129, 6 (2012), 1042--1049.

[32]

Orit Shechtman, Kezia D. Awadzi, Sherrilene Classen, Desiree N. Lanford, and Yongsung Joo. 2010. Validity and critical driving errors of on-road assessment for older drivers. Am. J. Occupat. Ther. 64, 2 (2010), 242--251.

[33]

Elizabeth Sheppard, Danielle Ropar, Geoffrey Underwood, and Editha van Loon. 2010. Brief report: Driving hazard perception in autism. J. Autism Dev. Disord. 40, 4 (2010), 504--508.

[34]

James W. Tanaka, Julie M. Wolf, Cheryl Klaiman, Kathleen Koenig, Jeffrey Cockburn, Lauren Herlihy, Carla Brown, Sherin Stahl, Martha D. Kaiser, and Robert T. Schultz. 2010. Using computerized games to teach face recognition skills to children with autism spectrum disorder: The Let's Face It&excl; Program. J. Child Psychol. Psychiat. 51, 8 (2010), 944--952.

[35]

Tobii Technology. 2011. Accuracy and Precision Test Method for Remote Eye Trackers (Edition 2.1.1). Tobii.

[36]

Joshua Wade, Dayi Bian, Lian Zhang, Amy Swanson, Medha Sarkar, Zachary Warren, and Nilanjan Sarkar. 2014. Design of a Virtual Reality Driving Environment to Assess Performance of Teenagers with ASD. In Universal Access in Human-Computer Interaction. Universal Access to Information and Knowledge. Springer, Berlin, 466--474.

[37]

Joshua Wade, Dayi Bian, Jing Fan, Lian Zhang, Amy Swanson, Medha Sarkar, Amy Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2015. A virtual reality driving environment for training safe gaze patterns: Application in individuals with ASD. In Universal Access in Human-Computer Interaction: Access to Learning, Health and Well-Being. Springer, Berlin, 689--697.

[38]

Amy S. Weitlauf, Melissa L. McPheeters, Brittany Peters, Nila Sathe, Rebekah Travis, Rachel Aiello, Edwin Williamson, Jeremy Veenstra-VanderWeele, Shanthi Krishnaswami, and Rebecca Jerome. 2014. Therapies for children with autism spectrum disorder. Comp. Effectiv. Rev. 137 (2014).

[39]

Martha Wingate, Russell S. Kirby, Sydney Pettygrove, Chris Cunniff, Eldon Schulz, Tista Ghosh, Cordelia Robinson, Li-Ching Lee, Rebecca Landa, and John Constantino. 2014. Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 sites, United States, 2010. Morbid. Mortal. Wkly. Rep. Surveill. Summ. 63, 2 (2014).

[40]

Lian Zhang, Joshua Wade, Dayi Bian, Jing Fan, Amy Swanson, Amy Weitlauf, Zachary Warren, and Nilanjan Sarkar. 2015. Multimodal fusion for cognitive load measurement in an adaptive virtual reality driving task for autism intervention. In Universal Access in Human-Computer Interaction. Access to Learning, Health and Well-Being. Springer, Berlin, 709--720.

[41]

Zhi Zheng, Shuvajit Das, Eric M. Young, Amy Swanson, Zachary Warren, and Nilanjan Sarkar. 2014. Autonomous robot-mediated imitation learning for children with autism. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2707--2712.

Cited By

Liu LYao XChen JZhang KLiu LWang GLing Y(2024)Virtual Reality Utilized for Safety Skills Training for Autistic Individuals: A ReviewBehavioral Sciences10.3390/bs1402008214:2(82)Online publication date: 23-Jan-2024
https://doi.org/10.3390/bs14020082
Migovich MAdiani DBreen MSwanson AVogus TSarkar N(2024)Stress Detection of Autistic Adults during Simulated Job Interviews Using a Novel Physiological Dataset and Machine LearningACM Transactions on Accessible Computing10.1145/363970917:1(1-25)Online publication date: 8-Jan-2024
https://dl.acm.org/doi/10.1145/3639709
Razzak RLi JHe SSokhadze E(2023)Investigating Sex-Based Neural Differences in Autism and Their Extended Reality Intervention ImplicationsBrain Sciences10.3390/brainsci1311157113:11(1571)Online publication date: 9-Nov-2023
https://doi.org/10.3390/brainsci13111571
Show More Cited By

Index Terms

A Gaze-Contingent Adaptive Virtual Reality Driving Environment for Intervention in Individuals with Autism Spectrum Disorders
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Vocational Rehabilitation of Individuals with Autism Spectrum Disorder with Virtual Reality

In this article, a virtual reality system for vocational rehabilitation of individuals with disabilities (VR4VR) is presented. VR4VR uses immersive virtual environments to assess and train individuals with cognitive and physical disabilities. This ...
Read More
A Humanoid Robot Used as an Assistive Intervention Tool for Children with Autism Spectrum Disorder: A Preliminary Research
BHI 2013: Proceedings of the International Conference on Brain and Health Informatics - Volume 8211

Autism spectrum disorder is a developmental disorder affecting 60 out of 10,000 individuals. Children with autism are often characterized by repetitive behaviors and by deficits in social skills and communicative abilities. They are usually not willing ...
Read More
Treatment of Individuals with Autism Spectrum Disorders Who Display Sexual Offending Behaviours
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Interactive Intelligent Systems

ACM Transactions on Interactive Intelligent Systems Volume 6, Issue 1

Special Issue on New Directions in Eye Gaze for Interactive Intelligent Systems (Part 2 of 2), Regular Articles and Special Issue on Highlights of IUI 2015 (Part 1 of 2)

May 2016

219 pages

ISSN:2160-6455

EISSN:2160-6463

DOI:10.1145/2896319

Editors:
Anthony Jameson
German Research Center for Artifi cial Intelligence (DFKI), Germany
,
Krzysztof Gajos
Harvard University, U.S.A.

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 March 2016

Accepted: 01 January 2016

Revised: 01 January 2016

Received: 01 December 2014

Published in TIIS Volume 6, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
1,858
Total Downloads

Downloads (Last 12 months)204
Downloads (Last 6 weeks)26

Other Metrics

View Author Metrics

Citations

Cited By

Liu LYao XChen JZhang KLiu LWang GLing Y(2024)Virtual Reality Utilized for Safety Skills Training for Autistic Individuals: A ReviewBehavioral Sciences10.3390/bs1402008214:2(82)Online publication date: 23-Jan-2024
https://doi.org/10.3390/bs14020082
Migovich MAdiani DBreen MSwanson AVogus TSarkar N(2024)Stress Detection of Autistic Adults during Simulated Job Interviews Using a Novel Physiological Dataset and Machine LearningACM Transactions on Accessible Computing10.1145/363970917:1(1-25)Online publication date: 8-Jan-2024
https://dl.acm.org/doi/10.1145/3639709
Razzak RLi JHe SSokhadze E(2023)Investigating Sex-Based Neural Differences in Autism and Their Extended Reality Intervention ImplicationsBrain Sciences10.3390/brainsci1311157113:11(1571)Online publication date: 9-Nov-2023
https://doi.org/10.3390/brainsci13111571
Camardella CChiaradia DBortone IFrisoli ALeonardis D(2023)Introducing wearable haptics for rendering velocity feedback in VR serious games for neuro-rehabilitation of childrenFrontiers in Virtual Reality10.3389/frvir.2022.10193023Online publication date: 6-Jan-2023
https://doi.org/10.3389/frvir.2022.1019302
Prakash A(2023)[DC] Investigating student's learning processes in a Virtual Reality learning environment by analyzing their interaction behavior2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00340(995-996)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00340
Prakash AShaikh DRajendran R(2023)Investigating Interaction Behaviors of Learners in VR Learning Environment2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00308(931-932)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00308
Gu PXu XQian XWeng T(2023)Leveraging Extended Reality for Autistic Individuals: A Scoping Review of Technical Features and Technology AffordancesIEEE Transactions on Learning Technologies10.1109/TLT.2022.319743016:1(133-149)Online publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1109/TLT.2022.3197430
(2023)Does the Level of Focus in Serious Games in Immersive VR Correlate with the Quality of Movement? Preliminary Results from an Ongoing Study on Rehabilitation of Children with Cerebral Palsy2023 International Conference on Rehabilitation Robotics (ICORR)10.1109/ICORR58425.2023.10304712(1-6)Online publication date: 24-Sep-2023
https://doi.org/10.1109/ICORR58425.2023.10304712
Lorenzo GNewbutt NLorenzo-Lledó A(2023)Designing virtual reality tools for students with Autism Spectrum Disorder: A systematic reviewEducation and Information Technologies10.1007/s10639-022-11545-z28:8(9557-9605)Online publication date: 12-Jan-2023
https://dl.acm.org/doi/10.1007/s10639-022-11545-z
Tan SRajaram K(2023)Harnessing Immersive Technologies for Innovation in Teaching and LearningsLearning Intelligence: Innovative and Digital Transformative Learning Strategies10.1007/978-981-19-9201-8_7(305-334)Online publication date: 10-Feb-2023
https://doi.org/10.1007/978-981-19-9201-8_7
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents