SmartFunction: An Immersive Vr System To Assess Attention Using Embodied Cognition
Authors: 
Ashish Jaiswal, Aref Hebri, Hamza Reza Pavel, Mohammad Zaki Zadeh, Fillia MakedonAuthors Info & Claims
Ashish Jaiswal, Aref Hebri, Hamza Reza Pavel, Mohammad Zaki Zadeh, Fillia MakedonAuthors Info & ClaimsPages 485 - 490
Abstract
In traditional neuropsychological tests, executive functions (EFs) are typically evaluated using paper and pencil or computer-based sit-down tasks. However, a new assessment framework, the Automated Test of Embodied Cognition (ATEC), has been developed to measure EFs and embodied cognition through physical tasks. This paper proposes integrating the ATEC system with virtual reality (VR) to evaluate and diagnose attention-deficit disorders using embodied cognition (EC) principles. The VR system will utilize Meta Quest 2 VR headsets and controllers with motion sensors to accurately capture users’ physical movements. The collected motion data will be transmitted to a remote server for evaluation through machine learning algorithms. By incorporating VR technology, the proposed solution provides an effective and affordable tool for assessing executive functions and attention-deficit disorders in real-life scenarios. The paper also presents the proposed solution’s system architecture, which involves using a virtual avatar and visual and auditory cues to guide users during physical tasks.
References
[1]
Morris D Bell, Andrea J Weinstein, Brian Pittman, Richard M Gorman, and Maher Abujelala. 2021. The Activate Test of Embodied Cognition (ATEC): Reliability, concurrent validity and discriminant validity in a community sample of children using cognitively demanding physical tasks related to executive functioning. Child Neuropsychology 27, 7 (2021), 973–983.
[2]
Zhengsi Chang, Brandon Pires, and Daniel Krawczyk. 2020. Functional performance in a virtual reality task with differential executive functional loads. Computers in Human Behavior Reports 2 (2020), 100035.
[3]
Naomi Chaytor, Maureen Schmitter-Edgecombe, and Robert Burr. 2006. Improving the ecological validity of executive functioning assessment. Archives of clinical neuropsychology 21, 3 (2006), 217–227.
[4]
C Keith Conners, Jeffery N Epstein, Adrian Angold, and John Klaric. 2003. Continuous performance test performance in a normative epidemiological sample. Journal of abnormal child psychology 31 (2003), 555–562.
[5]
Alex Dillhoff, Konstantinos Tsiakas, Ashwin Ramesh Babu, Mohammad Zakizadehghariehali, Benjamin Buchanan, Morris Bell, Vassilis Athitsos, and Fillia Makedon. 2019. An automated assessment system for embodied cognition in children: from motion data to executive functioning. In Proceedings of the 6th international Workshop on Sensor-based Activity Recognition and Interaction. 1–6.
[6]
Sanika Doolani, Callen Wessels, Varun Kanal, Christos Sevastopoulos, Ashish Jaiswal, Harish Nambiappan, and Fillia Makedon. 2020. A review of extended reality (xr) technologies for manufacturing training. Technologies 8, 4 (2020), 77.
[7]
Heba Essam Abou El Wafa, Soha Abd El Latif Ghobashy, and Aya Maged Hamza. 2020. A comparative study of executive functions among children with attention deficit and hyperactivity disorder and those with learning disabilities. Middle East Current Psychiatry 27, 1 (2020), 1–9.
[8]
Barbara A Eriksen and Charles W Eriksen. 1974. Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & psychophysics 16, 1 (1974), 143–149.
[9]
Charles W Eriksen and Derek W Schultz. 1979. Information processing in visual search: A continuous flow conception and experimental results. Perception & psychophysics 25, 4 (1979), 249–263.
[10]
Farnaz Farahanipad, Harish Ram Nambiappan, Ashish Jaiswal, Maria Kyrarini, and Fillia Makedon. 2020. HAND-REHA: dynamic hand gesture recognition for game-based wrist rehabilitation. In Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 1–9.
[11]
Kathryn E Greenwood, Robin Morris, Vanessa Smith, Anna-Marie Jones, Douglas Pearman, and Til Wykes. 2016. Virtual shopping: A viable alternative to direct assessment of real life function?Schizophrenia research 172, 1-3 (2016), 206–210.
[12]
Ashish Jaiswal, Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Debapriya Banerjee, and Fillia Makedon. 2020. A survey on contrastive self-supervised learning. Technologies 9, 1 (2020), 2.
[13]
Ashok S Jansari, Daniel Froggatt, Trudi Edginton, and Lynne Dawkins. 2013. Investigating the impact of nicotine on executive functions using a novel virtual reality assessment. Addiction 108, 5 (2013), 977–984.
[14]
Rithik Kapoor, Ashish Jaiswal, and Fillia Makedon. 2022. Light-Weight Seated Posture Guidance System with Machine Learning and Computer Vision. In Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments. 595–600.
[15]
Megan M McClelland, Claire E Cameron, Robert Duncan, Ryan P Bowles, Alan C Acock, Alicia Miao, and Megan E Pratt. 2014. Predictors of early growth in academic achievement: The head-toes-knees-shoulders task. Frontiers in psychology 5 (2014), 599.
[16]
Sayaka Okahashi, Keiko Seki, Akinori Nagano, Zhiwei Luo, Maki Kojima, and Toshiko Futaki. 2013. A virtual shopping test for realistic assessment of cognitive function. Journal of neuroengineering and rehabilitation 10, 1 (2013), 1–13.
[17]
Hamza Reza Pavel, Enamul Karim, Mohammad Zaki Zadeh, Ashish Jaiswal, Rithik Kapoor, and Fillia Makedon. 2022. Automated System to Measure Static Balancing in Children to Assess Executive Function. In Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments. 569–575.
[18]
Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Ashish Jaiswal, Alexis Lueckenhoff, Maria Kyrarini, and Fillia Makedon. 2020. A multi-modal system to assess cognition in children from their physical movements. In Proceedings of the 2020 International Conference on Multimodal Interaction. 6–14.
[19]
Belinda Renison, Jennie Ponsford, Renee Testa, Barry Richardson, and Kylie Brownfield. 2012. The ecological and construct validity of a newly developed measure of executive function: the virtual library task. Journal of the International Neuropsychological Society 18, 3 (2012), 440–450.
[20]
Albert A Rizzo and J Galen Buckwalter. 1997. Virtual reality and cognitive assessment and rehabilitation: the state of the art. Virtual reality in neuro-psycho-physiology (1997), 123–145.
[21]
Francisco Rocabado and Jon Andoni Duñabeitia. 2022. Assessing Inhibitory Control in the Real World Is Virtually Possible: A Virtual Reality Demonstration. Behavioral Sciences 12, 11 (2022), 444.
[22]
Saif Sayed and Vassilis Athitsos. 2021. Cross Your Body: a Cognitive Assessment System for Children. In Advances in Visual Computing: 16th International Symposium, ISVC 2021, Virtual Event, October 4-6, 2021, Proceedings, Part II. Springer, 97–109.
[23]
Jakob Siemerkus, Eva Irle, Carsten Schmidt-Samoa, Peter Dechent, and Godehard Weniger. 2012. Egocentric spatial learning in schizophrenia investigated with functional magnetic resonance imaging. NeuroImage: Clinical 1, 1 (2012), 153–163.
[24]
John F Stins, G Caroline M Van Baal, Tinca JC Polderman, Frank C Verhulst, and Dorret I Boomsma. 2004. Heritability of Stroop and flanker performance in 12-year old children. BMC neuroscience 5 (2004), 1–8.
[25]
J Ridley Stroop. 1935. Studies of interference in serial verbal reactions.Journal of experimental psychology 18, 6 (1935), 643.
[26]
Kirk Stucky, Michael Kirkwood, Jacobus Donders, and Christine Liff. 2020. Clinical neuropsychology study guide and board review. Oxford University Press.
[27]
James M Swanson. 2003. Role of executive function in ADHD. Journal of Clinical Psychiatry 64 (2003), 35–39.
[28]
Rua M Williams, Kiana Alikhademi, and Juan E Gilbert. 2022. Design of a toolkit for real-time executive function assessment in custom-made virtual experiences and interventions. International Journal of Human-Computer Studies 158 (2022), 102734.
[29]
Mohammad Zaki Zadeh, Ashwin Ramesh Babu, Ashish Jaiswal, Maria Kyrarini, and Fillia Makedon. 2021. Self-supervised human activity recognition by augmenting generative adversarial networks. In The 14th PErvasive Technologies Related to Assistive Environments Conference. 171–176.
[30]
Mohammad Zaki Zadeh, Ashwin Ramesh Babu, Ashish Jaiswal, Maria Kyrarini, Morris Bell, and Fillia Makedon. 2021. Automated system to measure Tandem Gait to assess executive functions in children. In The 14th PErvasive Technologies Related to Assistive Environments Conference. 167–170.
[31]
Mohammad Zaki Zadeh, Ashwin Ramesh Babu, Ashish Jaiswal, and Fillia Makedon. 2022. Self-Supervised Human Activity Representation for Embodied Cognition Assessment. Technologies 10, 1 (2022), 33.
Index Terms
- SmartFunction: An Immersive Vr System To Assess Attention Using Embodied Cognition
Recommendations
Measurement of exceptional motion in VR video contents for VR sickness assessment using deep convolutional autoencoder
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and TechnologyThis paper proposes a new objective metric of exceptional motion in VR video contents for VR sickness assessment. In VR environment, VR sickness can be caused by several factors which are mismatched motion, field of view, motion parallax, viewing angle, ...
Three Perspectives on Embodied Learning in Virtual Reality: Opportunities for Interaction Design
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing SystemsWith the fast evolution of Virtual Reality (vr) technology, new prospects opened for embodied learning. Learners can now manipulate digital representations of abstract concepts and make sense of them through sensorimotor stimulation. However, in ...
VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyHaptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...
Comments
Information & Contributors
Information
Published In
July 2023
797 pages
ISBN:9798400700699
DOI:10.1145/3594806
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 10 August 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
PETRA '23
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 394Total Downloads
- Downloads (Last 12 months)286
- Downloads (Last 6 weeks)39
Reflects downloads up to 02 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in