Administrating Cognitive Tests Through HRI: An Application of an Automatic Scoring System Through Visual Analysis
Authors: 
Sara Sangiovanni, Matteo Spezialetti, Fabio Aurelio D’Asaro, Gianpaolo Maggi, Silvia RossiAuthors Info & Claims
Sara Sangiovanni, Matteo Spezialetti, Fabio Aurelio D’Asaro, Gianpaolo Maggi, Silvia RossiAuthors Info & ClaimsPages 369 - 380
Abstract
In this paper, we propose the use of a social robot to support professional figures in performing cognitive screening and stimulation. We implemented tools that allow us to automatize the evaluation of a subject’s cognitive abilities. More specifically, we programmed the humanoid robot Pepper to administer, in a fully automated and “friendly” way, three cognitive assessment tasks: Word List Recall (WLR), Attentive Matrices (AM), and the Rey-Osterrieth Complex Figure (ROCF). For WLR, we displayed the word list on the robot’s tablet, and the speech recognition module to record the recalled words. AM was delivered by asking the subjects to use and mark numbers on the tablet. For ROCF, we implemented two novel score assessment algorithms based on the processing of the picture drawn by the subjects and acquired through the robot camera. In particular, for ROCF, correlation analysis was conducted to compare automatically computed scores with a human psychologist’s. Our results suggest that the human psychologist’s workload can be reliably reduced thanks to the support of the robot.
References
[1]
Agrigoroaie R, Tapus A, et al. Kheddar A et al. Influence of robot’s interaction style on performance in a Stroop task Social Robotics 2017 Heidelberg Springer 95-104
[2]
Baxter P, Ashurst E, Read R, Kennedy J, and Belpaeme T Robot education peers in a situated primary school study: personalisation promotes child learning PLoS ONE 2017 12 5 e0178126
[3]
Boumans, R., Van Meulen, F., Hindriks, K., Neerincx, M., Olde Rikkert, M.: Proof of concept of a social robot for patient reported outcome measurements in elderly persons. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 73–74 (2018)
[4]
Canham, R., Smith, S.L., Tyrrell, A.M.: Automated scoring of a neuropsychological test: the Rey Osterrieth complex figure. In: Proceedings of the 26th Euromicro Conference. EUROMICRO 2000. Informatics: Inventing the Future, vol. 2, pp. 406–413. IEEE (2000)
[5]
Kidd, C.D., Breazeal, C.: A robotic weight loss coach. In: Proceedings of the National Conference on Artificial Intelligence, vol. 22, p. 1985. AAAI Press/MIT Press. Cambridge/Menlo Park (2007)
[6]
Kidd, C.D.: Designing for long-term human-robot interaction and application to weight loss (2008)
[7]
Moetesum M, Siddiqi I, Ehsan S, and Vincent N Deformation modeling and classification using deep convolutional neural networks for computerized analysis of neuropsychological drawings Neural Comput. Appl. 2020 32 1-25
[8]
Neff M, Wang Y, Abbott R, and Walker M Allbeck J, Badler N, Bickmore T, Pelachaud C, and Safonova A Evaluating the effect of gesture and language on personality perception in conversational agents Intelligent Virtual Agents 2010 Heidelberg Springer 222-235
[9]
Niculescu A, van Dijk B, Nijholt A, Li H, and See SL Making social robots more attractive: the effects of voice pitch, humor and empathy Int. J. Soc. Robot. 2013 5 2 171-191
[10]
Olaronke I, Oluwaseun O, and Rhoda I State of the art: a study of human-robot interaction in healthcare Int. J. Inf. Eng. Electron. Bus. 2017 9 43-55
[11]
Petric, F., Kovacić, Z.: No data? No problem! expert system approach to designing a POMDP framework for robot-assisted ASD diagnostics. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 209–210 (2018)
[12]
Plutchik R The nature of emotions: human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice Am. Sci. 2001 89 4 344-350
[13]
Rossi S, Dell’Aquila E, Bucci B, et al. Salichs MA et al. Evaluating the emotional valence of affective sounds for child-robot interaction Social Robotics 2019 Cham Springer 505-514
[14]
Rossi, S., Santangelo, G., Staffa, M., Varrasi, S., Conti, D., Di Nuovo, A.: Psychometric evaluation supported by a social robot: personality factors and technology acceptance. In: 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 802–807. IEEE (2018)
[15]
Rossi S, Staffa M, and Tamburro A Socially assistive robot for providing recommendations: comparing a humanoid robot with a mobile application Int. J. Soc. Robot. 2018 10 2 265-278
[16]
Spinnler H Standardizzazione e taratura italiana di test neuropsicologici Ital. J. Neurol. Sci. 1987 6 21-120
[17]
Varrasi, S., Di Nuovo, S., Conti, D., Di Nuovo, A.: A social robot for cognitive assessment. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 269–270 (2018)
[18]
Varrasi S, Di Nuovo S, Conti D, and Di Nuovo A Ficuciello F, Ruggiero F, and Finzi A Social robots as psychometric tools for cognitive assessment: a pilot test Human Friendly Robotics 2019 Heidelberg Springer 99-112
[19]
Watanabe K et al. The Rey-Osterrieth complex figure as a measure of executive function in childhood Brain Dev. 2005 27 8 564-569
[20]
Willis SL et al. Long-term effects of cognitive training on everyday functional outcomes in older adults JAMA 2006 296 23 2805-2814
[21]
Wilson RS et al. Participation in cognitively stimulating activities and risk of incident Alzheimer disease JAMA 2002 287 6 742-748
Recommendations
Finding “H” in HRI: Examining Human Personality Traits, Robotic Anthropomorphism, and Robot Likeability in Human-Robot Interaction
The study examines the relationship between the big five personality traits (extroversion, agreeableness, conscientiousness, neuroticism, and openness) and robot likeability and successful HRI implementation in varying human-robot interaction (HRI) ...
A Novel Concept of Human-Robot Competition for Evaluating a Robot's Reasoning Capabilities in HRI
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot InteractionFor intelligent Human-Robot Interaction (HRI), a robot should be equipped with some core reasoning capabilities such as perspective taking, effort analysis, and affordance analysis. This paper starts to explore how a robot equipped with such reasoning ...
Fake Empathy and Human-Robot Interaction HRI: A Preliminary Study
Empathy is a basic emotion trigger for human beings, especially while regulating social relationships and behaviour. The main challenge of this paper is study whether people's empathic reactions towards robots change depending on previous information ...
Comments
Information & Contributors
Information
Published In
Nov 2020
726 pages
ISBN:978-3-030-62055-4
DOI:10.1007/978-3-030-62056-1
© Springer Nature Switzerland AG 2020.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 14 November 2020
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 08 Feb 2025