Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3308532.3329469acmconferencesArticle/Chapter ViewAbstractPublication PagesivaConference Proceedingsconference-collections
research-article

Virtual Human Questionnaire for Analysis of Depression, Anxiety and Personality

Published: 01 July 2019 Publication History

Abstract

Self-report questionnaires like PHQ-9 and GAD-7 are often used in the field of psychology to detect mental health problems and measure their severity. Their validity has been well established by a number of previous studies. However, most previous studies have used self-administration method to study their validity. In the context of automating the administering of questionnaires as a part of an interaction scenario led by a virtual human, we investigate if the virtual human administration of these questionnaires can be considered equivalent to the self-administration of these questionnaires (through an electronic form). Additionally, we also examine the equivalence when the virtual human is replaced by a real human. The interaction with real human is studied in two different modes: face-to-face and through a video-conferencing link. Statistical analysis of the scores obtained from our user study (consisting of 55 participants) revealed that human/virtual-human administered questionnaires can be considered practically equivalent to self administered ones. In most cases, the differences in the scores from self-administered questionnaires and human/virtual-human administered questionnaires, were found to be smaller than any effect size which could be considered practically significant.

References

[1]
2019. ARIA-VALUSPA Platform. https://github.com/ARIA-VALUSPA/AVP.
[2]
2019. Cereproc. https://www.cereproc.com.
[3]
Ravi Agarwal, Harini Alagarai Sampath, and Bipin Indurkhya. 2013. A usability study on natural interaction devices with ASD children. In International Conference on Universal Access in Human-Computer Interaction. Springer, 447--453.
[4]
Bruce Arroll, Felicity Goodyear-Smith, Susan Crengle, Jane Gunn, Ngaire Kerse, Tana Fishman, Karen Falloon, and Simon Hatcher. 2010. Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population. The Annals of Family Medicine 8, 4 (2010), 348--353.
[5]
Sara Bernardini, Kaka Porayska-Pomsta, and Tim J Smith. 2014. ECHOES: An intelligent serious game for fostering social communication in children with autism. Information Sciences 264 (2014), 41--60.
[6]
Jingying Chen, Dan Chen, Lizhe Wang, and Oliver Lemon. 2010. An advanced learning environment aided by recognition of multi-modal social signals. In International Conference on Web-Based Learning. Springer, 41--51.
[7]
David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, et al. 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of the 2014 international conference on Autonomous agents and multiagent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061--1068.
[8]
Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health 4, 2 (2017).
[9]
José Gutiérrez-Maldonado, Ivan Alsina-Jurnet, María Virginia Rangel-Gómez, Angel Aguilar-Alonso, Adolfo José Jarne-Esparcia, Antonio Andrés-Pueyo, and Antoni Talarn-Caparrós. 2008. Virtual Intelligent Agents to Train Abilities of Diagnosis in Psychology and Psychiatry. In New Directions in Intelligent Interactive Multimedia. Springer, 497--505.
[10]
Arno Hartholt, David Traum, Stacy C Marsella, Ari Shapiro, Giota Stratou, Anton Leuski, Louis-Philippe Morency, and Jonathan Gratch. 2013. All together now. In International Workshop on Intelligent Virtual Agents. Springer, 368--381.
[11]
Kurt Kroenke and Robert L Spitzer. 2002. The PHQ-9: a new depression diagnostic and severity measure. Psychiatric annals 32, 9 (2002), 509--515.
[12]
Kurt Kroenke, Robert L Spitzer, and Janet BW Williams. 2001. The PHQ-9: validity of a brief depression severity measure. Journal of general internal medicine 16, 9 (2001), 606--613.
[13]
Jeonghun Ku, Kiwan Han, Hyung Rae Lee, Hee Jeong Jang, Kwang Uk Kim, Sung Hyouk Park, Jae Jin Kim, Chan Hyung Kim, In Young Kim, and Sun I Kim. 2007. VR-based conversation training program for patients with schizophrenia: a preliminary clinical trial. Cyberpsychology & behavior 10, 4 (2007), 567--574.
[14]
Bernd Löwe, Oliver Decker, Stefanie Müller, Elmar Brähler, Dieter Schellberg, Wolfgang Herzog, and Philipp Yorck Herzberg. 2008. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical care 46, 3 (2008), 266--274.
[15]
Bernd Löwe, Jürgen Unützer, Christopher M Callahan, Anthony J Perkins, and Kurt Kroenke. 2004. Monitoring depression treatment outcomes with the patient health questionnaire-9. Medical care (2004), 1194--1201.
[16]
Alexandra Martin, Winfried Rief, Antje Klaiberg, and Elmar Braehler. 2006. Validity of the brief patient health questionnaire mood scale (PHQ-9) in the general population. General hospital psychiatry 28, 1 (2006), 71--77.
[17]
Juan Martínez-Miranda, Adrián Bresó, and Juan Miguel García-Gómez. 2014. Look on the bright side: a model of cognitive change in virtual agents. In International Conference on Intelligent Virtual Agents. Springer, 285--294.
[18]
Gary McKeown, Michel Valstar, Roddy Cowie, Maja Pantic, and Marc Schroder. 2012. The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE Transactions on Affective Computing 3, 1 (2012), 5--17.
[19]
Sally N Merry, Karolina Stasiak, Matthew Shepherd, Chris Frampton, Theresa Fleming, and Mathijs FG Lucassen. 2012. The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. Bmj 344 (2012), e2598.
[20]
Jacquelyn Ford Morie, Jamie Antonisse, Sean Bouchard, and Eric Chance. 2009. Virtual worlds as a healing modality for returning soldiers and veterans.
[21]
Sophie Pettit, Adam Qureshi, William Lee, Alex Stirzaker, Alex Gibson, William Henley, and Richard Byng. 2017. Variation in referral and access to new psychological therapy services by age: an empirical quantitative study. Br J Gen Pract 67, 660 (2017), e453--e459.
[22]
Melissa D Pinto, Amy M Greenblatt, Ronald L Hickman, Heather M Rice, Tami L Thomas, and John M Clochesy. 2016. Assessing the Critical Parameters of eSMART-MH: A Promising Avatar-Based Digital Therapeutic Intervention to Reduce Depressive Symptoms. Perspectives in psychiatric care 52, 3 (2016), 157--168.
[23]
Matthijs Pontier and Ghazanfar F Siddiqui. 2008. A virtual therapist that responds empathically to your answers. In International Workshop on Intelligent Virtual Agents. Springer, 417--425.
[24]
Beatrice Rammstedt and Oliver P John. 2007. Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. Journal of research in Personality 41, 1 (2007), 203--212.
[25]
Beatrice Rammstedt, Christoph J Kemper, Mira Céline Klein, Constanze Beierlein, and Anastassiya Kovaleva. 2017. A short scale for assessing the big five dimensions of personality: 10 item Big Five Inventory (BFI-10). methods, data, analyses 7, 2 (2017), 17.
[26]
Mike Rinck, Tobias Rörtgen, Wolf-Gero Lange, Ron Dotsch, Daniël HJ Wigboldus, and Eni S Becker. 2010. Social anxiety predicts avoidance behaviour in virtual encounters. Cognition and Emotion 24, 7 (2010), 1269--1276.
[27]
Marc Schröder. 2010. The SEMAINE API: towards a standards-based framework for building emotion-oriented systems. Advances in human-computer interaction 2010 (2010), 2.
[28]
Donald J Schuirmann. 1987. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. Journal of pharmacokinetics and biopharmaceutics 15, 6 (1987), 657--680.
[29]
Robert L Spitzer, Kurt Kroenke, Janet BW Williams, and Bernd Löwe. 2006. A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of internal medicine 166, 10 (2006), 1092--1097.
[30]
William Swartout, Ron Artstein, Eric Forbell, Susan Foutz, H Chad Lane, Belinda Lange, Jacquelyn Ford Morie, Albert Skip Rizzo, and David Traum. 2013. Virtual humans for learning. AI magazine 34, 4 (2013), 13--30.
[31]
Michel Valstar, Tobias Baur, Angelo Cafaro, Alexandru Ghitulescu, Blaise Potard, Johannes Wagner, Elisabeth André, Laurent Durieu, Matthew Aylett, Soumia Dermouche, et al. 2016. Ask Alice: an artificial retrieval of information agent. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. ACM, 419--420.
[32]
Johannes Wagner, Florian Lingenfelser, Tobias Baur, Ionut Damian, Felix Kistler, and Elisabeth André. 2013. The social signal interpretation (SSI) framework: multimodal signal processing and recognition in real-time. In Proceedings of the 21st ACM international conference on Multimedia. ACM, 831--834.

Cited By

View all
  • (2024)A conversational agent framework for mental health screening: design, implementation, and usabilityBehaviour & Information Technology10.1080/0144929X.2024.2332934(1-15)Online publication date: 27-Mar-2024
  • (2023)Mental Health Evaluation and Assistance for Visually Impaired PeopleICST Transactions on Scalable Information Systems10.4108/eetsis.vi.2931(e6)Online publication date: 21-Apr-2023
  • (2023)Chatbot features for anxiety and depression: A scoping reviewHealth Informatics Journal10.1177/1460458222114671929:1(146045822211467)Online publication date: 24-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IVA '19: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents
July 2019
282 pages
ISBN:9781450366724
DOI:10.1145/3308532
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. anxiety
  2. bfi-10
  3. depression
  4. gad-7
  5. intelligent virtual agent
  6. personality
  7. phq-9

Qualifiers

  • Research-article

Funding Sources

Conference

IVA '19
Sponsor:

Acceptance Rates

IVA '19 Paper Acceptance Rate 15 of 63 submissions, 24%;
Overall Acceptance Rate 53 of 196 submissions, 27%

Upcoming Conference

IVA '24
ACM International Conference on Intelligent Virtual Agents
September 16 - 19, 2024
GLASGOW , United Kingdom

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)94
  • Downloads (Last 6 weeks)7
Reflects downloads up to 30 Aug 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A conversational agent framework for mental health screening: design, implementation, and usabilityBehaviour & Information Technology10.1080/0144929X.2024.2332934(1-15)Online publication date: 27-Mar-2024
  • (2023)Mental Health Evaluation and Assistance for Visually Impaired PeopleICST Transactions on Scalable Information Systems10.4108/eetsis.vi.2931(e6)Online publication date: 21-Apr-2023
  • (2023)Chatbot features for anxiety and depression: A scoping reviewHealth Informatics Journal10.1177/1460458222114671929:1(146045822211467)Online publication date: 24-Jan-2023
  • (2023)Conversational Assessment of Mild Cognitive Impairment with Virtual AgentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607314(1-8)Online publication date: 19-Sep-2023
  • (2023)Self-Supervised Learning of Person-Specific Facial Dynamics for Automatic Personality RecognitionIEEE Transactions on Affective Computing10.1109/TAFFC.2021.306460114:1(178-195)Online publication date: 1-Jan-2023
  • (2023)PRA-Net: Part-and-Relation Attention Network for depression recognition from facial expressionComputers in Biology and Medicine10.1016/j.compbiomed.2023.106589157(106589)Online publication date: May-2023
  • (2022)Can Gestural Filler Reduce User-Perceived Latency in Conversation with Digital Humans?Applied Sciences10.3390/app12211097212:21(10972)Online publication date: 29-Oct-2022
  • (2022)A Conceptual Framework Based on Conversational Agents for the Early Detection of Cognitive ImpairmentProceedings of 2nd International Conference on Artificial Intelligence: Advances and Applications10.1007/978-981-16-6332-1_65(801-813)Online publication date: 14-Feb-2022
  • (2021)Design and Evaluation of Virtual Human Mediated Tasks for Assessment of Depression and AnxietyProceedings of the 21st ACM International Conference on Intelligent Virtual Agents10.1145/3472306.3478361(52-59)Online publication date: 14-Sep-2021
  • (2021)Designing an Adaptive Embodied Conversational Agent for Health LiteracyProceedings of the 21st ACM International Conference on Intelligent Virtual Agents10.1145/3472306.3478350(112-119)Online publication date: 14-Sep-2021
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media