LegacySphere: Facilitating Intergenerational Communication Through Perspective-Taking and Storytelling in Embodied VR
Article No.: 119, Pages 1 - 16
Abstract
Intergenerational communication can enhance well-being and family cohesion, but stereotypes and low empathy can be barriers to achieving effective communication. VR perspective-taking is a potential approach that is known to enhance understanding and empathy toward others by allowing a user to take another’s viewpoint. In this study, we introduce LegacySphere, a novel VR perspective-taking experience leveraging the combination of embodiment, role-play, and storytelling. To explore LegacySphere’s design and impact, we conducted an observational study involving five dyads with a one-generation gap. We found that LegacySphere promotes empathetic and reflexive intergenerational dialogue. Specifically, avatar embodiment encourages what we term “relationship cushioning,” fostering a trustful, open environment for genuine communications. The blending of real and embodied identities prompts insightful questions, merging both perspectives. The experience also nurtures a sense of unity and stimulates reflections on aging. Our work highlights the potential of immersive technologies for enhancing empathetic intergenerational relationships.
Supplemental Material
MP4 File - Video Preview
Video Preview
- Download
- 65.09 MB
- Download
- 294.16 MB
- Transcript
References
[1]
Elisabeth Ahlsén. 2008. Embodiment in communication – aphasia, apraxia and the possible role of mirroring and imitation. Clinical Linguistics & Phonetics 22, 4-5 (Jan. 2008), 311–315. https://doi.org/10.1080/02699200801918879 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/02699200801918879.
[2]
Sun Joo Ahn and Jeremy N. Bailenson. 2011. Self-Endorsing Versus Other-Endorsing in Virtual Environments. Journal of Advertising 40, 2 (2011), 93–106. https://doi.org/10.2753/JOA0091-3367400207 arXiv:https://doi.org/10.2753/JOA0091-3367400207
[3]
Karen Anderson, Jake Harwood, and Mary Lee Hummert. 2005. The Grandparent–Grandchild Relationship. Human Communication Research 31, 2 (2005), 268–294. https://doi.org/10.1111/j.1468-2958.2005.tb00872.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1468-2958.2005.tb00872.x.
[4]
Margaret Bearman, Claire Palermo, Louise M Allen, and Brett Williams. 2015. Learning empathy through simulation: a systematic literature review. Simulation in healthcare 10, 5 (2015), 308–319.
[5]
Daryl J Bem. 1972. Self-perception theory. In Advances in experimental social psychology. Vol. 6. Elsevier, 1–62.
[6]
David E. Bloom and Leo M. Zucker. 2022. Aging is the Real Population Bomb. International Monetary Fund. https://www.imf.org/en/Publications/fandd/issues/Series/Analytical-Series/aging-is-the-real-population-bomb-bloom-zucker
[7]
Nettie Boivin. 2021. Co-participatory multimodal intergenerational storytelling: preschool children’s relationship with modality creating elder inclusion. Journal of early childhood literacy (2021), 14687984211012055.
[8]
E Bonsignore. 2010. The use of StoryKit: design implications for intergenerational mobile storytelling. Technical Report. Tech Report HCIL-2010-31, HCIL, College Park, MD USA.
[9]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qual. Res. Psychol. 3, 2 (Jan. 2006), 77–101.
[10]
Alberto Castelli. 2023. The Melancholy of the Second-Person Narrator. Confluencia: Revista Hispánica de Cultura y Literatura 38, 2 (2023), 41–59.
[11]
Rita Charon. 2001. Narrative medicine: a model for empathy, reflection, profession, and trust. Jama 286, 15 (2001), 1897–1902.
[12]
Isabel Chen and Connor Forbes. 2014. Reflective writing and its impact on empathy in medical education: systematic review. Journal of educational evaluation for health professions 11 (2014).
[13]
Gerald L Clore and Katharine M Jeffery. 1972. Emotional role playing, attitude change, and attraction toward a disabled person.Journal of personality and social psychology 23, 1 (1972), 105.
[14]
Matt DelConte. 2003. Why you can’t speak: Second-person narration, voice, and a new model for understanding narrative. Style 37, 2 (2003), 204–219.
[15]
Nina Döllinger, Erik Wolf, Mario Botsch, Marc Erich Latoschik, and Carolin Wienrich. 2023. Are Embodied Avatars Harmful to Our Self-Experience? The Impact of Virtual Embodiment on Body Awareness. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 492, 14 pages. https://doi.org/10.1145/3544548.3580918
[16]
Nancy Eisenberg and Paul A Miller. 1987. The relation of empathy to prosocial and related behaviors.Psychological bulletin 101, 1 (1987), 91.
[17]
Scott Evenbeck, Stephen Reisman, and Chester A Insko. 1972. Cognitive requirements of consistent and counterattitudinal roleplaying: A general set effect. Psychonomic Science 26, 6 (1972), 343–344.
[18]
Chanee D. Fabius. 2016. Toward an Integration of Narrative Identity, Generativity, and Storytelling in African American Elders. Journal of Black Studies 47, 5 (2016), 423–434. https://doi.org/10.1177/0021934716638801 arXiv:https://doi.org/10.1177/0021934716638801
[19]
Christopher K Germer, Ronald D Siegel, and Paul R Fulton. 2013. Mindfulness and psychotherapy. The Guilford Press.
[20]
Susan B Gibbons. 2011. Understanding empathy as a complex construct: A review of the literature. Clinical Social Work Journal 39 (2011), 243–252.
[21]
Sandra E Gibson. 2009. Intergenerational communication in the classroom: Recommendations for successful teacher-student relationships. Nursing Education Perspectives 30, 1 (2009), 37–39.
[22]
Howard Giles and Jessica Gasiorek. 2011. Intergenerational communication practices. In Handbook of the psychology of aging. Elsevier, 233–247.
[23]
Howard Giles, Kimberly A. Noels, Angie Williams, Hiroshi Ota, Tae-Seop Lim, Sik Hung Ng, Ellen B. Ryan, and Lilnabeth Somera. 2003. Intergenerational Communication Across Cultures: Young People’s Perceptions of Conversations with Family Elders, Non-family Elders and Same-Age Peers. Journal of Cross-Cultural Gerontology 18, 1 (March 2003), 1–32. https://doi.org/10.1023/A:1024854211638
[24]
Eric Gordon and Steven Schirra. 2011. Playing with empathy: digital role-playing games in public meetings. In Proceedings of the 5th International Conference on Communities and Technologies. 179–185.
[25]
Victoria Groom, Jeremy N Bailenson, and Clifford Nass. 2009. The influence of racial embodiment on racial bias in immersive virtual environments. Social Influence 4, 3 (2009), 231–248.
[26]
Béatrice S. Hasler, Bernhard Spanlang, and Mel Slater. 2017. Virtual race transformation reverses racial in-group bias. PLOS ONE 12, 4 (04 2017), 1–20. https://doi.org/10.1371/journal.pone.0174965
[27]
Fernanda Herrera, Jeremy Bailenson, Erika Weisz, Elise Ogle, and Jamil Zaki. 2018. Building long-term empathy: A large-scale comparison of traditional and virtual reality perspective-taking. PLOS ONE 13, 10 (Oct. 2018), e0204494. https://doi.org/10.1371/journal.pone.0204494 Publisher: Public Library of Science.
[28]
Hal E. Hershfield, Daniel G. Goldstein, William F. Sharpe, Jesse Fox, Leo Yeykelis, Laura L. Carstensen, and Jeremy N. Bailenson. 2011. Increasing Saving Behavior Through Age-Progressed Renderings of the Future Self. Journal of Marketing Research 48, SPL (2011), S23–S37. https://doi.org/10.1509/jmkr.48.SPL.S23 arXiv:https://doi.org/10.1509/jmkr.48.SPL.S23PMID: 24634544.
[29]
Ben Herson. 2016. Empathy Engines: How Virtual Reality Films May (or May Not) Revolutionize Education. Comparative Education Review 60, 4 (Nov. 2016), 853–862.
[30]
Yasuyuki Inoue and Michiteru Kitazaki. 2021. Virtual mirror and beyond: The psychological basis for avatar embodiment via a mirror. Journal of Robotics and Mechatronics 33, 5 (2021), 1004–1012.
[31]
Irving L Janis and Leon Mann. 1965. Effectiveness of emotional role-playing in modifying smoking habits and attitudes.Journal of Experimental Research in Personality (1965).
[32]
Keith Johnstone. 2012. Impro: Improvisation and the theatre. Routledge.
[33]
Bumsoo Kang, Seungwoo Kang, and Inseok Hwang. 2021. Momentmeld: Ai-augmented mobile photographic memento towards mutually stimulatory inter-generational interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–16.
[34]
Zeinab Khanjani, Elnaz Mosanezhad Jeddi, Issa Hekmati, Saeede Khalilzade, Mahin Etemadi Nia, Morteza Andalib, and Parvaneh Ashrafian. 2015. Comparison of cognitive empathy, emotional empathy, and social functioning in different age groups. Australian Psychologist 50, 1 (2015), 80–85.
[35]
Jarrod Knibbe, Jonas Schjerlund, Mathias Petraeus, and Kasper Hornbæk. 2018. The Dream is Collapsing: The Experience of Exiting VR. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3174057
[36]
Sebastian Koblar, Matthew Cranwell, Simon Koblar, Ben Carnell, and Cherrie Galletly. 2018. Developing empathy: does experience through simulation improve medical-student empathy?Medical Science Educator 28 (2018), 31–36.
[37]
Gillian Porter Ladousse. 1987. Role play. Vol. 3. Oxford University Press.
[38]
Hung-Chi Lee, Ya Fang Cheng, Szu Yang Cho, Hsien-Hui Tang, Jane Hsu, and Chien-Hsiung Chen. 2014. Picgo: Designing Reminiscence and Storytelling for the Elderly with Photo Annotation. In Proceedings of the 2014 Companion Publication on Designing Interactive Systems (Vancouver, BC, Canada) (DIS Companion ’14). Association for Computing Machinery, New York, NY, USA, 9–12. https://doi.org/10.1145/2598784.2602769
[39]
Dana Di Pardo Léon-Henri and Bhawana Jain. 2017. Role play: A practical way to teach intercultural communication. Recherche et pratiques pédagogiques en langues de spécialité. Cahiers de l’Apliut 36, 2 (2017).
[40]
Cun Li. 2020. The Design of a System to Support Storytelling Between Older Adults Living in a Nursing Home and Their Children. The Design Journal 23, 1 (Jan. 2020), 153–163.
[41]
Cun Li, Jun Hu, Bart Hengeveld, and Caroline Hummels. 2018. Slots-Story: Facilitate Inter-Generational Life Story Sharing and Preservation of the Elderly. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (Oslo, Norway) (NordiCHI ’18). Association for Computing Machinery, New York, NY, USA, 691–695. https://doi.org/10.1145/3240167.3240245
[42]
Cun Li, Jun Hu, Bart Hengeveld, and Caroline Hummels. 2019. Slots-Memento: Facilitating Intergenerational Memento Storytelling and Preservation for the Elderly. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (Tempe, Arizona, USA) (TEI ’19). Association for Computing Machinery, New York, NY, USA, 359–366. https://doi.org/10.1145/3294109.3300979
[43]
Cun Li, Jun Hu, Bart Hengeveld, and Caroline Hummels. 2019. Story-Me: Design of a System to Support Intergenerational Storytelling and Preservation for Older Adults. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion (San Diego, CA, USA) (DIS ’19 Companion). Association for Computing Machinery, New York, NY, USA, 245–250. https://doi.org/10.1145/3301019.3323902
[44]
Cun Li, Jun Hu, Bart Hengeveld, and Caroline Hummels. 2020. Facilitating Storytelling and Preservation of Mementos for the Elderly Through Tangible Interface. In Human Systems Engineering and Design II. Springer International Publishing, 508–514.
[45]
Cun Li, Jun Hu, Bart Hengeveld, and Caroline Hummels. 2020. A Framework Designing for Story Sharing of the Elderly: From Design Opportunities to Concept Selection. In Intelligent Human Systems Integration 2020. Springer International Publishing, 810–815.
[46]
Cun Li, Xu Lin, Kai Kang, Jun Hu, Bart Hengeveld, Caroline Hummels, and Matthias Rauterberg. 2018. Interactive Gallery: Enhance Social Interaction for Elders by Story Sharing. In Advances in Digital Cultural Heritage. Springer International Publishing, 104–116.
[47]
Leon Mann and Irving L Janis. 1968. A follow-up study on the long-term effects of emotional role playing.Journal of personality and Social Psychology 8, 4p1 (1968), 339.
[48]
Pj. Manney. 2008. Empathy in the Time of Technology: How Storytelling is the Key to Empathy.
[49]
Seyed Hamidreza Mohammadi and Alexander Kain. 2017. An overview of voice conversion systems. Speech Communication 88 (2017), 65–82.
[50]
William D Morgan and Susan T Morgan. 2005. Cultivating attention and empathy. Mindfulness and psychotherapy 73 (2005), 90.
[51]
Soo Youn Oh, Jeremy Bailenson, Erika Weisz, and Jamil Zaki. 2016. Virtually old: Embodied perspective taking and the reduction of ageism under threat. Computers in Human Behavior 60 (2016), 398–410.
[52]
Kyung-Min Park, Jeonghun Ku, Soo-Hee Choi, Hee-Jeong Jang, Ji-Yeon Park, Sun I Kim, and Jae-Jin Kim. 2011. A virtual reality application in role-plays of social skills training for schizophrenia: a randomized, controlled trial. Psychiatry research 189, 2 (2011), 166–172.
[53]
Tabitha C. Peck, Sofia Seinfeld, Salvatore M. Aglioti, and Mel Slater. 2013. Putting yourself in the skin of a black avatar reduces implicit racial bias. Consciousness and Cognition 22, 3 (2013), 779–787. https://doi.org/10.1016/j.concog.2013.04.016
[54]
BC Pecorini and E Duplaa. 2017. Narrative gerontology and digital storytelling: What benefits for elders. MOJ Public Health 6, 6 (2017), 00192.
[55]
Paula B Poorman. 2002. Biography and role playing: Fostering empathy in abnormal psychology. Teaching of Psychology 29, 1 (2002), 32–36.
[56]
Tom Postmes, Russell Spears, and Martin Lea. 1998. Breaching or building social boundaries? SIDE-effects of computer-mediated communication. Communication research 25, 6 (1998), 689–715.
[57]
Anna Samira Praetorius and Daniel Görlich. 2020. How Avatars Influence User Behavior: A Review on the Proteus Effect in Virtual Environments and Video Games. In Proceedings of the 15th International Conference on the Foundations of Digital Games (Bugibba, Malta) (FDG ’20). Association for Computing Machinery, New York, NY, USA, Article 49, 9 pages. https://doi.org/10.1145/3402942.3403019
[58]
Rabindra Ratan, RV Rikard, Celina Wanek, Madison McKinley, Lee Johnson, and Young June Sah. 2016. Introducing Avatarification: An Experimental Examination of How Avatars Influence Student Motivation. In 2016 49th Hawaii International Conference on System Sciences (HICSS). 51–59. https://doi.org/10.1109/HICSS.2016.15
[59]
Renate LEP Reniers, Ahmad Abu-Akel, and Ana Seara-Cardoso. 2022. Cognitive Empathy and Perspective Taking: Understanding the Mechanisms of Normal and Abnormal Experiences and Abilities. Frontiers in Psychiatry 13 (2022), 945258.
[60]
Renate LEP Reniers, Rhiannon Corcoran, Richard Drake, Nick M Shryane, and Birgit A Völlm. 2011. The QCAE: A questionnaire of cognitive and affective empathy. Journal of personality assessment 93, 1 (2011), 84–95.
[61]
Jon Rueda and Francisco Lara. 2020. Virtual Reality and Empathy Enhancement: Ethical Aspects. Frontiers in Robotics and AI 7. https://doi.org/10.3389/frobt.2020.506984
[62]
Nicola S Schutte, Navjot Bhullar, Emma J Stilinović, and Katheryn Richardson. 2017. The impact of virtual environments on restorativeness and affect. Ecopsychology 9, 1 (2017), 1–7.
[63]
Jun’ichiro Seyama and Ruth S Nagayama. 2007. The uncanny valley: Effect of realism on the impression of artificial human faces. Presence 16, 4 (2007), 337–351.
[64]
Simona G Shamay-Tsoory, Rachel Tomer, and Judith Aharon-Peretz. 2005. The neuroanatomical basis of understanding sarcasm and its relationship to social cognition.Neuropsychology 19, 3 (2005), 288.
[65]
Mincheol Shin, Se Jung Kim, and Frank Biocca. 2019. The uncanny valley: No need for any further judgments when an avatar looks eerie. Computers in Human Behavior 94 (2019), 100–109.
[66]
Tania Singer and Olga M Klimecki. 2014. Empathy and compassion. Current Biology 24, 18 (2014), R875–R878.
[67]
Mel Slater, Bernhard Spanlang, Maria V Sanchez-Vives, and Olaf Blanke. 2010. First person experience of body transfer in virtual reality. PloS one 5, 5 (2010), e10564.
[68]
Mark Snyder, Elizabeth Decker Tanke, and Ellen Berscheid. 1977. Social perception and interpersonal behavior: On the self-fulfilling nature of social stereotypes.Journal of Personality and social Psychology 35, 9 (1977), 656.
[69]
Bernhard Spanlang, Jean-Marie Normand, David Borland, Konstantina Kilteni, Elias Giannopoulos, Ausiàs Pomés, Mar González-Franco, Daniel Perez-Marcos, Jorge Arroyo-Palacios, Xavi Navarro Muncunill, 2014. How to build an embodiment lab: achieving body representation illusions in virtual reality. Frontiers in Robotics and AI 1 (2014), 9.
[70]
Qi Sun, Li-Yi Wei, and Arie Kaufman. 2016. Mapping Virtual and Physical Reality. ACM Trans. Graph. 35, 4, Article 64 (jul 2016), 12 pages. https://doi.org/10.1145/2897824.2925883
[71]
Jih-Hsuan Tammy Lin and Dai-Yun Wu. 2021. Exercising with embodied young avatars: how young vs. older avatars in virtual reality affect perceived exertion and physical activity among male and female elderly individuals. Frontiers in psychology 12 (2021), 693545.
[72]
Austin Van Loon, Jeremy Bailenson, Jamil Zaki, Joshua Bostick, and Robb Willer. 2018. Virtual reality perspective-taking increases cognitive empathy for specific others. PloS one 13, 8 (2018), e0202442.
[73]
Torben Wallbaum, Andrii Matviienko, Swamy Ananthanarayan, Thomas Olsson, Wilko Heuten, and Susanne C.J. Boll. 2018. Supporting Communication between Grandparents and Grandchildren through Tangible Storytelling Systems. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174124
[74]
Roger Walsh. 1989. Asian psychotherapies. (1989).
[75]
Debra Webster. 2010. Promoting empathy through a creative reflective teaching strategy: A mixed-method study. Journal of Nursing Education 49, 2 (2010), 87–94.
[76]
Xiaoying Wei, Yizheng Gu, Emily Kuang, Xian Wang, Beiyan Cao, Xiaofu Jin, and Mingming Fan. 2023. Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and Grandchildren. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3544548.3581405
[77]
Angie Williams and Jon F Nussbaum. 2013. Intergenerational communication across the life span. Routledge.
[78]
Nick Yee and Jeremy Bailenson. 2007. The Proteus effect: The effect of transformed self-representation on behavior. Human communication research 33, 3 (2007), 271–290.
[79]
Nick Yee and Jeremy N. Bailenson. 2006. Walk A Mile in Digital Shoes : The Impact of Embodied Perspective-Taking on The Reduction of Negative Stereotyping in Immersive Virtual Environments.
[80]
Nick Yee and Jeremy N. Bailenson. 2009. The Difference Between Being and Seeing: The Relative Contribution of Self-Perception and Priming to Behavioral Changes via Digital Self-Representation. Media Psychology 12, 2 (2009), 195–209. https://doi.org/10.1080/15213260902849943 arXiv:https://doi.org/10.1080/15213260902849943
[81]
Oksana Ze, Patrizia Thoma, and Boris Suchan. 2014. Cognitive and affective empathy in younger and older individuals. Aging & mental health 18, 7 (2014), 929–935.
[82]
Anita Zehrer and Gabriela Leiß. 2020. Intergenerational communication barriers and pitfalls of business families in transition—a qualitative action research approach. Corporate Communications: An International Journal 25, 3 (Jan. 2020), 515–532. https://doi.org/10.1108/CCIJ-03-2020-0056 Publisher: Emerald Publishing Limited.
Index Terms
- LegacySphere: Facilitating Intergenerational Communication Through Perspective-Taking and Storytelling in Embodied VR
Index terms have been assigned to the content through auto-classification.
Recommendations
A Change of Scenery: Transformative Insights from Retrospective VR Embodied Perspective-Taking of Conflict With a Close Other
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsClose relationships are irreplaceable social resources, yet prone to high-risk conflict. Building on findings from the fields of HCI, virtual reality, and behavioral therapy, we evaluate the unexplored potential of retrospective VR-embodied perspective-...
The role of perspective-taking on empowering the empathetic behavior of educators in VR-based training sessions: An experimental evaluation
AbstractVR-based training approaches can be used to empower the empathetic behavior of educators, raising their awareness and understanding of their learners, particularly in an era of social isolation and distancing. This paper presents ...
Graphical abstractDisplay Omitted
Highlights- Virtual Reality offers a new paradigm in teacher education and training.
- ...
Examining children’s design processes, perspective-taking, and collaboration when using VR head-mounted displays
AbstractWe explore how children leverage virtual reality (VR) to reshape their design sensibilities and to expand their perspective-taking, which may lead to the children showing more empathic concerns for future users of their designs. We worked with ...
Comments
Information & Contributors
Information
Published In
May 2024
18961 pages
ISBN:9798400703300
DOI:10.1145/3613904
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 6,199 of 26,314 submissions, 24%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 918Total Downloads
- Downloads (Last 12 months)918
- Downloads (Last 6 weeks)92
Reflects downloads up to 05 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format