Immersive Flora: Re-Engaging with the Forest through the Visualisation of Plant-Environment Interactions in Virtual Reality
Authors: 
Youyang Hu, Cyprien Raymi Fol, Chiaochi Chou, Verena C Griess, 
Yasuaki KakehiAuthors Info & Claims
Youyang Hu, Cyprien Raymi Fol, Chiaochi Chou, Verena C Griess, Yasuaki KakehiAuthors Info & ClaimsArticle No.: 407, Pages 1 - 6
Abstract
In response to recent calls for Human-Computer Interaction (HCI) to address ongoing environmental crises and promote the engagement between humans and nature, this paper presents Immersive Flora, a living plants-driven interactive system that re-engages users with the natural environment by virtually showcasing the diverse plant-environment interactions inside a forest. By utilizing biosensors to detect and analyze the intricate biological reactions of plants to wind, rain and sunlight, we explore the diversity of natural elements perceived by these plants within their wilderness habitat. This information is subsequently translated into a sophisticated virtual particle system that will react in real-time to mimic a change in the natural environment. This system is constructed utilizing point cloud data derived from the 3D reconstruction of plants and the forest environment. Through the expression of plant-environment interactions via particle manipulation, we establish an innovative interface reconnecting humans to the natural world.
Supplemental Material
- Download
- 185.05 MB
- Transcript
- Download
- 37.67 MB
- Transcript
References
[1]
Julian Frey, Patricia Holter, Laura Kinzinger, Zoe Schindler, Christopher Morhart, Sven Kolbe, Christiane Werner, and Thomas Seifert. 2023. Detailed mapping of below canopy surface temperatures in forests reveals new perspectives on microclimatic processes. Agricultural and Forest Meteorology 341 (2023), 109656.https://doi.org/10.1016/j.agrformet.2023.109656
[2]
Mirela Beloiu, Lucca Heinzmann, Nataliia Rehush, Arthur Gessler, and Verena C Griess. 2023. Individual Tree-Crown Detection and Species Identification in Heterogeneous Forests Using Aerial RGB Imagery and Deep Learning. Remote Sensing 15, 5 (2023), 1463.https://doi.org/10.3390/rs15051463
[3]
Raphael Zürcher, Jiayan Zhao, Alvaro Lau Sarmiento, Benjamin Brede, and Alexander Klippel. 2023. Advancing Forest Monitoring and Assessment Through Immersive Virtual Reality. AGILE: GIScience Series 4 (2023), 15.https://doi.org/10.5194/agile-giss-4-15-2023
[4]
Sarah Webber, Ryan M Kelly, Greg Wadley, and Wally Smith. 2023. Engaging with Nature through Technology: A Scoping Review of HCI Research. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.https://doi.org/10.1145/3544548.3581534
[5]
Hiroki Kobayashi, Ryoko Ueoka, and Michitaka Hirose. 2009. Human computer biosphere interaction: towards a sustainable society. In CHI’09 Extended Abstracts on Human Factors in Computing Systems. 2509–2518.https://doi.org/10.1145/1520340.1520355
[6]
Edwina Portocarrero, Gershon Dublon, Joseph Paradiso, and V Michael Bove Jr. 2015. ListenTree: Audio-haptic display in the natural environment. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. 395–398.https://doi.org/10.1145/2702613.2725437
[7]
Ofer Asaf, Ronnie Oren, Shachar Geiger, and Michal Rinott. 2021. Plantimus–A Plant Stethoscope. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction. 1–5.https://doi.org/10.1145/3430524.3442467
[8]
Jane Tingley. 2020. Foresta inclusive. https://janetingley.com/foresta-inclusive/. (2023)
[9]
Thijs Biersteker. 2019. Symbiosia. https://thijsbiersteker.com/symbiosia/. (2023)
[10]
G Segreto. 2019. Review–We Live in an Ocean of Air by Marshmallow Laser Feast at Saatchi Gallery. The London Magazine (2019).
[11]
Lara Houston and Marshmallow Laser Feast. 2021. Dream: mixed reality technologies for live performance. Interactions 28, 4 (2021), 10–13.https://doi.org/10.1145/3469883
[12]
David Abram. 2012. The spell of the sensuous: Perception and language in a more-than-human world. Vintage.
[13]
Anna Lowenhaupt Tsing. 2015. The mushroom at the end of the world: On the possibility of life in capitalist ruins. Princeton University Press.
[14]
Donna J Haraway. 2016. Staying with the trouble: Making kin in the Chthulucene. Duke University Press.
[15]
Laura Forlano. 2017. Posthumanism and design. She Ji: The Journal of Design, Economics, and Innovation 3, 1 (2017), 16–29. https://doi.org/10.1016/j. sheji.2017.08.001
[16]
Elisa Giaccardi and Johan Redström. 2020. Technology and more-than-human design. Design Issues 36, 4 (2020), 33–44.https://doi.org/10.1162/desi_a_00612
[17]
Ron Wakkary. 2021. Things we could design: For more than human-centered worlds. MIT press.
[18]
Jen Liu, Daragh Byrne, and Laura Devendorf. 2018. Design for collaborative survival: An inquiry into human-fungi relationships. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.https://doi.org/10.1145/3173574.3173614
[19]
Daisy Yoo, Tilde Bekker, Peter Dalsgaard, Eva Eriksson, Simon Skov Fougt, Christopher Frauenberger, Batya Friedman, Elisa Giaccardi, Anne-Marie Hansen, Ann Light, 2023. More-Than-Human Perspectives and Values in Human-Computer Interaction. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–3.https://doi.org/10.1145/3544549.3583174
[20]
Youyang Hu, Chiaochi Chou, and Yasuaki Kakehi. 2023. Synplant: Cymatics Visualization of Plant-Environment Interaction Based on Plants Biosignals. Proceedings of the ACM on Computer Graphics and Interactive Techniques 6, 2 (2023), 1–7.
[21]
Michelle Chang, Chenyi Shen, Aditi Maheshwari, Andreea Danielescu, and Lining Yao. 2022. Patterns and Opportunities for the Design of Human-Plant Interaction. In Designing Interactive Systems Conference. 925–948.https://doi.org/10.1145/3532106.3533555
[22]
Susan Loh, Marcus Foth, and Yasu Santo. 2024. The more-than-human turn in human-plant interaction design: From utilitarian object to living co-inhabitant. International Journal of Human-Computer Studies 181 (2024), 103128.https://doi.org/10.1016/j.ijhcs.2023.103128
[23]
Yongjoo Cho and Kyoung Shin Park. 2023. Designing Immersive Virtual Reality Simulation for Environmental Science Education. Electronics 12, 2 (2023), 315.https://doi.org/10.3390/electronics12020315
[24]
Ifeanyi Paul Odenigbo, Alaa AlSlaity, and Rita Orji. 2022. Augmented and Virtual Reality-Driven Interventions for Healthy Behavior Change: A Systematic Review. In ACM International Conference on Interactive Media Experiences. 53–68.https://doi.org/10.1145/3505284.3529964
[25]
Stefan P Thoma, Matthias Hartmann, Jonas Christen, Boris Mayer, Fred W Mast, and David Weibel. 2023. Increasing awareness of climate change with immersive virtual reality. Frontiers in virtual reality 4 (2023), 897034.https://doi.org/10.3389/frvir.2023.897034
[26]
Jiawei Huang, Melissa S Lucash, Robert M Scheller, and Alexander Klippel. 2019. Visualizing ecological data in virtual reality. In 2019 IEEE conference on virtual reality and 3D user interfaces (VR). IEEE, 1311–1312.https://doi.org/10.1109/VR.2019.8797771
[27]
Hui Lin, Michael Batty, Sven E Jørgensen, Bojie Fu, Milan Konecny, Alexey Voinov, Paul Torrens, Guonian Lu, A-Xing Zhu, John P Wilson, 2015. Virtual environments begin to embrace process-based geographic analysis, 493–498 pages.https://doi.org/10.1111/tgis.12167
[28]
Alexander G Volkov. 2012. Plant electrophysiology: methods and cell electrophysiology. Springer Science & Business Media.
[29]
Alexander G Volkov and Don Rufus A Ranatunga. 2006. Plants as environmental biosensors.Plant signaling & behavior 1, 3 (2006), 105–115. https://doi.org/10.4161/psb.1.3.3000
[30]
Chiara Chioni, Anna Maragno, Angelica Pianegonda, Marco Ciolli, Sara Favargiotti, and Giovanna A. Massari. 2023. Low-Cost 3D Virtual and Dynamic Reconstruction Approach for Urban Forests: The Mesiano University Park. Sustainability. 15, no. 19: 14072. https://doi.org/10.3390/su151914072
[31]
Chiara Chioni, Arnadi Murtiyoso, Sara Favargiotti, and Giovanna A. Massari. 2023. Low-cost Workflow for 3D Urban Forest Virtual Reconstruction, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLVIII-1/W2-2023, 1723–1728, https://doi.org/10.5194/isprs-archives-XLVIII-1-W2-2023-1723-2023, 2023.
[32]
Keijiro, Takahashi. 2019. Pcx - Point Cloud Importer/Renderer for Unity. https://github.com/keijiro/Pcx. (2023)
Index Terms
- Immersive Flora: Re-Engaging with the Forest through the Visualisation of Plant-Environment Interactions in Virtual Reality
Recommendations
Lotus: enhancing the immersive experience in virtual environment with mist-based olfactory display
SA '18: SIGGRAPH Asia 2018 Virtual & Augmented RealityWith the advance of virtual reality (VR) headset and haptic technologies, users can have a great experience when they are immersed in the virtual environment (VE). A fewer of research allow users to perceive the odor from the VE simultaneously. Based on ...
A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment
This study presents a 3D virtual reality (VR) keyboard system with realistic haptic feedback. The system uses two five-fingered data gloves to track finger positions and postures, uses micro-speakers to create simulated vibrations, and uses a head-...
Empathy and embodied experience in virtual environment
This study investigates the user experience to clarify what it is like to experience stories in VR (virtual reality) and how immersion influences story experiences in immersive storytelling. This study explores the immersive storytelling context, ...
Comments
Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Demonstration
- Research
- Refereed limited
Funding Sources
- JSPS KAKENHI
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 452Total Downloads
- Downloads (Last 12 months)452
- Downloads (Last 6 weeks)70
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format