Harnessing Hypertext Paradigms to Augment VR Spaces
Article No.: 5, Pages 1 - 10
Abstract
This paper explores the integration of hypertext structures within Virtual Reality (VR) environments, differentiating between two distinct design philosophies: VR as a native framework for 3D embodiment-enabled spaces similar to traditional 2D spatial hypertext, and utilizing hypertext to enhance VR experiences. Focusing on the latter approach, we propose an abstract knowledge layer that bridges typical VR systems and human thinking, thus facilitating the integration of human cognitive capabilities. Finally, we explore ethical implications of VR systems that arise in the presented context and propose hypertext as a paradigm to address some of these concerns.
References
[1]
Giuseppe Abrami, Alexander Mehler, Mevlüt Bagci, Patrick Schrottenbacher, Alexander Henlein, Christian Spiekermann, Juliane Engel, and Jakob Schreiber. 2023. Va.Si.Li-Lab as a Collaborative Multi-User Annotation Tool in Virtual Reality and Its Potential Fields of Application. In Proceedings of the 34th ACM Conference on Hypertext and Social Media (Rome, Italy) (HT ’23). Association for Computing Machinery, New York, NY, USA, Article 22, 9 pages. https://doi.org/10.1145/3603163.3609076
[2]
Areej Abuhammad, Jannat Falah, Salasabeel F. M. Alfalah, Muhannad Abu-Tarboush, Ruba T. Tarawneh, Dimitris Drikakis, and Vassilis Charissis. 2021. “MedChemVR”: A Virtual Reality Game to Enhance Medicinal Chemistry Education. Multimodal Technologies and Interaction 5, 3 (2021). https://doi.org/10.3390/mti5030010
[3]
Claus Atzenbeck. 2024. Unwinding AI’s Moral Maze: Hypertext’s Ethical Potential. In Proceedings of the 34th ACM Conference on Hypertext and Social Media (HT’24). ACM, New York, NY, USA, 6. https://doi.org/10.1145/3648188.3678213
[4]
Claus Atzenbeck, Sam Brooker, and Daniel Roßner. 2023. Storytelling Machines. In Proceedings of the 6th Workshop on Human Factors in Hypertext(HUMAN ’23). ACM, New York, NY, USA, 1–9. https://doi.org/10.1145/3603607.3613481
[5]
Claus Atzenbeck, Eelco Herder, and Daniel Roßner. 2023. Breaking the routine: spatial hypertext concepts for active decision making in recommender systems. New Review of Hypermedia and Multimedia 29, 1 (2023), 1–35. https://doi.org/10.1080/13614568.2023.2170474
[6]
Claus Atzenbeck and Peter J. Nürnberg. 2019. Hypertext as Method. In Proceedings of the 30th ACM Conference on Hypertext and Social Media (HT ’19). ACM, New York, NY, USA, 29–38. https://doi.org/10.1145/3342220.3343669
[7]
Claus Atzenbeck, Peter J. Nürnberg, and Daniel Roßner. 2021. Synthesising augmentation and automation. New Review of Hypermedia and Multimedia 27, 1–2 (2021), 177–203. https://doi.org/10.1080/13614568.2021.1942237
[8]
Claus Atzenbeck, Daniel Roßner, and Manolis Tzagarakis. 2018. Mother – An Integrated Approach to Hypertext Domains. In Proceedings of the 29th ACM Conference on Hypertext and Social Media. ACM, New York, NY, USA, 145–149. https://doi.org/10.1145/3209542.3209570
[9]
Claus Atzenbeck, Thomas Schedel, Manolis Tzagarakis, Daniel Roßner, and Lucas Mages. 2017. Revisiting Hypertext Infrastructure. In Proceedings of the 28th ACM Conference on Hypertext and Social Media. ACM, New York, NY, USA, 35–44. https://doi.org/10.1145/3078714.3078718
[10]
Shaduan Babbili, Kevin Bönisch, Yannick Heinrich, Philipp Stephan, Giuseppe Abrami, and Alexander Mehler. 2023. Viki LibraRy: A virtual reality library for collaborative browsing and navigation through hypertext. In Proceedings of the 34th ACM Conference on Hypertext and Social Media (Rome, Italy) (HT ’23). Association for Computing Machinery, New York, NY, USA, Article 6, 3 pages. https://doi.org/10.1145/3603163.3609079
[11]
Katharina-Maria Behr, Andreas Nosper, Christoph Klimmt, and Tilo Hartmann. 2005. Some practical considerations of ethical issues in VR research. Presence: Teleoper. Virtual Environ. 14, 6 (dec 2005), 668–676. https://doi.org/10.1162/105474605775196535
[12]
Ayush Bhardwaj, Junghoon Chae, Richard Huynh Noeske, and Jin Ryong Kim. 2021. TangibleData: Interactive Data Visualization with Mid-Air Haptics. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (Osaka, Japan) (VRST ’21). Association for Computing Machinery, New York, NY, USA, Article 29, 11 pages. https://doi.org/10.1145/3489849.3489890
[13]
Noam Chomsky, Ian Roberts, and Jeffrey Watumull. 2023. The False Promise of ChatGPT. The New York Times March 8 (2023). https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chatgpt-ai.html
[14]
Poshmaal Dhar, Tetyana Rocks, Rasika Samarasinghe, Garth Stephenson, and Craig Smith. 2021. Augmented reality in medical education: students’ experiences and learning outcomes. Medical Education Online 26 (01 2021), 1953953. https://doi.org/10.1080/10872981.2021.1953953
[15]
Douglas C. Engelbart. 1962. Augmenting Human Intellect: A Conceptual Framework. Summary Report AFOSR-3233. Standford Research Institute. http://dougengelbart.org/content/view/138
[16]
Martin Feick, Kora Persephone Regitz, Anthony Tang, and Antonio Krüger. 2022. Designing Visuo-Haptic Illusions with Proxies in Virtual Reality: Exploration of Grasp, Movement Trajectory and Object Mass. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 635, 15 pages. https://doi.org/10.1145/3491102.3517671
[17]
Alexandre Gomes de Siqueira, Rohith Venkatakrishnan, Roshan Venkatakrishnan, Ayush Bhargava, Kathryn Lucaites, Hannah Solini, Moloud Nasiri, Andrew Robb, Christopher Pagano, Brygg Ullmer, and Sabarish Babu. 2021. Empirically Evaluating the Effects of Perceptual Information Channels on the Size Perception of Tangibles in Near-Field Virtual Reality. 1–10. https://doi.org/10.1109/VR50410.2021.00086
[18]
Kaj Grønbæk, Jannie F. Kristensen, Peter Ørbæk, and Mette Agger Eriksen. 2003. “Physical hypermedia”: Organising collections of mixed physical and digital material. In Proceedings of the 14th ACM Conference on Hypertext and Hypermedia. ACM Press, New York, NY, USA, 10–19. http://doi.acm.org/10.1145/900051.900056
[19]
Hunter Groninger, Diana Stewart, Deliya Wesley, James Cowgill, and Mihriye Mete. 2022. Virtual Reality for Management of Cancer Pain: Study Rationale and Design. Contemporary Clinical Trials Communications 26 (01 2022), 100895. https://doi.org/10.1016/j.conctc.2022.100895
[20]
Ziyue Guo, Dong Zhou, Qidi Zhou, Shunfeng Mei, Shengkui Zeng, Dequan Yu, and Jiayu Chen. 2019. A Hybrid Method for Evaluation of Maintainability Towards a Design Process Using Virtual Reality. Computers & Industrial Engineering 140 (12 2019), 106227. https://doi.org/10.1016/j.cie.2019.106227
[21]
Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4034–4044. https://doi.org/10.1145/3025453.3025665
[22]
Christopher L. Hunt, Yinghe Sun, Shipeng Wang, Ahmed W. Shehata, Jacqueline S. Hebert, Marlis Gonzalez-Fernandez, Rahul R. Kaliki, and Nitish V. Thakor. 2023. Limb Loading Enhances Skill Transfer Between Augmented and Physical Reality Tasks During Limb Loss Rehabilitation. Journal of NeuroEngineering and Rehabilitation 20 (1 2023). https://doi.org/10.1186/s12984-023-01136-5
[23]
Simon Julier, Yohan Baillot, Marco Lanzagorta, Dennis Brown, and Lawrence Rosenblum. 2001. BARS: Battlefield Augmented Reality System. (05 2001).
[24]
Gökhan Karadenız, Ahmet Özcan, Mehmet Bayram, and Gökhan İnce. 2024. Drone Wars 3D: A Game-Based Simulation Platform for Testing Aerial Defence Strategies Against Drone Swarms. Journal of Aeronautics and Space Technologies 17, Special Issue (4 2024), 182–207. https://jast.hho.msu.edu.tr/index.php/JAST/article/view/572
[25]
Abdulamir A. Karim and suha Dh. Athab. 2024. An Object Detection Model based on Augmented Reality for Iraqi Archaeology. Baghdad Science Journal 21 (5 2024).
[26]
Anne R. Kearney and Stephen Kaplan. 1997. Toward a Methodology for the Measurement of Knowledge Structures of Ordinary People. The Conceptual Content Cognitive Map (3CM). Environment and Behavior 29, 5 (1997), 579–617.
[27]
Ryo Kodama, Masahiro Koge, Shun Taguchi, and Hiroyuki Kajimoto. 2017. COMS-VR: Mobile virtual reality entertainment system using electric car and head-mounted display. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). 130–133. https://doi.org/10.1109/3DUI.2017.7893329
[28]
Jeroen S. Lemmens, Monika Simon, and Sindy R. Sumter. 2022. Fear and loathing in VR: the emotional and physiological effects of immersive games. Virtual Reality 26, 1 (2022), 223–234. https://doi.org/10.1007/s10055-021-00555-w
[29]
Mark Livingston, Simon Julier, Dennis Brown, J. II, Joseph Gabbard, and Deborah Hix. 2008. An Augmented Reality System for Military Operations in Urban Terrain. (12 2008).
[30]
Alexander Mehler, Giuseppe Abrami, Christian Spiekermann, and Matthias Jostock. 2018. VAnnotatoR: A Framework for Generating Multimodal Hypertexts. In Proceedings of the 29th on Hypertext and Social Media. ACM, New York, NY, USA, 150–154. https://doi.org/10.1145/3209542.3209572
[31]
Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented Reality: A class of displays on the reality-virtuality continuum. In Telemanipulator and Telepresence Technologies, Hari Das (Ed.). Vol. 2351. International Society for Optics and Photonics, SPIE, 282–292. https://doi.org/10.1117/12.197321
[32]
Catrin Misselhorn. 2019. Grundfragen der Maschinenethik (4 ed.). Number 19583 in Reclam Universal-Bibliothek. Reclam, Ditzingen.
[33]
Preben Mogensen and Kaj Grønbæk. 2000. Hypermedia in the Virtual Project Room - Toward Open 3D Spatial Hypermedia. In Proceedings of the Eleventh ACM on Hypertext and Hypermedia (San Antonio, Texas, USA) (HT ’00). Association for Computing Machinery, New York, NY, USA, 113–122. https://doi.org/10.1145/336296.336340
[34]
James H. Moor. 2006. The Nature, Importance, and Difficulty of Machine Ethics. IEEE Intelligent Systems 21, 4 (2006), 18–21. https://doi.org/10.1109/MIS.2006.80
[35]
Thomas Muender, Michael Bonfert, Anke Verena Reinschluessel, Rainer Malaka, and Tanja Döring. 2022. Haptic Fidelity Framework: Defining the Factors of Realistic Haptic Feedback for Virtual Reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 431, 17 pages. https://doi.org/10.1145/3491102.3501953
[36]
Alexander Muryy and Andrew Glennerster. 2020. Route Selection in Non-Euclidean Virtual Environments. (08 2020). https://doi.org/10.1101/2020.08.14.250621
[37]
Theodor Holm Nelson. 2015. What Box? In Intertwingled. The Work and Influence of Ted Nelson, Douglas R. Dechow and Daniele C. Struppa (Eds.). Springer, Cham, Switzerland, 133–150. https://doi.org/10.1007/978-3-319-16925-5_17
[38]
Samah Obeid and Halime Demirkan. 2020. The Influence of Virtual Reality on Design Process Creativity in Basic Design Studios. Interactive Learning Environments 31 (2020), 1841 – 1859. https://doi.org/10.1080/10494820.2020.1858116
[39]
Damiano Oriti, Federico Manuri, Francesco De Pace, and Andrea Sanna. 2021. Harmonize: A Shared Environment for Extended Immersive Entertainment. Virtual Reality 27 (10 2021). https://doi.org/10.1007/s10055-021-00585-4
[40]
Vesna Posloncec-Petric, Valentina Vuković, Zeljko Bacic, and Ivka Kljajić. 2023. Use of Augmented Reality to Present Archaeological Contents. 186–194. https://doi.org/10.1007/978-3-031-43056-5_15
[41]
Susanne Purucker, Claus Atzenbeck, and Daniel Roßner. 2019. Intelligent Hypertext for Video Selection: A Design Approach. In Proceedings of the 2nd International Workshop on Human Factors in Hypertext (HUMAN’19). ACM, New York, NY, USA, 19–26. https://doi.org/10.1145/3345509.3349279
[42]
Philipp A. Rauschnabel, Reto Felix, Chris Hinsch, Hamza Shahab, and Florian Alt. 2022. What is XR? Towards a Framework for Augmented and Virtual Reality. Computers in Human Behavior 133 (2022), 107289. https://doi.org/10.1016/j.chb.2022.107289
[43]
George Robertson, Mary Czerwinski, Kevin Larson, Daniel C. Robbins, David Thiel, and Maarten van Dantzich. 1998. Data Mountain: using spatial memory for document management. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 153–162. http://doi.acm.org/10.1145/288392.288596
[44]
Daniel Roßner and Claus Atzenbeck. 2021. Demonstration of Weblinks: A Rich Linking Layer Over the Web. In Proceedings of the 32nd ACM Conference on Hypertext and Social Media(HT ’21). ACM, New York, NY, USA, 283–286. https://doi.org/10.1145/3465336.3475123
[45]
Daniel Roßner, Claus Atzenbeck, and Sam Brooker. 2023. SPORE: A Storybreaking Machine. In Proceedings of the 33rd ACM Conference on Hypertext and Social Media (HT’23). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3603163.3609075
[46]
Daniel Roßner, Claus Atzenbeck, and Daniel Urban. 2020. Weblinks: Augmenting Web Browsers with Enhanced Link Services. In Proceedings of the 3rd Workshop on Human Factors in Hypertext. ACM, New York, NY, USA, Article 5, 5 pages. https://doi.org/10.1145/3406853.3432663
[47]
D. Rothman and William Warren. 2010. Wormholes in Virtual Reality and the Geometry of Cognitive Maps. Journal of Vision - J VISION 6, 143–143. https://doi.org/10.1167/6.6.143
[48]
Thomas Schedel and Claus Atzenbeck. 2016. Spatio-Temporal Parsing in Spatial Hypermedia. In Proceedings of the 27th ACM Conference on Hypertext and Social Media. ACM, New York, NY, USA, 149–157. http://doi.org/10.1145/2914586.2914596
[49]
Shashi Shekhar, Steven K. Feiner, and Walid G. Aref. 2015. Spatial computing. Communication of the ACM 59, 1 (12 2015), 72–81. https://doi.org/10.1145/2756547
[50]
Frank M. Shipman and Catherine C. Marshall. 1999. Spatial hypertext: an alternative to navigational and semantic links. Comput. Surveys 31, 4es (dec 1999), 14–es. https://doi.org/10.1145/345966.346001
[51]
Beat Signer, Reinout Roels, Robert van Barlingen, and Brent Willems. 2021. Back to the Future: Bringing Original Hypermedia and Cross-Media Concepts to Modern Desktop Environments. In Proceedings of the 32nd ACM Conference on Hypertext and Social Media(HT ’21). ACM, New York, NY, USA, 277–282. https://doi.org/10.1145/3465336.3475122
[52]
Rosemary Michelle Simpson. 1996. Beyond the Plane: Spatial Hypertext in a Virtual Reality World. SIGWEB Newsl. 5, 3 (oct 1996), 13–16. https://doi.org/10.1145/264838.264841
[53]
Alexander Skulmowski, Steve Nebel, Martin Remmele, and Günter Daniel Rey. 2022. Is a Preference for Realism Really Naive After All? A Cognitive Model of Learning with Realistic Visualizations. Educational Psychology Review 34, 2 (2022), 649–675. https://doi.org/10.1007/s10648-021-09638-1
[54]
Mel Slater, Cristina Gonzalez-Liencres, Patrick Haggard, Charlotte Vinkers, Rebecca Gregory-Clarke, Steve Jelley, Zillah Watson, Graham Breen, Raz Schwarz, William Steptoe, Dalila Szostak, Shivashankar Halan, Deborah Fox, and Jeremy Silver. 2020. The Ethics of Realism in Virtual and Augmented Reality. Frontiers in Virtual Reality 1, Article 1 (2020), 13 pages. https://doi.org/10.3389/frvir.2020.00001
[55]
Britta Stammler, Kathrin Flammer, Thomas Schuster, Marian Lambert, and Hans-Otto Karnath. 2023. Negami: An Augmented Reality App for the Treatment of Spatial Neglect After Stroke. JMIR Serious Games 11 (02 2023). https://doi.org/10.2196/40651
[56]
Ivan E. Sutherland. 1965. The Ultimate Display. In Proceedings of the International Federation for Information Processing Congress. 506–508.
[57]
Ryo Suzuki, Adnan Karim, Tian Xia, Hooman Hedayati, and Nicolai Marquardt. 2022. Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 553, 33 pages. https://doi.org/10.1145/3491102.3517719
[58]
Leonardo Tanzi, Pietro Piazzolla, Francesco Porpiglia, and Enrico Vezzetti. 2021. Real-time Deep Learning Semantic Segmentation During Intra-Operative Surgery for 3D Augmented Reality assistance. International Journal of Computer Assisted Radiology and Surgery 16 (06 2021). https://doi.org/10.1007/s11548-021-02432-y
[59]
Daisuke Umebayashi, Yu Yamamoto, Yasuhiro Nakajima, Nobuhisa Fukaya, and Masahito Hara. 2018. Augmented Reality Visualization–Guided Microscopic Spine Surgery: Transvertebral Anterior Cervical Foraminotomy and Posterior Foraminotomy. Journal of the American Academy of Orthopaedic Surgeons. Global Research & Reviews 2 (2018). https://doi.org/10.5435/JAAOSGlobal-D-17-00008
[60]
Carissa Véliz. 2021. Moral zombies: why algorithms are not moral agents. AI & Society 36 (6 2021), 487–497. https://doi.org/10.1007/s00146-021-01189-x
[61]
William Warren. 2019. Non-Euclidean Navigation. The Journal of Experimental Biology 222 (02 2019), jeb187971. https://doi.org/10.1242/jeb.187971
[62]
Christopher Widdowson and Ranxiao Frances Wang. 2022. Human Navigation in Curved Spaces. Cognition 218 (2022), 104923. https://doi.org/10.1016/j.cognition.2021.104923
[63]
Jianghao Xiong, En-Lin Hsiang, Ziqian He, Tao Zhan, and Shin-Tson Wu. 2021. Augmented reality and virtual reality displays: emerging technologies and future perspectives. Light: Science & Applications 10 (10 2021), 216. https://doi.org/10.1038/s41377-021-00658-8
[64]
Grzegorz Zwoliński, Dorota Kamińska, Anna Laska-Leśniewicz, Rain Eric Haamer, Mário Vairinhos, Rui Raposo, Frane Urem, and Pedro Reisinho. 2022. Extended Reality in Education and Training: Case Studies in Management Education. Electronics 11, 3 (2022). https://doi.org/10.3390/electronics11030336
Index Terms
- Harnessing Hypertext Paradigms to Augment VR Spaces
Recommendations
Stepping into the Unknown: Immersive Spatial Hypertext
HUMAN '24: Proceedings of the 7th Workshop on Human Factors in HypertextTraditional spatial hypertext systems, predominantly limited to two-dimensional (2D) interfaces, offer limited support for addressing long debated inherent problems such as orientation difficulties and navigation in large information spaces. In this ...
Using Design Fiction to Explore the Ethics of VR ‘In the Wild’
TVX '19: Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online VideoIn this half-day workshop, we will explore the ethics of Virtual Reality (VR) through conversations framed around design fictions. Affordable head-mounted displays (HMDs) and accessible VR content are now within reach of large audiences, yet many of VR'...
Building and Employing Cross-Reality
This issue's Works in Progress department lists five projects with a focus on cross reality. The first two involve using Project Wonderland for collaborative projects. The next three use virtual and augmented reality to enhance user capabilities and ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
HT '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6 of 9 submissions, 67%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 62Total Downloads
- Downloads (Last 12 months)62
- Downloads (Last 6 weeks)38
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in