Design of a virtual image distance measurement system for augmented reality/virtual reality display

In the field of surgery, major changes that have occurred include the advent of minimally invasive surgery and the realization of the importance of the ‘systems’ in the surgical care of the patient (Pierorazio & Allaf, 2009). Challenges in surgical training are two-fold: (i) to train the surgical residents to manage a patient clinically (ii) to train them in operative skills (Singh & Darzi,2013). In Pakistan, another issue with surgical training is that we have the shortest duration of surgical training in general surgery of four years only, compared to six to eight years in Europe and America (Zafar & Rana, 2013). Along with it, the smaller number of patients to surgical residents’ ratio is also an issue in surgical training. This warrants formal training outside the operation room. It has been reported by many authors that changes are required in the current surgical training system due to the significant deficiencies in the graduating surgeon (Carlsen et al., 2014; Jarman et al., 2009; Parsons, Blencowe, Hollowood, & Grant, 2011). Considering surgical training, it is imperative that a surgeon is competent in clinical management and operative skills at the end of the surgical training. To achieve this outcome in this challenging scenario, a resident surgeon should be provided with the opportunities of training outside the operation theatre, before s/he can perform procedures on a real patient. The need for this training was felt more when the Institute of Medicine in the USA published a report, ‘To Err is Human’ (Stelfox, Palmisani, Scurlock, Orav, & Bates, 2006), with an aim to reduce medical errors. This is required for better training and objective assessment of the surgical residents. The options for this training include but are not limited to the use of mannequins, virtual patients, virtual simulators, virtual reality, augmented reality, and mixed reality. Simulation is a technique to substitute or add to real experiences with guided ones, often immersive in nature, that reproduce substantial aspects of the real world in a fully interactive way. Mannequins, virtual simulators are in use for a long time now. They are available in low fidelity to high fidelity mannequins and virtual simulators and help residents understand the surgical anatomy, operative site and practice their skills. Virtual patients can be discussed with students in a simple format of the text, pictures, and videos as case files available online, or in the form of customized software applications based on algorithms. In a study done by Courtielle et al, they reported that knowledge retention is increased in residents when it is delivered through virtual patients as compared to lecturing (Courteille et al., 2018).But learning the skills component requires hands-on practice. This gap can be bridged with virtual, augmented, or mixed reality. There are three types of virtual reality (VR) technologies: (i) non-immersive, (ii) semi-immersive, and (iii) fully immersive. Non-immersive (VR) involves the use of software and computers. In semi-immersive and immersive VR, the virtual image is presented through the head-mounted display(HMD), the difference being that in the fully immersive type, the virtual image is completely obscured from the actual world. Using handheld devices with haptic feedback the trainee can perform a procedure in the virtual environment (Douglas, Wilke, Gibson, Petricoin, & Liotta, 2017). Augmented reality (AR) can be divided into complete AR or mixed reality (MR). Through AR and MR, a trainee can see a virtual and a real-world image at the same time, making it easy for the supervisor to explain the steps of the surgery. Similar to VR, in AR and MR the user wears an HMD that shows both images. In AR, the virtual image is transparent whereas, in MR, it appears solid (Douglas et al., 2017). Virtual augmented and mixed reality has more potential to train surgeons as they provide fidelity very close to the real situation and require fewer physical resources and space compared to the simulators. But they are costlier, and affordability is an issue. To overcome this, low-cost solutions to virtual reality have been developed. It is high time that we also start thinking on the same lines and develop this means of training our surgeons at an affordable cost.

Getrieben durch populäre Produkte und Anwendungen wie Oculus Rift, Pokémon Go oder der Samsung Gear stößt Virtual Reality, Augmented Reality und auch Mixed Reality auf zunehmend großes Interesse. Obwohl die zugrunde liegenden Technologien bereits seit den 1990er Jahren eingesetzt werden, ist eine breitere Adoption erst seit relativ kurzer Zeit zu beobachten. In der Folge ist ein sich schnell entwickelndes Ökosystem für VR und AR entstanden (Berg & Vance, 2017). Aus einer (medien-) politischen Perspektive interessiert dabei, welche Standortfaktoren die Ansiedlung und Agglomeration dieser Firmen begünstigen. Da die Wertschöpfungsaktivitäten sowohl hinsichtlich der Zielmärkte als auch der Leistungserstellung (z. B. starker Einsatz von IT und Hardware in der Produkterstellung) von denen klassischer Medienprodukte deutlich abweichen, kann insbesondere gefragt werden, ob die VR-, MR- und AR-Unternehmen mit Blick auf die Ansiedlungspolitik als Teil der Medienbranche aufzufassen sind und somit auf die für Medienunternehmen besonders relevanten Faktoren in ähnlichem Maße reagieren. Der vorliegende Aufsatz ist das Ergebnis eines Forschungsprojekts im Auftrag des Mediennetzwerks NRW, einer Tochterfirma der Film- und Medienstiftung NRW.

Background: The application of virtual and augmented reality technologies to orthopaedic surgery training and practice aims to increase the safety and accuracy of procedures and reducing complications and costs. The purpose of this systematic review is to summarise the present literature on this topic while providing a detailed analysis of current flaws and benefits. Methods: A comprehensive search on the PubMed, Cochrane, CINAHL, and Embase database was conducted from inception to February 2021. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used to improve the reporting of the review. The Cochrane Risk of Bias Tool and the Methodological Index for Non-Randomized Studies (MINORS) was used to assess the quality and potential bias of the included randomized and non-randomized control trials, respectively. Results: Virtual reality has been proven revolutionary for both resident training and preoperative planning. Thanks to augmented reality, orthopaedic surgeons could carry out procedures faster and more accurately, improving overall safety. Artificial intelligence (AI) is a promising technology with limitless potential, but, nowadays, its use in orthopaedic surgery is limited to preoperative diagnosis. Conclusions: Extended reality technologies have the potential to reform orthopaedic training and practice, providing an opportunity for unidirectional growth towards a patient-centred approach.

Virtual environments and immersive technologies are growing in popularity for human factors purposes. Whether it is training in a low-risk environment or using simulated environments for testing future automated vehicles, virtual environments show promise for the future of our field. The purpose of this session is to have current human factors practitioners and researchers demonstrate their immersive technologies. This is the eighth iteration of the “Me and My VE” interactive session. Presenters in this session will provide a brief introduction of their virtual reality, augmented reality, or virtual environment work before engaging with attendees in an interactive demonstration period. During this period, the presenters will each have a multimedia display of their immersive technology as well as discuss their work and development efforts. The selected demonstrations cover issues of designing immersive interfaces, military and medical training, and using simulation to better understand complex tasks. This includes a mix of government, industry, and academic-based work. Attendees will be virtually immersed in the technologies and research presented allowing for interaction with the work being done in this field.

Escape Rooms are presently considered a very popular social entertainment activity, with increasing popularity in education field, since they are considered capable of stimulating the interest of players/students and enhancing learning. The combined game mechanics have led to blended forms of Escape Rooms, the Serious Escape Games (SEGs) and the hybrid type of Escape Rooms that uses Augmented Reality (AR)/Virtual Reality technology, a type that is expected to be widely used in the future. In the current study, the MillSecret is presented, a multi-player Serious Escape Game about local cultural heritage, where the players must solve a riddle about the cultural asset of watermills. MillSecret uses AR technology and it was designed to be conducted in the real-physical environment and in an informal educational context. The paper describes the game, its implementation, the playing process, and its evaluation, which aimed to study the feasibility of game conduction in outdoor settings and the views and experience of players with the game, the local cultural heritage and local history. Evaluation results reveal, among other findings, a very positive first feedback from players that allows us to further evolve the development of the game.