Mixed Reality

Until recently, depth sensing cameras have been used almost exclusively in research due to the high costs of such specialized equipment. With the introduction of the Microsoft Kinect device, realtime depth imaging is now available for the ordinary developer at low expenses and so far it has been received with great interest from both the research and hobby developer community. The underlying OpenNI framework not only allows to extract the depth image from the camera, but also provides tracking information of gestures or user skeletons. In this paper, we present a framework to include depth sensing devices into X3D in order to enhance visual fidelity of X3D Mixed Reality applications by introducing some extensions for advanced rendering techniques. We furthermore outline how to calibrate depth and image data in a meaningful way through calibration for devices that do not already come with precalibrated sensors, as well as a discussion of some of the OpenNI functionality that X3D can benefit from in the future.

Yovcheva, Z., Buhalis, D., Gatzidis, C., & van Elzakker, C. P. (2014). Empirical Evaluation of Smartphone Augmented Reality Browsers in an Urban Tourism Destination Context. International Journal of Mobile Human Computer Interaction (IJMHCI), 6(2), 10-31. http://doi.org/10.4018/ijmhci.2014040102
Abstract Exposure to new and unfamiliar environments is a necessary part of daily life. Effective communication of location-based information through location-based services has become a key concern for cartographers, geographers, human-computer interaction and professional designers alike. Recently, much attention was directed towards Augmented Reality (AR) interfaces. Current research, however, focuses primarily on computer vision and tracking, or investigates the needs of urban residents, already familiar with their environment. Adopting a user-centred design approach, this paper reports findings from an empirical mobile study investigating how tourists acquire knowledge about an unfamiliar urban environment through AR browsers. Qualitative and quantitative data was used in the development of a framework that shifts the perspective towards a more thorough understanding of the overall design space for such interfaces. The authors analysis provides a frame of reference for the design and evaluation of mobile AR interfaces. The authors demonstrate the application of the framework with respect to optimization of current design of AR.

Augmented Reality, Mixed Reality, Metaverse

The Metaverse is the post-reality universe, a perpetual and persistent multiuser environment merging physical reality with digital virtuality. It is based on the convergence of technologies that enable multisensory interactions with virtual environments, digital objects and people such as virtual reality (VR) and augmented reality (AR). Hence, the Metaverse is an interconnected web of social, networked immersive environments in persistent multiuser platforms. It enables seamless embodied user communication in real-time and dynamic interactions with digital artifacts. Its first iteration was a web of virtual worlds where avatars were able to teleport among them. The contemporary iteration of the Metaverse features social, immersive VR platforms compatible with massive multiplayer online video games, open game worlds and AR collaborative spaces.

This study introduces a framework to build a new concept of architectural education based on the idea of Mixed Reality (MR) as a technique of merging real and virtual learning environment, studying its impact on the education curricular contents and the course outline especially in design studio courses to provide new possibilities for innovation design. the study aims to achieve strategies to design a model for architectural design education with the focus on the concept of design studio’s evolution through the analysis of its basic components, between Mind (Think of the human factor), Reality (spatial factor for the design process), Media (tools used in Design) and the work organization in the studio between students and instructor/s and the Design Processes from the pre-design stage to design development stage.

There is evidence that recent developments in Augmented Reality (AR) technology has the potential to be applied as pervasive media on multiple devices in different ways and contexts, especially with low-cost devices including Mobile Augmented Reality (MAR) applications on smart phones or Pocket-PCs. In this paper we present a framework in order to combine the pervasive e-education concept with augmented reality content for e-training. We analyze current research, discuss some examples from ultralight / light sport aircraft maintenance and show how to apply this framework generically. We present a learning engine to deliver this special type of content and provide a further outlook of future research. A user-centered approach must ensure that the developments can stimulate motivation and enhance performance of the end users in different training sessions. The main benefit is, that the end users are enabled to better perceive complex, technical facts, systems and components.

A previous study indicated that peripheral visual information strongly affects the judgment of egocentric distances for users of immersive virtual environments. The experiment described in this document aimed to investigate if these effects could be explained in terms of changes in gait caused by visual information in the extreme periphery. Three conditions with varying degrees of peripheral occlusion were tested and participants' walking characteristics measured. The results indicate that the improvements in distance ...

Mixed Reality, MR, is defined as the integration of real and virtual worlds to create an environment which allows co  -existing of physical and digital objects enabling users to interact with both. MR is a cross of reality, virtual reality including augmented reality and augmented virtuality. With the advent of wireless technologies and ever-increasing integration of the virtual world with the real  world,  MR  has  gained  more  significance  in  the  last  5  years.  Also,  because  of  its  real-life applications in education, gaming, entertainment, medicine, and military. But no technology comes without risks and shortcomings. Thus, MR also faces many threats and attacks which are broadly classified into 5 types namely, input, output, data, user interaction and device protection some of which include latency, data collection, physical device threats, user threats etc. This paper presents a comprehensive analysis of these threats on MR and solutions to mitigate the effects of it

We propose an approach to creating shared mixed realities based on the construction of transparent boundaries between real and virtual spaces. First, we introduce a taxonomy that classifies current approaches to shared spaces according to the three dimensions of transportation, artificiality, and spatiality. Second, we discuss our experience of staging a poetry performance simultaneously within real and virtual theaters. This demonstrates the complexities involved in establishing social interaction between real and virtual spaces and motivates the development of a systematic approach to mixing realities. Third, we introduce and demonstrate the technique of mixed-reality boundaries as a way of joining real and virtual spaces together in order to address some of these problems.

This paper focuses on the computational creation of animated data visualization used to communicate urban analysis and design in a video. The goal is to combine abstract analysis information with concrete qualitative impressions of a location in the case study area of Zurich. Different urban analysis methods are used to procedurally create an animation with the open source software Blender that facilitates also the compositing process of animation with video. The resulting videos are created during an elective course at ETH Zurich. Anticipating the advent of augmented and mixed reality applications for daily life, we elaborate on their usability for urban design, education and collaborative planning with relatively easy to learn video effect methods. Not only different levels of abstraction are visualized but also -inherent to the medium of video -the relation to time.

Japan is a super-aging society, one marked by a steadily silvering population and shrinking birthrates. Social effects range from a decline in intergenerational homes to new tensions between the generations as elders delay retirement or return to work. Towards improving relations between the generations, two versions of an inclusive, intergenerational game employing "shared action," or time-movement synchrony, were developed: a finger-based version inspired by medical exercise technology from gerontology and a smart shoe-based version as a familiar form factor. A series of three exploratory studies were conducted with young Japanese adults and elders. Findings suggest that the foot version was most suitable overall and reveal initial, complex effects of age and gender on empathy measures that can inform affective computing initiatives within and beyond the cultural milieu of modern Japan.

Developments in mixed reality systems in the last decade have provided proof-of-concepts by means of technologytailored usage scenarios. Instead of focusing on the technology required for implementation, we have shifted our focus towards users, investigating the potential impact of such techniques on the actual work practice of industrial designers. Specific activities have been identified during a full ethnographic study conducted by means of Cultural Probes and Workshops with representative participants. We have identified an important task, the creation of mood boards, and have explored how industrial designers perceive the use of mixed reality to support their work by asking them to create a mood board on an existing mixed reality prototype. Participants were enthusiastic about the idea of creating mood boards in mixed reality.

Based on a brief overview of the history of ontology and on some philosophical problems of virtual reality, a new approach to virtuality is proposed. To characterize the representational (information, cognitive, cultural, communication) technologies in the Internet age, I suggest that Aristotle’s dualistic ontological system (which distinguishes between actual and potential being) be complemented with a third form of being: virtuality. In the virtual form of being actuality and potentiality are inseparably intertwined. Virtuality is potentiality considered together with its actualization. In this view, virtuality is reality with a measure, a reality which has no absolute character, but which has a relative nature. This situation can remind us the emergence of probability in the 17th century: then the concept of certainty, now the concept of reality is reconsidered and relativized. Currently, in the descriptions of the world created by representational technologies, there are two coh...

Mixed Reality (MR) applications are becoming very popular in different sectors such as communication, education and entertainment for its extensive application areas and also for the wide adoption of mobile and especially wearable devices. Due to weak computational efficiency and short battery life of these devices, MR applications performance can be hampered. Offloading the MR application burden to the cloud server can be a solution to this problem but this approach also creates high communication latency. Mobile Edge Computing (MEC) is an emerging technology which brings cloud close to the user proximity at the base station and utilizes radio access network for maintaining communication with the users. This paper presents a MEC based MR application for assisting blind and visually impaired people. In the proposed scheme, the computational task is offloaded to the nearest MEC server in order to prolong the battery life of the MR devices. Finally, experimental results based on laten...

In this paper, we describe a method of dynamic creation of interactive presentations for Mixed Reality environments. The presentations are created automatically for collections of multimedia objects arbitrarily arranged in virtual presentation spaces stored in a database. Users can navigate between the spaces using Web and 3D multimedia contents. The objects in each space are presented through a presentation template, which determines both the visualization and the interaction aspects of the presentation. The possible user interactions are described using a novel language called MR-ISL. The presentation templates are coded in X-VRML, a high-level modeling language. The method can be used in various application domains. Examples discussed in the paper relate to presentation of cultural heritage and educational resources.

Augmented reality (AR) makes it possible to create games in which virtual objects are overlaid on the real world, and real objects are tracked and used to control virtual ones. We describe the development of an AR racing game created by modifying an existing racing game, using an AR infrastructure that we developed for use with the XNA game development platform. In our game, the driver wears a tracked video see-through head-worn display, and controls the car with a passive tangible controller. Other players can participate by manipulating waypoints that the car must pass and obstacles with which the car can collide. We discuss our AR infrastructure, which supports the creation of AR applications and games in a managed code environment, the user interface we developed for the AR racing game, the game's software and hardware architecture, and feedback and observations from early demonstrations.

The field of CSCW research emerged with the development of distributed computing systems and attempts to understand the socially organized ('collaborative' or 'cooperative') nature of work in order to embed such systems in the workplace. As a field of interdisciplinary inquiry CSCW was motivated by technological developments and the need to understand the particular contexts within which those developments were intended to resonate. In other words, it is no mere accident that CSCW took work as its topic and resourcethe historical nature of IT research from which the field emerged meant that for all practical purposes it could not be otherwise. Yet times change. IT research moves on. Today mobile, ambient, pervasive, ubiquitous, mixed reality and wearable computing, et cetera, are of fundamental concern to the contemporary computing research community. Furthermore, these developments are accompanied by a movement away from the workplace to focus on diverse settings in everyday life: homes, games, museums, photography, tourism, performances, indeed diverse bodies of people and pursuits that generally fall under the conceptual rubric of the 'ludic'. Accompanying this shift away from work is a call for new approaches and concepts that will enable researchers to better understand the ludic and inform design appropriately. In this paper we seek to address the boundaries of CSCW and the ability of CSCW to respond to contemporary research agendas. We present an ethnomethodological study of a locationbased mixed reality game to demonstrate the continued relevance of CSCW approaches and concepts to contemporary agendas in IT research.

In this paper a set of concepts to design mixed reality systems is presented. The principle of interaction space is proposed and then integrated in a development process, especially, to take into account the mixed reality specifications in the information system design. Models are elaborated to highlight relationships between business and interaction spaces. The development of the proposed method is presented on a case study.

ParticipART is an initiative aimed at exploring participation in interactive works using ubiquitous computing and mixed reality. It supports and analyses work of artists and creative practitioners incorporating or reflecting on participatory processes to support new roles and forms of engagement for art participants. We aim at proposing a space for discussion that can enliven and enrich the dialogue between human-computer interaction and the creative practices. We present several works that have been exhibited and experienced. The works are used to reflect on the different participative strategies and the role of interaction technologies: enabling authorship, affording connectivity, interacting with artificial beings, reinterpreting the visitor world, and engaging in performative acts.

Mixed Reality (MR) technology is a combination of Virtual Reality (VR) and Augmented Reality (AR), which is recently very popular in game engine and art work presentation. In digital fabrication field, robotic technology is still most normally used, because we human beings can't have a live feedback between real world and digital data. However, as the rapid development of MR technology, we can easily add digital data into the real world only by a smartphone and a pair of VR glasses, so now it's possible to build a system to guide human workers to complete nonstandard fabrication jobs instead of robotic arms. So based on the recent researches, the author built an android software and a set of MR equipment. By loading digital model data in the software, the smartphone can recognize a target image through the camera, and figure out the 3D position of this target image, so that the digital model can be shown as an image upon real world image taken by the camera. After wearing the headset equipment , users can see a live updated digital model in the real world space. Using this system, an experimental wooden blocks assembly was tested. Its success points out that, untrained workers can complete nonstandard fabrication works with the help of MR technology. So we can tell, MR technology will be widely used in start-up companies and student research in the future.

The rapid development of Virtual Reality (VR) technology offers new opportunities for the promotion of tourism products and experiences. VR pro-vides potential tourists with a compelling imagery and a chance to get a first im-pression of what it feels like to be at a destination. Previous studies have mostly focused on visual and auditory VR experiences and have rather neglected the possibility of adding additional sensory stimuli, i.e. haptic and olfactory feed-back, to a VR experience. This study is novel in that it takes a multisensory ap-proach to VR and examines its impact on the intention to recommend a destina-tion through the lens of presence. A multi-stage laboratory experiment with 64 participants was conducted. The analysis reveals that the stimulation of additional senses does not lead to a significant enhancement of the user’s sense of presence. However, a significant increase in the user’s intention to recommend a destina-tion can be observed. For destination marketers, this study proposes multisensory VR as a novel and effective tool to positively influence travel recommendations.

Collaborative technologies increasingly permeate our everyday lives. Mixed reality games use these technologies to entertain, motivate, educate, and inspire. We understand mixed reality games as goaldirected, structured play experiences that are not fully contained by virtual or physical worlds. They transform existing technologies, relationships, and places into a platform for gameplay. While the design of mixed reality games and interactive entertainments have received increasing attention across multiple disciplines, a focus on the collaborative potential of mixed reality formats, such as augmented and alternate reality games, has been lacking. We believe the CSCW community can play an essential and unique role in examining and designing the next generation of mixed reality games and technologies that support them. To this end, we seek to bring together researchers, designers, and players to advance an integrated mixed reality games' research canon and outline key opportunities and challenges for future research and development.

User studies need to be perform on the new technology such as Mixed reality
(MR) before it reach maturity. In this paper we would like to reveal the study that has been
done to determine users' perception and acceptance on the mixed reality prototype, named
Mixed Reality Regenerative Concept (MRRC). The aim of MRRC is to increase users
understanding on regenerative concept and tissue engineering.

Reciprocal shading for mixed reality aims to integrate virtual objects into real environments in a way that they are in the ideal case indistinguishable from real objects. It is therefore an attractive technology for architectural visualizations, product visualizations and for cultural heritage sites, where virtual objects should be seamlessly merged with real ones. Due to the improved performance of recent graphics hardware, real-time global illumination algorithms are feasible for mixed-reality applications, and thus more and more researchers address realistic rendering for mixed reality. The goal of this thesis is to provide algorithms which improve the visual plausibility of virtual objects in mixed-reality applications. Our contributions are as follows: First, we present five methods to reconstruct the real surrounding environment. In particular, we present two methods for geometry reconstruction, a method for material estimation at interactive frame rates and two methods to reconstruct the color mapping characteristics of the video see-through camera. Second, we present two methods to improve the visual appearance of virtual objects. The first, called differential instant radiosity, combines differential rendering with a global illumination method called instant radiosity to simulate reciprocal shading effects such as shadowing and indirect illumination between real and virtual objects. The second method focuses on the visual plausible rendering of reflective and refractive objects. The high-frequency lighting effects caused by these objects are also simulated with our method. The third part of this thesis presents two user studies which evaluate the influence of the presented rendering methods on human perception. The first user study measured task performance with respect to the rendering mode, and the second user study was set up as a web survey where participants had to choose which of two presented images, showing mixed-reality scenes, they preferred. v Kurzfassung Reziproke Schattierung für erweiterte Realitäten zielt darauf ab, virtuelle Objekte so in eine reale Umgebung zu integrieren, dass diese im Idealfall nicht von realen Objekten zu unterscheiden sind. Deshalb ist reziproke Schattierung für erweiterte Realitäten eine attraktive Technologie für Architekturvisualisierungen, Produktvisualisierungen oder für Kulturstätten, bei denen virtuelle Objekte nahtlos in die reale Umgebung eingebettet werden sollen. Aufgrund der erhöhten Leistung heutiger Graphikhardware sind nun auch globale Beleuchtungsmethoden für Echtzeitanwendungen möglich, wodurch das wissenschaftliche Interesse an realistischen Darstellungen für erweiterte Realitäten gestiegen ist. Das Ziel dieser Dissertation ist es die visuelle Plausibilität virtueller Objekte für Anwendungen im Bereich der erweiterten Realität zu erhöhen. Folgende Beiträge werden in dieser Arbeit präsentiert: Der erste Abschnitt widmet sich fünf Methoden, die zum Ziel haben die reale Umgebung zu rekonstruieren. Zwei dieser Methoden befassen sich mit der Rekonstruierung der realen Geometrie, eine weitere Methode dient der Schätzung von Materialeigenschaften bei Beibehaltung interaktiver Bildraten. Die verbleibenden beiden Methoden rekonstruieren das Farbabbildungsverhalten der Kamera, über deren Bilder die virtuellen Objekte eingeblendet werden. Der zweite Abschnitt beschreibt zwei Methoden, um die visuelle Plausibilität virtueller Objekte zu verbessern. Die erste Methode nennt sich "differential instant radiosity", welche "differential rendering" und die globale Beleuchtungsmethode "instant radiosity" kombiniert, um reziprokale Schattierungseffekte, wie Schatten und indirekte Beleuchtung zwischen realen und virtuellen Objekten zu simulieren. Die zweite Methode beschäftigt sich mit der visuell plausiblen Darstellung reflektierender und refraktierender Objekte. Die bei solchen Objekten entstehenden hochfrequenten Lichteffekte werden mit dieser Methode ebenfalls simuliert. Der dritte Teil der Dissertation präsentiert zwei Benutzerstudien, welche den Einfluss verschiedener Rendering-Methoden messen. Die erste Studie untersuchte den Einfluss der Rendering-Methoden auf die Dauer mit der verschiedene Aufgabenstellungen von Testpersonen erledigt wurden. Die zweite Studie wurde in Form einer Internetumfrage gestaltet bei der Teilnehmer beurteilten, welche von zwei vorgelegten erweiterten Realitätsbildern, sie subjektiv bevorzugen. vii

The currently applied maintenance strategies, including Reactive and Preventive maintenance can be considered obsolete. The constant improvements in Information and Communication Technologies as well as in Digital Technologies along with the increase of computational power, have facilitated the development of new Artificial Intelligence algorithms to integrate cognition in computational systems. This trend is posing a great challenge for engineers, as such developments will enable the creation of robust systems that can monitor the current status of the machines and by extension to predict unforeseeable situations. Furthermore, Smart Computers will be capable of examining all possible scenarios and suggest viable solutions in a fraction of time compared to humans. Therefore, in this paper, the modelling, design and development of a Predictive Maintenance and Remote Monitoring system are proposed, based on the utilization of Artificial Intelligence algorithms for data acquisition, fusion, and postprocessing. In addition to that, the proposed framework will integrate a Mixed Reality application for the intuitive visualization of the data, that will ultimately facilitate production and maintenance engineers to monitor the condition of the machines, and most importantly to get an accurate prediction of the oncoming failures.

Immersive systems can be used to capture new data, create new experiences, and provide new insights by generating virtual elements of physical and imagined worlds. Immersive systems are seeing increased application across a broad array of fields. However, in many situations it is unknown if an immersive application performs as well or better than the existing application in accomplishing a specific task. The purpose of this study is to conduct a systematic review of the literature that addresses the performance of immersive systems. This review assesses those applications where experiments, tests, or clinical trials have been performed to evaluate the proposed application. This research addresses a broad range of application areas and considers studies that compared one or more immersive systems with a control group or evaluated performance data for the immersive system pre- and post-test. The results identify those applications that have been successfully tested and also delineate areas of future research where more data may be needed to assess the effectiveness of proposed applications.

Borrowing from film and filmmaking styles, techniques and devices that manipulate spectators ’ attention and experience, this paper proposes an approach to inform design of games and gameplay to manipulate player’s focus of attention and encourage contemplation – in design features, characters, story elements, etc. or even break the player’s engaged attention in the game/virtual world altogether – to provide meaning, experience and opportunities for learning. Focusing on film styles alternative to the continuity style of Hollywood filmmaking, we discuss examples of design for contemplative gameplay in game-based learning environments/serious games, machinima and augmented and mixed reality games in previous, current and future projects. We propose that one goal of game design is to establish a rhythm between contemplation and engagement, and the appropriate rhythm is determined largely by a game’s genre, platform and/or narrative.

This study presents an ecosystemic approach to music interaction, through the practice-based development of a mixed reality installation artwork. It fuses a generative, immersive audio composition with augmented reality visualisation, within an architectural space as part of a blended experience. Participants are encouraged to explore and interact with this combination of elements through physical engagement, to then develop an understanding of how the blending of real and virtual space occurs as the installation unfolds. The sonic layer forms a link between the two, as a three-dimensional sound composition. Connections in the system allow for multiple streams of data to run between the layers, which are used for the real-time modulation of parameters. These feedback mechanisms form a complete loop between the participant in real space, soundscape and mixed reality visualisation, providing a participant mediated experience that exists somewhere between creator and observer.

This paper describes the design and implementation of a middleware for a framework dedicated to Augmented Reality / Mixed Reality (AR/MR) applications. The goal is to offer an environment for the development of distributed applications running on mobile devices (wearable computers and/or smartphones). The paper first presents the main needs of an AR application and introduces the necessity of distribution in this field. Then we make a quick overview of existing distributed AR frameworks. The goal of this overview is to extract main features and strengths of each framework's architecture based on a set of defined criteria. This comparison being meant as a starting point to extend our own framework (ARCS: Augmented Reality Component System), the last section is about the design and implementation of our own software infrastructure for transparent distributed Augmented Reality taking in consideration our own goals and constraints and taking profit of the strengths of the studied existing frameworks.

In a general technical sense, Augmented Reality (AR) is considered as primarily a virtual overlay, a datafied window that situates visual or textual information in the physical world. In contradistinction, AR as experimental art practice activates critical inquiry, collective participation, and multimodal perception. Experimental art deployed in the AR medium is contributing to a reconfiguration of traditional perceptions of interface, audience participation, and perceptual experience. This paper explores such experimental AR art practices as examples of 'software assemblage,' a materialist conception that facilitates the movement of AR beyond the conventional empirical borders of the engineering world and toward a poetic re-configuration of AR as experimental art practice.

How may we find new and engaging solutions for access to, and the application of, digital photo archives? Digitized collections continue to be relatively unused and unexploited, despite formidable investments over several decades. Innovation in design and implementation could open the way to a plethora of new techniques for the display and dissemination of digitized resources. In this paper, we explore some new and potentially valuable techniques to enhance use of digitized historical photographs by combining (mobile) Augmented Reality (AR) with elements of gameplay (gamification). To make the design practical, we drew from features found in common 'analogue' games such as the jigsaw puzzle and the 'Hot & Cold' game. In addition to this experimental design for a ‘Photo Positioning Puzzle’, the application includes a dynamic 3D–reconstruction of an historic city square (Raekoja Plats in Old Narva, Estonia), as well as an information layer for access to background information, including additional historical photos and online resources. The system has been tested and assessed by users on location. Our conclusion is that the presented ‘Photo Positioning Puzzle’ and its integration with other forms of mobile AR functionality was successful, and should have general value and suitability for additional historical places with corresponding photo collections and archived documentation.

In this paper we propose a mixed reality system (MRS) and an adaptation module for rehabilitation of the upper limb after stroke through serious games. Aim of the system is to increase intensity and number of training session using the fun factor as driver. Although our system is targeting post stroke patient it is necessary to validate and test our approach with valid users at the first stage to provide patients with stable system to use. These studies and their results are described in this paper.

. EXMAR supports exploration of off-screen view. (a) user's view when using EXMAR (b) magnification of (a) when using EXMAR. User can explore off-screen point of interests with environmental contextual information by simple dragging gesture. Green dot represents augmented tags ( looking through the sequence of images from left to right )

E-learning, virtual learning and mixed reality techniques are now a global integral part of the academic and educational systems. They provide easier access to educational opportunities to a very wide spectrum of individuals to pursue their educational and qualification objectives. These modern techniques have the potentials to improve the quality of the teaching and learning process and elevate its performance to higher standards. Furthermore, e-learning in conjunction with mixed reality techniques can reduce the cost of higher education at both institutional and individual learner levels. In this paper, the focus will be on teaching-learning of applied science such as engineering. These studies demand special requirements, such as acquiring specific technical skills and practices through training. In this paper is the explanation and design of remote laboratories in mixed-reality mode. Decision making and evaluation of performance using fuzzy logic will be embedded in the proposed design.

Response to the comment "Image Fusion and Mixed Reality in Abdominal Surgery" by Federico Gheza & Paolo Raimondi on our paper "Mixed Reality in Visceral Surgery: Development of a Suitable Workflow and Evaluation of Intraoperative Use-cases" (https://journals.lww.com/annalsofsurgery/Abstract/2017/11000/Mixed_Reality_in_Visceral_Surgery__Development_of.4.aspx)