SIGGRAPH-ASIA

Motivated by recent availability of augmented and virtual reality platforms, we tackle the challenging problem of immersive storytelling experiences on mobile devices. In particular, we show an end-to-end system to generate 3D assets that enable real-...

Come to the Table! explores whether extended realities (XR) can create a bridge between indigenous people (Māori), descendants from European settlers (Pākehā) and people from other ethnicities, by practicing social inclusion. The experience uses real ...

“Encounters” provides a multiparticipant audiovisual art experience with a cross reality (XR) system which consists of HoloLens units, VIVE Tracker units, SteamVR system and so on. In this experience, participants fire virtual bullets or beams at ...

Supernumerary Robotic Arms (SRAs) can make physical activities easier, but require cooperation with the operator. To improve cooperation, we predict the operator’s intentions by using his/her Facial Expressions (FEs). We propose to map FEs to SRAs ...

Camera-based hand tracking technologies can enable unprecedented interactive contents with gripping impressions of embodiment and immersion. However, current systems are often restricted by the tracking volume of their sensors which results in limited ...

Haptic interaction in virtual reality poses an ongoing research challenge as to how touch sensations are delivered in applications. A simple solution is to have matching physical and virtual counterparts, i.e. a physical switch provides perfect haptic ...

Hyperscanning is a method to detect if brain wave synchronicity exists between two or more individuals, which is usually due to behavioral or social interactions. It is usually limited to neuroscience studies and very rarely used as an interaction or ...

In AR/MR remote collaboration, a remote expert often has to demonstrate tasks for a local worker. To make this easier, we have developed a new adaptive MR remote collaborative architecture which enables a remote expert to guide a local user in physical ...

We introduce a short virtual reality experience highlighting a use-case scenario of distance relocation technique in Redirected Jumping to reduce the size requirements for tracked working space of spatial applications. In our demo, the player traverses ...

Real-time facial projection mapping is a challenging problem due to the low system latency and the high spatial augmentation accuracy requirements. We propose a new compact and inexpensive projector-camera system (ProCam) composed of off-the-self ...

We propose a light-weight 6DoF video production pipeline which uses only one stereo camera as input. The subject can move freely in any direction (lateral and depth) as the stereo camera follows to keep the subject within the frame. DeepKeying, our own ...

Lost City of Mer is a virtual reality (VR) game experience combined with a smartphone app that immerses players in a fantasy undersea civilization devastated by ecological disaster caused by global warning. The project aims to harness the immersive and ...

M-Hair is a novel method for providing tactile feedback by stimulating only body hair. By applying passive magnetic materials to the body hair, these ones responsive to external magnetic forces/fields, creating a new opportunity for interactions, such ...

With the rise of VR applications, the ability to experience physical touches becomes progressively important to increase immersion. In this paper, we propose PhantomTouch, a wearable forearm augmentation, that enables recreation of natural touch ...

In this study, we define physical e-sports that require physical training and show an example of such sport created using a mobile virtual reality system, the VAIR Field. Unlike conventional e-sports, physical e-sports involve physical activities, ...

With the advance of virtual reality (VR) head-mounted display, the appearance of the virtual companion can be more realistic and full of vitality, such as breathing and facial expression. However, the users cannot interact physically with the companions ...

During multi-camera remote collaboration on physical tasks, as the name implies, multiple cameras capture different areas and perspectives of a task space. It can be challenging for the remote user to obtain the right view of the local user and to ...

We developed a vehicle ride simulation system for immersive virtual reality, consisting of a wheelchair for vibration and vestibular sensation, and a pedestal with a curved surface for the wheelchair to run on, utilizing a gravitational component. ...

Supersizehero is an immerse VR game for HTC Vive which puts the player in the role of an overweight hero trying to save the day. A special crafted, tracked fat suit allowing the player to actively use his belly serves as the main gameplay mechanic. The ...

TouchVR is a novel wearable haptic interface which can deliver multimodal tactile stimuli on the palm by DeltaTouch haptic display and vibrotactile feedback on the fingertips by vibration motors for the Virtual Reality (VR) user. DeltaTouch display is ...

Created by Taiwanese artists Hu, Chin-Hsiang, Tsai Bing-Hua and Chang, Zhao-Qing, this piece attempts to use a hybrid reality, LED lights, wearable devices, and fans to build a installation that uploads the human mind to digital space. Imagine that ...

Virtual reality (VR) stories provide an immersive and interactive medium to present narrative content. While it provides an immersive way to present the content, it is challenging to present the story in a way that matches the intention of the producer. ...