Metapunch X: Combing Multidisplay and Exertion Interaction for Watching and Playing E-sports in Multiverse

E-sports events have become more popular. In the Olympics Esports Series, ten items were included in the official competition; four were exergames, and only one implemented extended reality (XR). However, there are no games that apply the encountered-type haptic feedback with exertion interaction. Also, these esports games are only broadcast on screen, resulting in a lack of sense of presence in the virtual world. In our work, we introduce Metapunch X, an encountered-type haptic feedback esports game that integrates exertion interaction in XR with multi-screen spectating. The game is designed as an asymmetric competition, utilizing an XR head-mounted display (HMD) and a substitutional reality robot to create an esports experience with encountered-type haptic feedback. To enhance the audiences’ experience, in addition to the third-person perspective broadcast, we provide 360-degree live streaming available on mobile devices and virtual reality (VR) HMD, allowing audiences to immerse themselves in the virtual environment and experience the competition as if they were personally present at the venue and feel like engaging in a multiverse.