Multimodal collaboration for crime scene investigation in mediated reality

In this paper, we present an innovative mediated reality-oriented, real-time software system designed to support multimodal collaboration among remote CSI experts and forensic investigators at the crime scene. Our prototype integrates state-of-the art technologies for stereo navigation, 3D digital mapping and adaptive hand gesture-based user interface for natural interaction. The multimodal interface accepts mouse inputs, audio and hand gestures possibly while interacting with a purposively designed physical object. The evaluation done by a panel of international CSI practitioners [5] using an adapted Burkhardt et al. method [1], shows that our prototype system genuinely fits into the common practice of forensic investigation while clearly boosting the quality of collaboration. At the moment, the system is under consideration for routinely being adopted as part of special procedures by The Forensic Institute in The Hague, The Netherlands [6].