VR-based Assistance System for Semi-Autonomous Robotic Boats
Pages 877 - 881
Abstract
In this paper we present the concept for a teleoperation system for semi-autonomous robotic boats using virtual reality. This system can be used for monitoring autonomous driving as well as for direct manual control. The integration of live sensor data is possible as well as the integration of past measurement results and their correct registration within the virtual representation. Initial field tests have shown that the technical concept can be used for the envisaged areas of application, from which specific challenges can be derived that are addressed in this paper.
Supplemental Material
MP4 File
Supplemental video
- Download
- 27.80 MB
References
[1]
Eunhee Chang, Hyun Taek Kim, and Byounghyun Yoo. 2020. Virtual Reality Sickness: A Review of Causes and Measurements. International Journal of Human--Computer Interaction (2020).
[2]
Florin Covaciu and Anca-Elena Iordan. 2022. Control of a drone in virtual reality using MEMS sensor technology and machine learning. Micromachines, Vol. 13, 4 (2022), 521.
[3]
Zhao Di, Li Shiqi, Zhu Wenge, and Wang Mingming. 2011. A Haptic Interface for Virtual Reality Based Teleoperation System. Springer. https://doi.org/10.1007/978--3--642--19853--3_55
[4]
Matthew Dunbabin. 2015. Autonomous Greenhouse Gas Sampling Using Multiple Robotic Boats. In FSR (Springer Tracts in Advanced Robotics, Vol. 113), David Wettergreen and Timothy D. Barfoot (Eds.). Springer, 17--30. http://dblp.uni-trier.de/db/conf/fsr/fsr2015.html#Dunbabin15
[5]
Matthew David Dunbabin and Alistair Grinham. 2010. Experimental evaluation of an Autonomous Surface Vehicle for water quality and greenhouse gas emission monitoring. In ICRA. IEEE, 5268--5274. http://dblp.uni-trier.de/db/conf/icra/icra2010.html#DunbabinG10
[6]
Matthew David Dunbabin and Alistair Grinham. 2017. Quantifying Spatiotemporal Greenhouse Gas Emissions Using Autonomous Surface Vehicles. J. Field Robotics, Vol. 34, 1 (2017), 151--169. http://dblp.uni-trier.de/db/journals/jfr/jfr34.html#DunbabinG17
[7]
Mike Eichhorn, Christoph Ament, Marco Jacobi, Torsten Pfützenreuter, Divas Karimanzira, Kornelia Bley, Michael Boer, and Henning Wehde. 2018. Modular AUV System with Integrated Real-Time Water Quality Analysis. Sensors, Vol. 18, 6 (2018), 1837. http://dblp.uni-trier.de/db/journals/sensors/sensors18.html#EichhornAJPKBBW18
[8]
Mike Eichhorn, Ralf Taubert, Christoph Ament, Marco Jacobi, and Torsten Pfützenreuter. 2017. Modular AUV System for Sea Water Quality Monitoring and Management. CoRR, Vol. abs/1702.08094 (2017). http://dblp.uni-trier.de/db/journals/corr/corr1702.html#EichhornTAJP17
[9]
Sebastian Gnatzig, Frederic Chucholowski, Tito Tang, and Markus Lienkamp. 2013. A System Design for Teleoperated Road Vehicles. In International Conference on Informatics in Control, Automation and Robotics. https://api.semanticscholar.org/CorpusID:46122663
[10]
Hooman Hedayati, Michael Walker, and Daniel Szafir. 2018. Improving Collocated Robot Teleoperation with Augmented Reality. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction (Chicago, IL, USA) (HRI '18). Association for Computing Machinery, New York, NY, USA, 78--86. https://doi.org/10.1145/3171221.3171251
[11]
Amin Hosseini and Markus Lienkamp. 2016. Enhancing telepresence during the teleoperation of road vehicles using HMD-based mixed reality. In 2016 IEEE Intelligent Vehicles Symposium (IV). 1366--1373. https://doi.org/10.1109/IVS.2016.7535568
[12]
Abderrahmane Kheddar, Ee Sian Neo, Riichiro Tadakuma, and Kazuhito Yokoi. 2007. Enhanced Teleoperation Through Virtual Reality Techniques. In Advances in Telerobotics, Manuel Ferre, Martin Buss, Rafael Aracil, Claudio Melchiorri, and Carlos Balaguer (Eds.). Springer Tracts in Advanced Robotics, Vol. 31. Springer, 139--159. http://dblp.uni-trier.de/db/series/star/star31.html#KheddarNTY07
[13]
Mårten Lager and Elin A. Topp. 2019. Remote Supervision of an Autonomous Surface Vehicle using Virtual Reality. IFAC-PapersOnLine (2019). 10th IFAC Symposium on Intelligent Autonomous Vehicles IAV 2019.
[14]
Xiaoling Lv, Minglu Zhang, Feng Cui, and Xiaoli Zhang. 2006. Teleoperation of Robot Based on Virtual Reality. In ICAT Workshops. IEEE Computer Society, 400--403. http://dblp.uni-trier.de/db/conf/icat/icat2006w.html#LvZCZ06
[15]
David B. Merwe, Leendert Maanen, Frank B. Haar, Roelof J. E. Dijk, Nirul Hoeba, and Nanda Stap. 2019. Human-Robot Interaction During Virtual Reality Mediated Teleoperation: How Environment Information Affects Spatial Task Performance and Operator Situation Awareness. Springer. https://doi.org/10.1007/978--3-030--21565--1_11
[16]
Alexandre Monferrer and David Bonyuet. 2002. Cooperative Robot Teleoperation through Virtual Reality Interfaces. In IV. IEEE Computer Society, 243--248. http://dblp.uni-trier.de/db/conf/iv/iv2002.html#MonferrerB02
[17]
Luciano Nava-Balanzar, José Luis Sánchez-Gaytán, Fernando Fonseca-Navarro, Tomás Salgado-Jiménez, Luis Govinda Garc'ia-Valdovinos, O Rubio-Lopez, Alfonso Gómez-Espinosa, and A Ramirez-Martinez. 2017. Towards Teleoperation and Automatic Control Features of an Unmanned Surface Vessel-ROV System: Preliminary Results. In ICINCO (2). 292--299.
[18]
Francisco Navarro, Javier Fdez, Mario Garzón, Juan Jesús Roldán, and Antonio Barrientos. 2018. Integrating 3D Reconstruction and Virtual Reality: A New Approach for Immersive Teleoperation. Springer. https://doi.org/10.1007/978--3--319--70836--2_50
[19]
Stefan Neumeier, Nicolas Gay, Clemens Dannheim, and Christian Facchi. 2018. On the way to autonomous vehicles teleoperated driving. In AmE 2018-Automotive meets Electronics; 9th GMM-Symposium. VDE, 1--6.
[20]
Sebastian Pose, Stefan Reitmann, Gero Jörn Licht, Thomas Grab, and Tobias Fieback. 2023. AI-Prepared Autonomous Freshwater Monitoring and Sea Ground Detection by an Autonomous Surface Vehicle. Remote Sensing, Vol. 15, 3 (2023), 860.
[21]
Jun Ryu, Seunghoon Park, and Gerard Jounghyun Kim. 2023. Sickness Reduction in FPV Drone Control: Improved Effects of Reverse Optical Flow with Static Landmarks Only. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology. 1--2.
[22]
Andreas Schimpe, Johannes Feiler, Simon Hoffmann, Domagoj Majstorovic, and Frank Diermeyer. 2022. Open Source Software for Teleoperated Driving. In 2022 International Conference on Connected Vehicle and Expo (ICCVE). 1--6. https://doi.org/10.1109/ICCVE52871.2022.9742859
[23]
Cezary Specht, Emilian 'Switalski, and Mariusz Specht. 2017. Application of an autonomous/unmanned survey vessel (ASV/USV) in bathymetric measurements. Polish Maritime Research (2017).
[24]
Michael E. Walker, Hooman Hedayati, and Daniel Szafir. 2019. Robot Teleoperation with Augmented Reality Virtual Surrogates. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 202--210. https://doi.org/10.1109/HRI.2019.8673306
[25]
Kandai Watanabe and Masaki Takahashi. 2020. Head-synced Drone Control for Reducing Virtual Reality Sickness. Journal of Intelligent & Robotic Systems, Vol. 97, 3--4 (2020), 733--744. https://doi.org/10.1007/s10846-019-01054--6
Index Terms
- VR-based Assistance System for Semi-Autonomous Robotic Boats
Recommendations
A mobile robot with autonomous climbing and descending of stairs
Mobile robots are used to operate in urban environments, for surveillance, reconnaissance, and inspection, as well as for military operations and in hazardous environments. Some are intended for exploration of only natural terrains, but others also for ...
VR-Enhanced Teleoperation System for a Semi-autonomous Mulitplatform All-Terrain Exploration Vehicle
Virtual, Augmented and Mixed RealityAbstractThis paper presents a research on the integration of a virtual reality (VR) enhanced teleoperation system within the semi-autonomous multi-platform all-terrain exploration vehicle (MAEV). The main objective is to improve the operator’s control and ...
Virtual Teleoperation Setup for a Bimanual Bartending Robot
Extended RealityAbstractThis paper presents the preliminary design of a teleoperation system for a bimanual bartending robot, with reference to the BRILLO (Bartending Robot for Interactive Long Lasting Operations) project. The aim is to simulate the remote control of the ...
Comments
Information & Contributors
Information
Published In
March 2024
1408 pages
ISBN:9798400703232
DOI:10.1145/3610978
- General Chairs:
- Dan Grollman,
- Elizabeth Broadbent,
- Program Chairs:
- Wendy Ju,
- Harold Soh,
- Tom Williams
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 March 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
HRI '24: ACM/IEEE International Conference on Human-Robot Interaction
March 11 - 15, 2024
CO, Boulder, USA
Acceptance Rates
Overall Acceptance Rate 268 of 1,124 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 80Total Downloads
- Downloads (Last 12 months)80
- Downloads (Last 6 weeks)7
Reflects downloads up to 10 Aug 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in