Autonomous Exploration of Unknown Indoor Environments for High-Quality Mapping Using Feature-Based RGB-D SLAM
Abstract
:1. Introduction
- A novel exploration strategy was developed using the number of features and their distribution uniformity score in 3D, thereby achieving better mapping quality using feature-based RGB-D SLAM.
- A generalized Voronoi path planner was modified and implemented to keep the robot on a fixed road map of paths. Moreover, we ensured the same path was taken between any two positions (i.e., back-and-forth), to increase the probability of accurate loop closure detection. The robot also had the maximum clearance from any obstacle in the investigated, narrow real-world environments.
- A comprehensive and intensive evaluation of our proposed autonomous exploration system was conducted in three real-world, complex, indoor scenarios, with its performance compared to the FBE approach.
2. Related Works
3. Autonomous Exploration System
3.1. Generation of Goal Candidates
3.2. Evaluation of Goal Candidates
3.3. Next Goal Strategy
3.4. Path Planning
4. Experiments and Discussion
4.1. Hardware
4.2. Software
4.3. Low-Texture Experiment
4.4. Moderate-Texture Experiment
4.5. Texture-Rich Experiment
5. Conclusions
- A GVD path planner was modified to keep the robot on a fixed road map to increase the probability of accurate loop closure detection.
- A novel autonomous exploration strategy was proposed specifically for feature-based RGB-D SLAM. The number of features and their distribution were considered to obtain better mapping quality.
- The proposed autonomous exploration system was evaluated in three real-world indoor environments (chosen according to the availability of features). Our evaluation concerned how the mapping quality was enhanced compared to the baseline FBE strategy. To that end, we tested the baseline classical frontier-based strategy (D strategy), our proposed mapping quality strategy (M strategy), and a combination of the two (M+D strategy). The results may be summarized as follows:
- In the low-texture environment, we achieved a high mapping quality, which indicates that when using feature-based SLAM, it is valuable to consider the number of features and their distribution to decide the next goal. The enhancement in mapping quality was significant, i.e., more than 40% in PTPD RMSE for both the M and M+D strategies compared to the D strategy. Moreover, the total path length and exploration time were reduced by nearly 30% and 23% for the M and M+D strategies, respectively, compared to the D strategy.
- In the moderate-texture environment, the enhancement in mapping quality was 15.6% in PTPD RMSE for the M strategy and 13.5% for the M+D strategy. The total exploration path length increased from under 35 to 45 m for the M strategy, but it remained in the same range for the M+D strategy.
- In the texture-rich environment, our strategy only slightly enhanced the mapping quality, i.e., by less than 3% in PTPD RMSE for the M strategy and 10% for the M+D strategy. However, the total path length and exploration time were enhanced by 26% and 34% for the M and M+D strategies, respectively.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Endres, F.; Hess, J.; Sturm, J.; Cremers, D.; Burgard, W. 3-D mapping with an RGB-D camera. IEEE Trans. Robot. 2013, 30, 177–187. [Google Scholar] [CrossRef]
- Engel, J.; Schöps, T.; Cremers, D. LSD-SLAM: Large-scale direct monocular SLAM. In Proceedings of the European Conference on Computer Vision, Zurich, Switzerland, 6–12 September 2014; Springer: Cham, Switzerland; pp. 834–849. [Google Scholar]
- Mur-Artal, R.; Montiel, J.M.M.; Tardos, J.D. ORB-SLAM: A versatile and accurate monocular SLAM system. IEEE Trans. Robot. 2015, 31, 1147–1163. [Google Scholar] [CrossRef] [Green Version]
- Engel, J.; Koltun, V.; Cremers, D. Direct sparse odometry. IEEE Trans. Pattern Anal. Mach. Intell. 2017, 40, 611–625. [Google Scholar] [CrossRef] [PubMed]
- Mur-Artal, R.; Tardós, J.D. Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras. IEEE Trans. Robot. 2017, 33, 1255–1262. [Google Scholar] [CrossRef] [Green Version]
- Kim, P.; Coltin, B.; Kim, H.J. Low-drift visual odometry in structured environments by decoupling rotational and translational motion. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21–25 May 2018; pp. 7247–7253. [Google Scholar]
- Labbé, M.; Michaud, F. RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation. J. Field Robot. 2019, 36, 416–446. [Google Scholar] [CrossRef]
- Schmuck, P.; Chli, M. CCM-SLAM: Robust and efficient centralized collaborative monocular simultaneous localization and mapping for robotic teams. J. Field Robot. 2019, 36, 763–781. [Google Scholar] [CrossRef] [Green Version]
- Zou, Y.; Eldemiry, A.; Li, Y.; Chen, W. Robust RGB-D SLAM using point and line features for low textured scene. Sensors 2020, 20, 4984. [Google Scholar] [CrossRef]
- Shan, T.; Englot, B. Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018; pp. 4758–4765. [Google Scholar]
- Ye, H.; Chen, Y.; Liu, M. Tightly coupled 3d lidar inertial odometry and mapping. In Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada, 20–24 May 2019; pp. 3144–3150. [Google Scholar]
- Rozenberszki, D.; Majdik, A.L. LOL: Lidar-only odometry and localization in 3D point cloud maps. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Virtual, 31 May–31 August 2020; pp. 4379–4385. [Google Scholar]
- Shan, T.; Englot, B.; Meyers, D.; Wang, W.; Ratti, C.; Rus, D. Lio-sam: Tightly-coupled lidar inertial odometry via smoothing and mapping. In Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA, 24 October 2020–24 January 2021; pp. 5135–5142. [Google Scholar]
- Xu, W.; Zhang, F. Fast-lio: A fast, robust lidar-inertial odometry package by tightly-coupled iterated kalman filter. IEEE Robot. Autom. Lett. 2021, 6, 3317–3324. [Google Scholar] [CrossRef]
- Yamauchi, B. Frontier-based exploration using multiple robots. In Proceedings of the Second International Conference on Autonomous Agents, Minneapolis, MN, USA, 9–13 May 1998; pp. 47–53. [Google Scholar]
- González-Banos, H.H.; Latombe, J.-C. Navigation strategies for exploring indoor environments. Int. J. Robot. Res. 2002, 21, 829–848. [Google Scholar] [CrossRef]
- Khatib, O. Real-time obstacle avoidance for manipulators and mobile robots. In Autonomous Robot Vehicles; Springer: Berlin/Heidelberg, Germany, 1986; pp. 396–404. [Google Scholar]
- LaValle, S.M. Rapidly-Exploring Random Trees: A New Tool for Path Planning; Iowa State University: Ames, IA, USA, 1998. [Google Scholar]
- Cieslewski, T.; Kaufmann, E.; Scaramuzza, D. Rapid exploration with multi-rotors: A frontier selection method for high speed flight. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, Canada, 24–28 September 2017; pp. 2135–2142. [Google Scholar]
- Gomez, C.; Hernandez, A.C.; Barber, R. Topological frontier-based exploration and map-building using semantic information. Sensors 2019, 19, 4595. [Google Scholar] [CrossRef] [Green Version]
- Selin, M.; Tiger, M.; Duberg, D.; Heintz, F.; Jensfelt, P. Efficient autonomous exploration planning of large-scale 3-d environments. IEEE Robot. Autom. Lett. 2019, 4, 1699–1706. [Google Scholar] [CrossRef] [Green Version]
- Lu, L.; Redondo, C.; Campoy, P. Optimal frontier-based autonomous exploration in unconstructed environment using RGB-D sensor. Sensors 2020, 20, 6507. [Google Scholar] [CrossRef]
- Mobarhani, A.; Nazari, S.; Tamjidi, A.H.; Taghirad, H.D. Histogram based frontier exploration. In Proceedings of the 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA, 25–30 September 2011; pp. 1128–1133. [Google Scholar]
- Da Silva Lubanco, D.L.; Pichler-Scheder, M.; Schlechter, T. A novel frontier-based exploration algorithm for mobile robots. In Proceedings of the 2020 6th International Conference on Mechatronics and Robotics Engineering (ICMRE), Barcelona, Spain, 12–15 February 2020; pp. 1–5. [Google Scholar]
- CERBERUS. TEAM CERBERUS. Available online: https://www.subt-cerberus.org/ (accessed on 11 June 2022).
- Bellicoso, C.D.; Bjelonic, M.; Wellhausen, L.; Holtmann, K.; Günther, F.; Tranzatto, M.; Fankhauser, P.; Hutter, M. Advances in real-world applications for legged robots. J. Field Robot. 2018, 35, 1311–1326. [Google Scholar] [CrossRef]
- Tranzatto, M.; Mascarich, F.; Bernreiter, L.; Godinho, C.; Camurri, M.; Khattak, S.; Dang, T.; Reijgwart, V.; Loeje, J.; Wisth, D. Cerberus: Autonomous legged and aerial robotic exploration in the tunnel and urban circuits of the darpa subterranean challenge. arXiv 2022, arXiv:2201.07067. [Google Scholar] [CrossRef]
- Tranzatto, M.; Miki, T.; Dharmadhikari, M.; Bernreiter, L.; Kulkarni, M.; Mascarich, F.; Andersson, O.; Khattak, S.; Hutter, M.; Siegwart, R. CERBERUS in the DARPA Subterranean Challenge. Sci. Robot. 2022, 7, eabp9742. [Google Scholar] [CrossRef]
- Hart, P.E.; Nilsson, N.J.; Raphael, B. A formal basis for the heuristic determination of minimum cost paths. IEEE Trans. Syst. Sci. Cybern. 1968, 4, 100–107. [Google Scholar] [CrossRef]
- Stentz, A. The focussed d^* algorithm for real-time replanning. IJCAI 1995, 95, 1652–1659. [Google Scholar]
- Stentz, A. Optimal and efficient path planning for partially known environments. In Intelligent Unmanned Ground Vehicles; Springer: Berlin/Heidelberg, Germany, 1997; pp. 203–220. [Google Scholar]
- Likhachev, M.; Gordon, G.J.; Thrun, S. ARA*: Anytime A* with provable bounds on sub-optimality. Adv. Neural Inf. Process. Syst. 2003, 16, 767–774. [Google Scholar]
- Koenig, S.; Likhachev, M.; Furcy, D. Lifelong planning A∗. Artif. Intell. 2004, 155, 93–146. [Google Scholar] [CrossRef] [Green Version]
- Likhachev, M.; Ferguson, D.I.; Gordon, G.J.; Stentz, A.; Thrun, S. Anytime Dynamic A*: An Anytime, Replanning Algorithm. ICAPS 2005, 5, 262–271. [Google Scholar]
- Bulitko, V.; Lee, G. Learning in real-time search: A unifying framework. J. Artif. Intell. Res. 2006, 25, 119–157. [Google Scholar] [CrossRef] [Green Version]
- Koenig, S.; Likhachev, M. Real-time adaptive A. In Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, Hakodate, Japan, 8–12 May 2006; pp. 281–288. [Google Scholar]
- Dolgov, D.; Thrun, S.; Montemerlo, M.; Diebel, J. Practical search techniques in path planning for autonomous driving. Ann Arbor 2008, 1001, 18–80. [Google Scholar]
- Kuffner, J.J.; LaValle, S.M. RRT-connect: An efficient approach to single-query path planning. In Proceedings of the 2000 ICRA. Millennium Conference, IEEE International Conference on Robotics and Automation, Symposia Proceedings, San Francisco, CA, USA, 24–28 April 2000; pp. 995–1001. [Google Scholar]
- Bruce, J.; Veloso, M.M. Real-time randomized path planning for robot navigation. In Robot Soccer World Cup; Springer: Berlin/Heidelberg, Germany, 2002; pp. 288–295. [Google Scholar]
- Kuwata, Y.; Teo, J.; Fiore, G.; Karaman, S.; Frazzoli, E.; How, J.P. Real-time motion planning with applications to autonomous urban driving. IEEE Trans. Control Syst. Technol. 2009, 17, 1105–1118. [Google Scholar] [CrossRef]
- Karaman, S.; Frazzoli, E. Sampling-based algorithms for optimal motion planning. Int. J. Robot. Res. 2011, 30, 846–894. [Google Scholar] [CrossRef]
- Karaman, S.; Walter, M.R.; Perez, A.; Frazzoli, E.; Teller, S. Anytime motion planning using the RRT. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 1478–1483. [Google Scholar]
- Gammell, J.D.; Srinivasa, S.S.; Barfoot, T.D. Informed RRT*: Optimal sampling-based path planning focused via direct sampling of an admissible ellipsoidal heuristic. In Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA, 14–18 September 2014; pp. 2997–3004. [Google Scholar]
- Janson, L.; Schmerling, E.; Clark, A.; Pavone, M. Fast marching tree: A fast marching sampling-based method for optimal motion planning in many dimensions. Int. J. Robot. Res. 2015, 34, 883–921. [Google Scholar] [CrossRef]
- Lau, B.; Sprunk, C.; Burgard, W. Improved updating of Euclidean distance maps and Voronoi diagrams. In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 October 2010; pp. 281–286. [Google Scholar]
- Lau, B.; Sprunk, C.; Burgard, W. Efficient grid-based spatial representations for robot navigation in dynamic environments. Robot. Auton. Syst. 2013, 61, 1116–1130. [Google Scholar] [CrossRef]
- Fedorenko, R.; Gurenko, B. Local and global motion planning for unmanned surface vehicle. MATEC Web Conf. 2016, 42, 01005. [Google Scholar] [CrossRef] [Green Version]
- ROS.org. voronoi_planner. Available online: http://wiki.ros.org/voronoi_planner (accessed on 25 May 2022).
- Microsoft. Azure Kinect DK. Available online: https://azure.microsoft.com/en-us/services/kinect-dk/ (accessed on 25 May 2022).
- Kobuki, I. Turtlebot2. Available online: http://kobuki.yujinrobot.com/about2/ (accessed on 25 May 2022).
- Hörner, J. Map-Merging for Multi-Robot System. Bachelor’s Thesis, Charles University, Prague, Czech Republic, 2016. [Google Scholar]
- Intel®. Intel® NUC Kit NUC6i7KYK. Available online: https://ark.intel.com/content/www/us/en/ark/products/89187/intel-nuc-kit-nuc6i7kyk.html (accessed on 25 May 2022).
- ROS.org. explore_lite. Available online: http://wiki.ros.org/explore_lite (accessed on 25 May 2022).
- ROS.org. move_base. Available online: http://wiki.ros.org/move_base (accessed on 25 May 2022).
- Besl, P.J.; McKay, N.D. Method for registration of 3-D shapes. In Proceedings of the Sensor Fusion IV: Control Paradigms and Data Structures, Boston, MA, USA, 12–15 November 1991; pp. 586–606. [Google Scholar]
- Li, J. A practical O (N2) outlier removal method for point cloud registration. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 44, 3926–3939. [Google Scholar] [CrossRef]
- Li, J.; Hu, Q.; Ai, M. Point cloud registration based on one-point ransac and scale-annealing biweight estimation. IEEE Trans. Geosci. Remote Sens. 2021, 59, 9716–9729. [Google Scholar] [CrossRef]
- Li, J.; Hu, Q.; Zhang, Y.; Ai, M. Robust symmetric iterative closest point. ISPRS J. Photogramm. Remote Sens. 2022, 185, 219–231. [Google Scholar] [CrossRef]
- Leica Geosystems. Leica BLK360 Imaging Laser Scanner. Available online: https://leica-geosystems.com/products/laser-scanners/scanners/blk360 (accessed on 25 May 2022).
- Leica Geosystems. Leica RTC360 3D Laser Scanner. Available online: https://leica-geosystems.com/products/laser-scanners/scanners/leica-rtc360 (accessed on 25 May 2022).
Strategy_trial | RMSE (cm) | STD (cm) | #LC | L (m) | T (s) |
---|---|---|---|---|---|
D_1 | 8.94 | 6.80 | 0 | 35.08 | 191.3 |
D_2 | 10.36 | 7.70 | 0 | 31.14 | 179.1 |
D_3 | 7.95 | 5.91 | 11 | 69.88 | 436.1 |
Average | 9.08 | 6.80 | 3.7 | 45.37 | 268.8 |
M_1 | 6.02 | 4.74 | 2 | 23.74 | 140.6 |
M_2 | 4.96 | 3.80 | 7 | 37.57 | 206.2 |
M_3 | 4.83 | 3.61 | 4 | 36.44 | 186.4 |
Average | 5.27 | 4.05 | 4.3 | 32.59 | 177.7 |
Enhancement | 41.9% | 40.5% | +0.6 loops | 28.2% | 33.9% |
M+D_1 | 5.06 | 4.03 | 18 | 43.07 | 258.9 |
M+D_2 | 4.90 | 3.66 | 3 | 27.25 | 154.9 |
M+D_3 | 5.12 | 4.21 | 11 | 36.63 | 200.8 |
Average | 5.03 | 3.97 | 10.7 | 35.65 | 204.9 |
Enhancement | 44.6% | 41.7% | +7 loops | 21.4% | 23.8% |
Strategy_trial | RMSE (cm) | STD (cm) | #LC | L (m) | T (s) |
---|---|---|---|---|---|
D_1 | 7.58 | 5.82 | 0 | 33.89 | 204.0 |
D_2 | 8.92 | 6.58 | 0 | 34.29 | 206.6 |
D_3 | 6.76 | 5.31 | 2 | 34.92 | 225.3 |
Average | 7.75 | 5.90 | 0.7 | 34.37 | 212.0 |
M_1 | 6.88 | 5.54 | 50 | 51.98 | 297.2 |
M_2 | 6.67 | 5.24 | 36 | 38.98 | 238.1 |
M_3 | 6.09 | 4.82 | 22 | 42.13 | 244.7 |
Average | 6.55 | 5.20 | 36 | 44.36 | 260.0 |
Enhancement | 15.6% | 12% | +35 loops | −29% | −22% |
M+D_1 | 6.96 | 5.60 | 27 | 37.33 | 220.3 |
M+D_2 | 6.30 | 4.98 | 2 | 34.85 | 214.3 |
M+D_3 | 6.86 | 5.36 | 31 | 42.90 | 243.2 |
Average | 6.71 | 5.31 | 20 | 38.36 | 225.9 |
Enhancement | 13.5% | 10.0% | +19 loops | −11% | −6% |
Strategy_trial | RMSE (cm) | STD (cm) | #LC | L (m) | T (s) |
---|---|---|---|---|---|
D_1 | 5.74 | 4.25 | 12 | 30.46 | 191.0 |
D_2 | 6.37 | 4.51 | 8 | 40.18 | 266.7 |
D_3 | 5.79 | 4.49 | 4 | 36.70 | 240.0 |
Average | 5.97 | 4.42 | 8 | 35.78 | 232.6 |
M_1 | 6.04 | 4.65 | 17 | 37.88 | 238.6 |
M_2 | 4.16 | 3.22 | 13 | 19.21 | 117.7 |
M_3 | 7.33 | 5.21 | 10 | 21.54 | 160.3 |
Average | 5.84 | 4.36 | 13.3 | 26.21 | 172.2 |
Enhancement | 2.1% | 1.3% | +5 loops | 26.7% | 26.0% |
M+D_1 | 5.44 | 4.10 | 4 | 13.84 | 90.8 |
M+D_2 | 5.30 | 4.02 | 15 | 29.69 | 192.5 |
M+D_3 | 5.42 | 4.15 | 11 | 27.33 | 175.3 |
Average | 5.39 | 4.09 | 10 | 23.62 | 152.9 |
Enhancement | 9.7% | 7.4% | +2 loops | 34.0% | 34.3% |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Eldemiry, A.; Zou, Y.; Li, Y.; Wen, C.-Y.; Chen, W. Autonomous Exploration of Unknown Indoor Environments for High-Quality Mapping Using Feature-Based RGB-D SLAM. Sensors 2022, 22, 5117. https://doi.org/10.3390/s22145117
Eldemiry A, Zou Y, Li Y, Wen C-Y, Chen W. Autonomous Exploration of Unknown Indoor Environments for High-Quality Mapping Using Feature-Based RGB-D SLAM. Sensors. 2022; 22(14):5117. https://doi.org/10.3390/s22145117
Chicago/Turabian StyleEldemiry, Amr, Yajing Zou, Yaxin Li, Chih-Yung Wen, and Wu Chen. 2022. "Autonomous Exploration of Unknown Indoor Environments for High-Quality Mapping Using Feature-Based RGB-D SLAM" Sensors 22, no. 14: 5117. https://doi.org/10.3390/s22145117
APA StyleEldemiry, A., Zou, Y., Li, Y., Wen, C.-Y., & Chen, W. (2022). Autonomous Exploration of Unknown Indoor Environments for High-Quality Mapping Using Feature-Based RGB-D SLAM. Sensors, 22(14), 5117. https://doi.org/10.3390/s22145117