Abstract
This paper presents a framework for simulating the visual tracking of low orbit space platforms such as satellites to be captured by a space manipulator system intended to conduct assembly, maintenance, or deorbiting operations. The video stream from the International Space Station, publicly available, is used as background for an animated overlay of the target platform moving within the field of view of the camera. A real-synthetic video is generated in Blender in different daytime observation conditions, allowing also the introduction of light sources for simulating the sun or its reflection of Earth’s surface. Additionally, completely synthetic videos are created using a rendered model of the Earth, which allows for a variety of relative orientations for the camera. In order to illustrate the application of the developed framework with a particular visual tracking method, the Continuously Adaptive Mean-Shift (CAMShift) algorithm is evaluated considering a satellite platform as the target to be tracked with different approaching trajectories, illumination conditions, and background. The initial detection phase in dark scenes is enhanced introducing a Fast Line Detector (FLD) stage in a modified implementation, exploiting the linear segments typically found on satellites and solar panel arrays. The performance of the algorithm is evaluated in different conditions using the generated videos.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Papadopoulos, E., Aghili, F., Ma, O., Lampariello, R.: Robotic manipulation and capture in space: a survey. Front. Robot. AI 228 (2021)
Tatsch, A., Fitz-Coy, N., Gladun, S.: On-orbit servicing: a brief survey. In: Proceedings of the IEEE International Workshop on Safety, Security, and Rescue Robotics (SSRR 2006), pp. 276–281 (2006)
Flores-Abad, A., Ma, O., Pham, K., Ulrich, S.: A review of space robotics technologies for on-orbit servicing. Prog. Aerosp. Sci. 68, 1–26 (2014)
Li, W.-J., et al.: On-orbit service (OOS) of spacecraft: a review of engineering developments. Prog. Aerosp. Sci. 108, 32–120 (2019)
Li, D., Zhong, L., Zhu, W., Xu, Z., Tang, Q., Zhan, W.: A survey of space robotic technologies for on-orbit assembly. Space: Sci. Technol. 2022 (2022)
Zhao, P., Liu, J., Wu, C.: Survey on research and development of on-orbit active debris removal methods. Sci. China Technol. Sci. 63(11), 2188–2210 (2020)
Biesbroek, R., Innocenti, L., Wolahan, A., Serrano, S.M.: e. deorbit-esa’s active debris removal mission. In: Proceedings of the 7th European Conference on Space Debris, vol. 10. ESA Space Debris Office (2017)
Medina, A., et al.: Towards a standardized grasping and refuelling on-orbit servicing for geo spacecraft. Acta Astronaut. 134, 1–10 (2017)
Christian, J.A., Cryan, S.: A survey of lidar technology and its use in spacecraft relative navigation. In: AIAA Guidance, Navigation, and Control (GNC) Conference, p. 4641 (2013)
Wilde, M., Clark, C., Romano, M.: Historical survey of kinematic and dynamic spacecraft simulators for laboratory experimentation of on-orbit proximity maneuvers. Prog. Aerosp. Sci. 110, 100552 (2019)
Lepcha, P., Purio, C., Angelo M.: Image dataset taken by 1u cubesat constellation in the low earth orbit. Mendeley Data (2023)
Werth, M., Lucas, J., Kyono, T., McQuaid, I., Fletcher, J.: Silo: a machine learning dataset of synthetic ground-based observations of LEO satellites. In: 2020 IEEE Aerospace Conference, pp. 1–8, IEEE (2020)
Aarestad, J., et al.: Challenges and opportunities for cubesat detection for space situational awareness using a CNN. In: 34th Annual Small Satellite Conference (2020)
Suarez, A., Heredia, G., Ollero, A.: Cooperative sensor fault recovery in multi-UAV systems. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 1188–1193. IEEE (2016)
Suarez, A., Heredia, G., Ollero, A.: Cooperative virtual sensor for fault detection and identification in multi-UAV applications. J. Sens. 2018 (2018)
Exner, D., Bruns, E., Kurz, D., Grundhöfer, A., Bimber, O.: Fast and robust camshift tracking. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pp. 9–16. IEEE (2010)
Huang, S., Hong, J.: Moving object tracking system based on Camshift and Kalman filter. In: 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet), pp. 1423–1426. IEEE (2011)
Li, J., Ning, Z., He, S., Lee, C.-H., Zhao, S.: Three-dimensional bearing-only target following via observability-enhanced helical guidance. IEEE Trans. Robot. (2022)
NASA. Live high-definition views from the international space station (official nasa stream). https://www.youtube.com/watch?v=KG6SL6Mf7ak. Accessed 23 July 2023
Rong, Z.: Earth rendering. https://assetstore.unity.com/packages/vfx/shaders/earth-rendering-free-54914. Accessed 24 July 2023
Acknowledgments
This work was supported by the ROBMIND project (Robots aéreos inteligentes para inspección y mantenimiento de instalaciones industriales, PDC2021-121524-I00) funded by the Spanish Ministerio de Ciencia e Innovacion, and by the Smart Robotics for On-Orbit Servicing Applications (AROSA, CPP-2021-008629) project funded by the Spanish Ministry of Science and Innovation.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Suarez, A., Gonzalez, J., Scalvini, A., Ollero, A. (2024). Visual Tracking of Synthetic Space Platforms in Low Orbit Using International Space Station Video Stream and Rendered Earth Model. In: Marques, L., Santos, C., Lima, J.L., Tardioli, D., Ferre, M. (eds) Robot 2023: Sixth Iberian Robotics Conference. ROBOT 2023. Lecture Notes in Networks and Systems, vol 976. Springer, Cham. https://doi.org/10.1007/978-3-031-58676-7_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-58676-7_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-58675-0
Online ISBN: 978-3-031-58676-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)