Abstract
Object detection is a vast domain which comprises of various methods of detecting objects efficiently and with good accuracy. Most of the images that we use for detection of objects are RGB images, but what if the images that we are using are captured during adverse weather conditions like foggy, hazy or in bad illumination conditions (during night)? Our model for object detection might not perform well in such cases. To overcome the problem of illumination, images can be captured by an infrared (IR) camera which are robust under such conditions. Thermal images are captured through infrared cameras and they capture the image with the radiation (heat) into visible images, such images are useful in many applications like autonomous driving, military applications, object detection in adverse conditions, etc. It is essential to make use of thermal images and exploit its use to solve many real-world problems faced in object detection. This review tries to analyze the various existing models and design a lightweight network framework for detecting objects under adverse weather conditions in thermal images. The work will primarily focus on comparing various models and review it based on efficiency and appropriateness for specific use cases in thermal dataset. The applications of the robust deep learning models like you only look once (YOLO), convolution neural network (CNN), etc., are analyzed through experimentations and based on the results we find the shortcomings in thermal image object detection space and try to fill the gaps by suggesting a framework of methodology to detect an object and further compress the model using techniques like pruning and knowledge distillation to make the model lightweight so that the research can be extended in this domain even without compromising on the accuracy and disk space to do object detection in thermal imagery. This research can be utilized in various fields to improve accuracy in detection of objects.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Krišto M, Ivasic-Kos M, Pobar M (2020) Thermal object detection in difficult weather conditions using YOLO. IEEE Access 8:125459–125476
Bustos N et al. (2023) A systematic literature review on object detection using near infrared and thermal images. Neurocomputing 126804
Akkaya IB, Altinel F, Halici U (2021) Self-training guided adversarial domain adaptation for thermal imagery. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Kera SB, Tadepalli A, Jennifer Ranjani J (2023) A paced multi-stage block-wise approach for object detection in thermal images. The Visual Computer 39.6:2347–2363
Vs V, Poster D, You S, Hu S, Patel VM (2022) Meta-UDA: unsupervised domain adaptive thermal object detection using meta-learning. In: 2022 IEEE/CVF winter conference on applications of computer vision (WACV), Waikoloa, HI, USA, pp 3697–3706. https://doi.org/10.1109/WACV51458.2022.00375
Ghose D et al. (2019) Pedestrian detection in thermal images using saliency maps. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops
https://www.kaggle.com/datasets/deepnewbie/flir-thermal-images-dataset
Ivašić-Kos M, Krišto M, Pobar M (2019) Human detection in thermal imaging using YOLO. In: Proceedings of the 2019 5th International conference on computer and technology applications
Tumas P, Nowosielski A, Serackis A (2020) Pedestrian detection in severe weather conditions. IEEE Access 8:62775–62784
Ganbayar B et al. (2020) Deep learning-based thermal image reconstruction and object detection. IEEE Access 9:5951–5971
Nima A, Ribeiro E (2021) Combining weight pruning and knowledge distillation for CNN compression. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition
Tsai P-F, Liao C-H, Yuan S-M (2022) Using deep learning with thermal imaging for human detection in heavy smoke scenarios. Sensors 22(14):5351
Mantau AJ et al. (2022) A human-detection method based on YOLOv5 and transfer learning using thermal image data from UAV perspective for surveillance system. Drones 6.10:290
Singha A, Bhowmik MK (2019) Salient features for moving object detection in adverse weather conditions during night time. IEEE Trans Circuits and Syst Video Technol 30.10:3317–3331
Wu J et al. (2023) MENet: Lightweight multimodality enhancement network for detecting salient objects in RGB-thermal images. Neurocomputing 527:119–129
Cong R et al. (2022) Does thermal really always matter for RGB-T salient object detection?. IEEE Trans Multimedia
Luo A et al. (2020) Cascade graph neural networks for RGB-D salient object detection. In: Computer Vision–ECCV 2020: 16th European conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XII 16. Springer International Publishing
Devaguptapu C et al. (2019) Borrow from anywhere: pseudo multi-modal object detection in thermal imagery. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops
Jangblad M (2018) Object detection in infrared images using deep convolutional neural networks
Marinó GC et al. (2023) Deep neural networks compression: a comparative survey and choice recommendations. Neurocomputing 520:152–170
Ozcan A, Cetin O (2022) A novel fusion method with thermal and RGB-D sensor data for human detection. IEEE Access 10:66831–66843
Johansen AS et al. (2023) Who cares about the weather? Inferring weather conditions for weather-aware object detection in thermal images. Appl Sci 13.18:10295
Wu X, Sahoo D, Hoi SCH (2020) Recent advances in deep learning for object detection. Neurocomputing 396:39–64
Knapik M, Cyganek B (2021) Fast eyes detection in thermal images. Multimedia Tools and Appl 80:3601–3621
Munir F et al. (2022) Exploring thermal images for object detection in underexposure regions for autonomous driving. Appl Soft Comput 121:108793
Agrawal K, Subramanian A (2019) Enhancing object detection in adverse conditions using thermal imaging. arXiv preprint arXiv:1909.13551
Farooq MA et al. (2021) Object detection in thermal spectrum for advanced driver-assistance systems (ADAS). IEEE Access 9:156465–156481
Nakaguchi VM, Tofael A (2022) Development of an early embryo detection methodology for quail eggs using a thermal micro camera and the YOLO deep learning algorithm. Sensors 22.15:5820
Jiang C et al. (2022) Object detection from UAV thermal infrared images and videos using YOLO models. Int J Appl Earth Observ Geoinform 112:102912
Sheu M-H et al. (2022) FHI-Unet: faster heterogeneous images semantic segmentation design and edge AI implementation for visible and thermal images processing. IEEE Access 10:18596–18607
Krišto M, Ivašić-Kos M (2019) Thermal imaging dataset for person detection. In: 2019 42nd International convention on information and communication technology, electronics and microelectronics (MIPRO). IEEE
Zhang H, Hong X, Zhu L (2021) Detecting small objects in thermal images using single-shot detector. Autom Control Comput Sci 55(2):202–211
Tu Y, Lin Y (2019) Deep neural network compression technique towards efficient digital signal modulation recognition in edge device. IEEE Access 7:58113–58119
Yim J et al. (2017) A gift from knowledge distillation: fast optimization, network minimization and transfer learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Vibashan VS, Poojan O, Patel VM (2023) Instance relation graph guided source-free domain adaptive object detection. In: 2023 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE
Cheng Y et al. (2017) A survey of model compression and acceleration for deep neural networks. arXiv preprint arXiv:1710.09282
Lyu Z et al. (2023) A survey of model compression strategies for object detection. In: Multimedia tools and applications, pp 1–72
Munir F, Azam S, Jeon M (2021) Sstn: self-supervised domain adaptation thermal object detection for autonomous driving. In: 2021 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Malhotra, H., Ravinder, M. (2024). A Study on Lightweight Object Detection in Thermal Images and Its Recent Advances. In: Hassanien, A.E., Anand, S., Jaiswal, A., Kumar, P. (eds) Innovative Computing and Communications. ICICC 2024. Lecture Notes in Networks and Systems, vol 1024. Springer, Singapore. https://doi.org/10.1007/978-981-97-3817-5_24
Download citation
DOI: https://doi.org/10.1007/978-981-97-3817-5_24
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-3816-8
Online ISBN: 978-981-97-3817-5
eBook Packages: EngineeringEngineering (R0)