Abstract
Forests are potentially and seriously threatened by fires which have caused huge damages and losses of life and properties every year. In general, it is easier to detect smoke than fire in its early stage. Developing an effective and safe smoke detection method is thereby critical for early forest fire fighting and preventing the fire developing into uncontrollable. This paper presents a learning-based fuzzy smoke detection approach intended to achieve an effective and early forest fire detection, while greatly reduce the negative impacts from clouds in the sky, illumination variations, and changes of forest features. First, a fuzzy-logic based smoke detection rule is designed for detecting and segmenting smoke regions in the visual images captured by the camera onboard an unmanned aerial vehicle (UAV). The differences of each two components of red, green, and blue (RGB) model and intensity in hue, saturation, and intensity (HSI) model of images are chosen as inputs of a fuzzy logic rule, while the smoke likelihood is selected as its output. Then, an extended Kalman filter (EKF) is further employed for reshaping the inputs and output of the fuzzy smoke detection rule on-line. It is expected to provide the smoke detection method with additional regulating flexibility adapting to variations of environmental conditions and reliable automatic detection performance. Next, the morphological operation is also adopted to remove imperfections induced by noises and textures distorted nonconvex/concave segments. Finally, extensive studies on several sets of images containing smoke under distinct environmental conditions are conducted to validate the proposed methodology.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Flannigan, M., Cantin, A.S., De Groot, W.J., Wotton, M., Newbery, A., Gowman, L.M.: Global wildland fire season severity in the 21st century. For. Ecology Management. 294, 54–61 (2013)
Le Goff, H., Flannigan, M.D., Bergeron, Y.: Potential changes in monthly fire risk in the eastern Canadian boreal forest under future climate change. Canadian J. For. Res. 39(12), 2369–2380 (2009)
Yuan, C., Zhang, Y.M., Liu, Z.X.: A survey on technologies for automatic forest fire monitoring, detection and fighting using UAVs and remote sensing techniques. Can. J. Forest Res. 45(7), 783–792 (2015)
Ho, C.C.: Machine vision-based real-time early flame and smoke detection. Measurement Sci. Tech. 20(4), 1–13 (2009)
Chen, T.H., Yin, Y.H., Huang, S.F., Ye, Y.T.: The smoke detection for early fire-alarming system based on video processing. IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing. pp. 427–430 (2006)
Yuan, F.: A fast accumulative motion orientation model based on integral image for video smoke detection. Pattern Recognit. Lett. 29(7), 925–932 (2008)
Wei, Z., Wang, X., An, W., Che, J.: Target-tracking based early fire smoke detection in video. International Conference on Image and Graphics. pp. 172–176 (2009)
Yang, J., Chen, F., Zhang, W.: Visual-based smoke detection using support vector machine. Int. Conf. Natural Comput. 4, 301–305 (2008)
Gubbi, J., Marusic, S., Palaniswami, M.: Smoke detection in video using wavelets and support vector machines. Fire Saf. J. 44(8), 1110–1115 (2009)
Töreyin, B.U., Dedeoğlu, Y., Cetin, A.E.: Wavelet based real-time smoke detection in video. European Conference on Signal Processing. pp. 1–4 (2005)
Töreyin, B.U., Dedeoğlu, Y., Cetin, A.E.: Contour based smoke detection in video using wavelets. European Conference on Signal Processing. pp. 1–4 (2006)
Xu, Z., Xu, J.: Automatic fire smoke detection based on image visual features. International Conference on Computational Intelligence and Security Workshops. pp. 316–319 (2007)
Yu, C.Y., Fang, J., Wang, J.J., Zhang, Y.M.: Video fire smoke detection using motion and color features. Fire Technol. 46(3), 651–663 (2010)
Vicente, J., Guillemant, P.: An image processing technique for automatically detecting forest fire. Int. J. Therm. Sciences. 41(12), 1113–1120 (2002)
Xiong, Z., Caballero, R., Wang, H., Finn, A.M., Lelic, M.A., Peng, P.Y.: Video-based smoke detection: possibilities, techniques, and challenges Fire Suppression and Detection Research and Applications Conference (2007)
Cui, Y., Dong, H., Zhou, E.: An early fire detection method based on smoke texture analysis and discrimination. Congress Image Signal Process. 3, 95–99 (2008)
Lee, C.Y., Lin, C.T., Hong, C.T., Su, M.T.: Smoke detection using spatial and temporal analyses. J. Innovative Comput. Inf. Control. 8(7), 4749–4770 (2012)
Tung, T.X., Kim, J.M.: An effective four-stage smoke-detection algorithm using video images for early fire-alarm systems. Fire Saf. J. 46(5), 276–282 (2011)
Chen, T.H., Wu, P.H., Chiou, Y.C.: An early fire-detection method based on image processing. Int. Conference Image Process. 3, 1707–1710 (2004)
Sugeno, M., Yasukawa, T.: A fuzzy-logic-based approach to qualitative modeling. IEEE Trans. Fuzzy Syst. 1(1), 7–31 (1993)
Ahn, K.K., Truong, D.Q.: Online tuning fuzzy PID controller using robust extended Kalman filter. J. Process Control 19(6), 1011–1023 (2009)
Liu, Z.X., Yuan, C., Zhang, Y.M., Luo, J.: A learning-based fault tolerant tracking control of an unmanned quadrotor helicopter. J. Intell. Robot. Syst. 84(1), 145–162 (2016)
Grewal, M.S.: Kalman filtering. Springer, Berlin (2011)
Acknowledgments
This work was supported in part by the Natural Sciences and Engineering Research Council of Canada, in part by the National Natural Science Foundation of China under Grant 61573282. The authors would like to express their sincere gratitude to the Editor-in-Chief, the Guest Editors, and the anonymous reviewers whose insightful comments have helped to improve the quality of this paper considerably.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work was supported partially by Natural Sciences and Engineering Research Council of Canada.
Rights and permissions
About this article
Cite this article
Yuan, C., Liu, Z. & Zhang, Y. Learning-Based Smoke Detection for Unmanned Aerial Vehicles Applied to Forest Fire Surveillance. J Intell Robot Syst 93, 337–349 (2019). https://doi.org/10.1007/s10846-018-0803-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-018-0803-y