Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Automatic target recognition and tracking in forward-looking infrared image sequences with a complex background

  • Regular Paper
  • Control Theory
  • Published:
International Journal of Control, Automation and Systems Aims and scope Submit manuscript

Abstract

This paper presents a technique for automatic airborne target recognition and tracking in forward-looking infrared (FLIR) images with a complex background. An image splitting and merging method is applied for detecting target signals. The presence of a complex background due to clouds and sun glint generates clutter in the image with the resulting possibility of false alarms. A Bayesian classifier trained using the NMI (normalized moment of inertia) feature is proposed for efficient clutter rejection. After classification, target candidates are entered into a tracking filter. As an efficient and robust multi-target tracking filter in cluttered environments, the JDC-JIHPDAF is proposed. Experimental results using a wide range of real FLIR images ensure reliable classification and automatic target recognition performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. B. Bhanu, “Automatic target recognition: state of the art survey,” IEEE Trans. on Aerospace Electronic Systems, vol. AES-22, no. 4, pp. 364–379, July 1986.

    Article  Google Scholar 

  2. B. Bhanu, “Guest editorial introduction to the special issue on automatic target detection and recognition,” IEEE Trans. on Image Processing, vol. 6, no. 1, January 1997.

  3. J. A. Ratches, “Review of current aided/automatic target acquisition technology for military target acquisition tasks,” Optical Engineering, vol. 50, no. 7, July 2011.

  4. S. Richard, F. Sims, and A. Mahalanobis, “Performance evaluation of quadratic correlation filters for target detection and discrimination in infrared imagery,” Optical Engineering, vol. 43, no. 8, pp. 1705–1711, August 2004.

    Article  Google Scholar 

  5. C. F. Olson and D. P. Huttenlocher, “Automatic target recognition by matching oriented edge pixels,” IEEE Trans. on Image Processing, vol. 6, no. 1, pp. 103–113, January 1997.

    Article  Google Scholar 

  6. B. Bhanu and J. Ahn, “A system for model-based recognition of articulated objects,” Proc. of the 14th Conf. Pattern Recognition, vol. 2, pp. 1812–1815, August 1998.

    Google Scholar 

  7. S. Belongie, J. Malik, and J. Puzicha, “Shape matching and object recognition using shape context,” Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509–522, April 2002.

    Article  Google Scholar 

  8. Y. Won, P. D. Gader, and P. C. Coffield, “Morphological shared-weight networks with applications to automatic target recognition,” IEEE Trans. on Neural Networks, vol. 8, no. 5, pp. 1195–1203, September 1997.

    Article  Google Scholar 

  9. U. Braga-Neto and J. Goutsias, “Automatic target detection and tracking in forward-looking infrared image sequences using morphological connected operators,” Journal of Electronic Imaging, vol. 13, no. 4, pp. 802–813, October 2004.

    Article  MathSciNet  Google Scholar 

  10. M. W. Roth, “Survey of neural network technology for automatic target recognition,” IEEE Trans. on Neural Networks, vol. 1, no. 1, pp. 28–43, March 1990.

    Article  Google Scholar 

  11. J. F. khan, M. S. Alam, and S. M. A. Bhuiyan, “Automatic target detection in forward-looking infrared imagery via probabilistic neural networks,” Optical Society of America, vol. 48, no. 3, pp. 464–476, January 2009.

    Google Scholar 

  12. W. Li, C. Pan, and L. Liu, “Saliency-based automatic target detection in forward looking infrared images,” Proc. of IEEE International Conf. on Image Processing, pp. 957–960, November 2009.

  13. S. Arivazhagan and L. Ganesan, “Automatic target detection using wavelet transform,” EURASIP Journal on Advances Signal Processing, vol. 2004, no. 17, pp. 2663–2674, July 2004.

    Article  MATH  Google Scholar 

  14. S. Greenberg, “Region-of-interest-based algorithm for automatic target detection in infrared images,” Optical Engineering, vol. 44, no. 077002, July 2005.

  15. T. H. Kim and T. L. Song, “False alarm reduction for imaging infrared surveillance systems,” Proc. of the 4th International Conf. on Signal and Information Processing, pp. 591–696, October 2011.

  16. R. C. Gonzalez, R. E. Woods, and S. L. Eddins, Digital Image Processing Using MATLAB, 2nd Ed., Prentice Hall, 2009.

  17. N. Otsu, “A threshold selection method from graylevel histograms,” IEEE Trans. on System, Man and Cybernetics, vol. SMC-9, no. 1, pp. 62–66, January 1979.

    MathSciNet  Google Scholar 

  18. P. S. Liao, T. S. Chen, and P. C. Chung, “A fast algorithm for multilevel thresholding,” Journal of Information Science and Engineering, vol. 17, no. 5, pp. 713–727, September 2001.

    Google Scholar 

  19. M. Wei, H. Chen, and T. Y. Yan, “NMI-based small target detecting method,” Proc. of International Conf. on Electrical and Control Engineering, pp. 1363–1366, June 2010.

  20. I.-S. Oh, Pattern Recognition, Kyobobook, August, 2008.

  21. CJC Burges, “A tutorial on support vector machines for pattern recognition,” Journal of Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, June 1998.

    Article  Google Scholar 

  22. G. Ratsch, T. Onoda, and K. R. Muller, “Soft Margins for AdaBoost,” Machine Learning, vol. 42, no. 3, pp. 287–320, March 2001.

    Article  Google Scholar 

  23. Y. Kim and T. L. Song, “A study for improvement of target detection and tracking performance by using target classification methods in a cluttered environment,” Proc. of Conf. on Korea Institute of Military Science and Technology, 2008.

  24. Z. Chen, G. Wang, J. Liu, and C. Liu, “Small target detection algorithm based on average absolute difference maximum and background forecast,” International Journal of Infrared Millimeter Waves, vol. 28, no. 1, pp. 87–97, 2007.

    Article  MathSciNet  Google Scholar 

  25. S. Kim, Y. Yang, and J. Lee, “Robust horizontal target detection with cooperative spatial filtering,” Proc. of the 34th International Conf. on Infrared, Millimeter, and Terahertz Waves, pp. 1–2, September 2009.

  26. R. Grasso and F. Spina, “Small bottom object density analysis from side scan sonar data by a mathematical morphology detector,” Proc. of the 9th International Conf. on Information Fusion, July 2006.

  27. P. Soille, Morphological Image Analysis: Principles and Applications, Springer-Verlag, New York Inc., Secaucus, NJ, USA, 2003.

    MATH  Google Scholar 

  28. L. Jicheng, S. Zhengkang, and L. Tao, “Detection of spot target in infrared clutter with morphological filter,” Proc. of the IEEE Conf. Aerospace and Electronics, vol. 1, pp. 168–172, May 1996.

    Google Scholar 

  29. T. H. Kim and T. L. Song, “Adaptive automatic thresholding in infrared image target tracking,” Journal of Institute of Control, Robotics and Systems (Korean), vol. 17, no. 6, pp. 579–586, June 2011.

    Article  Google Scholar 

  30. C. Rother, V. Kolmogorov, and A. Blake, “Graphcut: interactive foreground extraction using iterated graph cuts,” ACM Trans. on Graphics, vol. 25, no. 3, pp. 309–314, August 2004.

    Article  Google Scholar 

  31. J. Shi and J. Malik, “Normalized cuts and image segmentation,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888–905, August 2006.

    Google Scholar 

  32. L. Shafarenko, M. Petrou, and J. Kittler, “Automatic watershed segmentation of randomly textured color image,” IEEE Trans. on Image Processing, vol. 6, no. 11, pp. 1530–1544, November 1997.

    Article  Google Scholar 

  33. D. Musicki and R. Evans, “Clutter map information for data association and track initialization,” IEEE Trans. on Aerospace and Electronic Systems, vol. 40, no. 2, pp. 387–398, April 2004.

    Article  Google Scholar 

  34. D. Musicki and T. Hanselmann, “Optimal Signal Detection for False Track Discrimination,” Proc. of the 7th International Conf. Information Fusion, pp. 352–357, July 2005.

  35. D. Musicki, R. J. Evans, and S. Stankovic, “Integrated probabilistic data association,” IEEE Trans. on Automatic Control, vol. 39, no. 6, pp. 1237–1241, June 1994.

    Article  MathSciNet  MATH  Google Scholar 

  36. N. Li and X. R. Li, “Target perceivability and its applications,” IEEE Trans. on Signal Processing, vol. 49, no. 11, pp. 2588–2604, November 2001.

    Article  Google Scholar 

  37. X. R. Li and N. Li, “Intelligent PDAF: refinement of IPDAF for target tracking in clutter,” Proc. of the 29th Conf. Pattern Recognition System Theory, pp. 133–137, March 1997.

  38. Y. Bar-Shalom and T. E. Fortmann, Tracking and Data Association, Academic Press, New York, 1988.

    MATH  Google Scholar 

  39. D. Musicki and R. J. Evans, “Joint integrated probabilistic data association-JIPDA,” IEEE Trans. on Aerospace and Electronic Systems, vol. 40, no. 3, pp. 1093–1099, July 2004.

    Article  Google Scholar 

  40. D. Musicki, R. J. Evans, and B. F. La Scala, “Integrated Track Splitting filter-efficient multi-scan single target tracking in clutter,” IEEE Trans. on Aerospace and Electronic Systems. vol. 43, no. 4, pp. 1409–1425, October 2007.

    Article  Google Scholar 

  41. T. L. Song and D. S. Kim, “Highest probability data association for active sonar tracking,” Proc. of the 9th International Conf. Information Fusion, pp. 1–8, July 2006.

  42. D. S. Kim and T. L. Song, “A study of automatic multi-target detection and tracking algorithm using highest probability data association in a cluttered environment,” The Trans. on KIEE, vol. 56, no. 10, pp. 1826–1835, October 2007.

    Google Scholar 

  43. J. S. Bae, A Study for Image Target Auto-detection and Tracking by Using Dynamic Filtering Algorithms in a Cluttered Environment, Ph.D. Dissertation, Hanyang University, February 2008.

Download references

Author information

Authors and Affiliations

  1. Department of Electronic Systems Engineering, Hanyang University, 1271 Sa-1 dong, Sangnok-gu, Ansan, Kyeonggi-do, 426-791, Korea

    Seok Pil Yoon, Taek Lyul Song & Tae Han Kim

Authors
  1. Seok Pil Yoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taek Lyul Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tae Han Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tae Han Kim.

Additional information

Recommended by Editorial Board member Young Jae Lee under the direction of Editor Myotaeg Lim.

This research was supported by the Defense Acquisition Program Administration and Agency for Defense Development, Korea, through the Image Information Research Center at Korea Advanced Institute of Science & Technology under the contract (UD100006CD).

Seok Pil Yoon received his B.S. in Electronics, Information and System Engineering from Hanyang University in 2010. He is currently working toward an M.S. degree at the Department of Electronic, Electrical, Control and Instrumentation Engineering.

Taek Lyul Song received his Ph.D. in Aerospace Engineering from the University of Texas at Austin in 1983. He is a professor in the Department of Electronics and Systems Engineering at Hanyang University. His research interests include target state estimation, guidance, navigation and control.

Tae Han Kim received his M.S. in Electronic, Electrical, Control and Instrumentation Engineering from Hanyang University in 2011. He is currently working toward a Ph.D. degree at the same department. His research interests include target state estimation, data association, and multi-sensor data fusion.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yoon, S.P., Song, T.L. & Kim, T.H. Automatic target recognition and tracking in forward-looking infrared image sequences with a complex background. Int. J. Control Autom. Syst. 11, 21–32 (2013). https://doi.org/10.1007/s12555-011-0226-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12555-011-0226-z

Keywords

Search

Navigation