Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Automatic moving object segmentation methods under varying illumination conditions for video data: comparative study, and an improved method

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent past, many moving object segmentation methods under varying lighting changes have been proposed in literature and each of them has their own benefits and limitations. The various methods available in literature for moving object segmentation may be broadly classified into four categories i.e., moving object segmentation methods based on (i) motion information (ii) motion and spatial information (iii) learning (iv) and change detection. The objective of this paper is two-fold i.e., firstly, this paper presents a comprehensive comparative study of various classical as well as state-of-the art methods for moving object segmentation under varying illumination conditions under each of the above mentioned four categories and secondly this paper presents an improved approximation filter based method in complex wavelet domain and its comparison with other methods under four categories mentioned as above. The proposed approach consist of seven steps applied on given video frames which include: wavelet decomposition of frames using Daubechies complex wavelet transform; use of improved approximate median filter on detail co-efficient (LH, HL, HH); use of background modeling on approximate co-efficient (LL sub-band); soft thresholding for noise removal; strong edge detection; inverse wavelet transformation for reconstruction; and finally using closing morphology operator. The qualitative and quantitative comparative study of the various methods under four categories as well as the proposed method is presented for six different datasets. The merits, demerits, and efficacy of each of the methods under consideration have been examined. The extensive experimental comparative analysis on six different challenging benchmark data sets demonstrate that proposed method is performing better to other state-of-the-art moving object segmentation methods and is well capable of dealing with various limitations of existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Avcibas I, Sankur B, Sayood K (2002) Statistical evaluation of image quality measure. J Electron Imaging 11(2):206–223

    Article  Google Scholar 

  2. Baradarani A (2008) Moving object segmentation using 9/7-10/8 dual tree complex filter bank. In proceeding of IEEE 19th International Conference on Pattern Recognition (ICPR), Tampa 1–4

  3. Baradarani A, Wu QMJ (2010) Wavelet based moving object segmentation: from scalar wavelets to dual-tree complex filter banks. In Herout A, Pattern recognition recent advances, ISBN 978-953-7619-90-9, In Tech Publication

  4. Bradski GR, Davis JW (2002) Motion segmentation and pose recognition with motion history gradients. Int J Mach Vis Appl 13(3):174–184

    Article  Google Scholar 

  5. Bucak S, Gunsel B, Gursoy O (2007) Incremental non-negative matrix factorization for dynamic background modeling. International Workshop on Pattern Recognition in Information Systems, Funchal

    Google Scholar 

  6. Butler D, Sridharan S, Bove VM Jr (2003) Real-time adaptive background segmentation. IEEE Int Conf Acoust Speech Signal Process 3:349–352

    MATH  Google Scholar 

  7. Cavallaro A, Ebrahimi T (2001) Change detection based on color edges, circuits and systems. IEEE int. symposium, 141–144

  8. Cheng F, Huang S, Ruan S (2010) Advanced motion detection for intelligent video surveillance systems. ACM Symposium on Applied Computing, Lausanne

    Book  Google Scholar 

  9. Cheung S-C, Kamath C (2004) Robust techniques for background subtraction in urban traffic video. Proc SPIE 5308 Conf Vis Commun Image Process 5308:881–892

    Google Scholar 

  10. Chien S-Y, Ma S-Y, Chen L-G (2002) Efficient moving object segmentation algorithm using background registration technique. IEEE Trans Circ Syst Video Technol 12(7):577–586

    Article  Google Scholar 

  11. Cristani M, Farenzena M, Bloisi D, Murino V (2010) Background subtraction for automated multisensor surveillance: a comprehensive review. EURASIP J Adv Sig Process 24

  12. Cucchiara R, Grana C, Piccardi M, Prati A (2003) Detecting moving objects, ghosts, and shadows in video streams. IEEE Trans Pattern Anal Mach Intell 25(10):1337–1442

    Article  Google Scholar 

  13. Culbrik D, Marques O, Socek D, Kalva H, Furht B (2007) Neural network approach to background modeling for video object segmentation. IEEE Trans Neural Netw 18(6):1614–1627

    Article  Google Scholar 

  14. Daubechies, Ten Lectures on wavelets, SIAM

  15. Di Stefano L, Tombari F, Mattoccia S (2007) Robust and accurate change detection under sudden illumination variations. In ACCV workshop on multi-dimensional and multi-view image processing

  16. Elhabian SY, El-Sayed KM, Ahmed SH (2008) Moving object detection in spatial domain using background removal techniques - state-of-art. Recent Pat Comput Sci 1:32–54

    Article  Google Scholar 

  17. Ellis L, Zografos V (2013) Online learning for fast segmentation of moving objects. 11th Asian Conf Comput Vis 7725:52–65

    Google Scholar 

  18. Eskicioglu AM, Fisher PS (1995) Image quality measures and their performance. IEEE Trans Commun 43(12):2959–2965

    Article  Google Scholar 

  19. Gao-bo Y, Zhao-yang Z (2004) Objective performance evaluation of video segmentation algorithms with ground-truth. J Shanghai Univ (Engl Ed) 8(1):70–74

    Article  Google Scholar 

  20. Hsia C-H, Guo J-M (2014) Efficient modified direction al lifting-based discrete wavelet transform for moving object detection. J Signal Process 96:138–152

    Article  Google Scholar 

  21. Hu W, Tan T (2006) A survey on visual surveillance of object motion and behaviors. IEEE Trans Syst Man Cybern 34(3):334–352

    Article  Google Scholar 

  22. Huang JC, Hsieh WS (2003) Wavelet based moving object segmentation. Electron Lett 39(19):1380–1382

    Article  Google Scholar 

  23. Huang JC, Su TS, Wang LJ, Hsieh WS (2004) Double change detection method for wavelet based moving object segmentation. Electron Lett 40(13):798–799

    Article  Google Scholar 

  24. Ivanov Y, Bobick A, Li J (1998) Fast lighting independent background subtraction. In proceeding of IEEE workshop on visual surveillance, 49–55

  25. Jalal AS, Singh V (2012) A framework for background modelling and shadow suppression for moving object detection in complex wavelet domain. Multimedia Tools and Applications, Springer

  26. Karmann K-P, Brandt AV, Gerl R (1990) Moving object segmentation based on adaptive reference images. In Signal processing V: theories and application, Elsevier

  27. Kato J, Watanabe T, Joga S, Rittscher J, Blake A (2002) An HMM based segmentation method for traffic monitoring movies. IEEE Trans Patt Recog Mach Intell 24(9):1291–1296

    Article  Google Scholar 

  28. Khare M, Srivastava RK, Khare A (2014) Single change detection-based moving object segmentation by using Daubechies complex wavelet transform. IET Image Process (ISSN 1751–9659) 8(6):334–344

    Article  Google Scholar 

  29. Khare A, Tiwary US, Pedrycz W, Jeon M (2010) Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform. Imaging Sci J 58(6):340–358

    Article  Google Scholar 

  30. Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real time foreground background segmentation using codebook model. J Real Time Imaging 11(3):172–185

    Article  Google Scholar 

  31. Kim C, Hwang J-N (2002) Fast and automatic video object segmentation and tracking for content-based applications. IEEE Trans Circ Syst Video Technol 12(2):122–129

    Article  Google Scholar 

  32. Kim C, Hwang J-N (2002) Fast and automatic video object segmentation and tracking for content-based applications. IEEE Trans Circ Syst Video Technol 12:122–129

    Article  Google Scholar 

  33. Kim M, Jeon JG, Kwak JS, Lee MH, Ahn C (2001) Moving object segmentation in video sequences by user interaction and automatic object tracking. Image Vis Comput 19(5):245–260

    Article  Google Scholar 

  34. Kushwaha AKS, Sharma CM, Khare M, Prakash O, Khare A (2014) Adaptive real-time motion segmentation technique based on statistical background model. Imaging Sci J (ISSN: 1743-131X) 62(5):285–302

    Article  Google Scholar 

  35. Kushwaha AKS, Sharma C, Khare M, Srivastava RK, Khare A (2012) Automatic multiple human detection and tracking for visual surveillance system. In Proc. of IEEE/OSA/iapr international conference on informatics, electronics and vision, 326–331

  36. Liu H, Chen X, Chen Y, Xie C (2006) Double change detection method for moving-object segmentation based on clustering. IEEE ISCAS 2006 circuits and syst, 5027–5030

  37. Liu M-Y, Dai Q-H, Liu X-D, Er G-H (2005) Automatic extraction of initial moving object based on advanced feature and video analysis. Proc Vis Commun Image Process 5960:160–168

    Google Scholar 

  38. Luque R, Lopez-Rodriguez D, Merida-Casermeiro E, Palomo EJ (2008) Video object segmentation with multivalued neural networks. IEEE international conference on hybrid intelligent system, 613–618

  39. Maddalena L, Petrosino A (2008) A self organizing approach to background subtraction for visual surveillance applications. IEEE Trans Image Process 17(7):1729–1736

    Article  MathSciNet  Google Scholar 

  40. Mahmoodi S (2009) Shape based active contour for fast video segmentation. IEEE Signal Process Lett 16(10):857–860

    Article  Google Scholar 

  41. McFarlane N, Schofield C (1995) Segmentation and tracking of piglets in images. Mach Vis Appl 8(3):187–193

    Article  Google Scholar 

  42. Mei X, Ling L (2005) An automatic segmentation method for moving objects based on the spatial-temporal information of video. J Electron 22(5):498–504

    Google Scholar 

  43. Meier T (1988) Segmentation for video object plane extraction and reduction of coding artifacts. PhD Thesis, Department of Electrical and Electronics Engineering, University of Western, Australia

  44. Meier T, Ngan KN (1998) Automatic segmentation of moving objects for video object plane generation. IEEE Trans Circ Syst Video Technol 8(5):525–538

    Article  Google Scholar 

  45. Mitiche A, Bouthemy P (1996) Computation and analysis of image motion: a synopsis of current problems and methods. Int J Comput Vis 19(1):29–55

    Article  Google Scholar 

  46. Oliver N, Rosario B, Pentland A (2000) A bayesian computer vision system for modeling human interactions. IEEE PAMI 22:831–843

    Article  Google Scholar 

  47. Poobal S, Ravindran G (2011) The performance of fractal image compression on different imaging modalities using objective quality measures. Int J Eng Sci Technol 3(1):525–530

    Google Scholar 

  48. Radke RJ, Andra S, Al-Kofahi O, Roysam B (2005) Image change detection algorithms: a systematic survey. IEEE Trans Image Process 14(3):294–307

    Article  MathSciNet  Google Scholar 

  49. Remagnino P, Baumberg A, Grove T, Hogg D, Tan T, Worrall A, Baker K (1997) An integrated traffic and pedestrian model-based vision system. In Proceedings of the eighth British machine vision conference, 380–389

  50. Reza H, Broojeni S, Charkari NM (2009) A new background subtraction method in video sequences based on temporal motion windows. In proceeding of international conference on IT to celebrate S. Charmonman’s 72 birthday, 25.1–25.7

  51. Shih M-Y, Chang Y-J, Fu B-C, Huang C-C (2007) Motion-based back-ground modeling for moving object detection on moving platforms. In Proceedings of the international conference on computer communications and networks, 1178–1182

  52. Snidaro L, Foresti GL (2003) Real-time thresholding with Euler numbers. Pattern Recognit Lett 24(9/10):1533–1544

    Article  MATH  Google Scholar 

  53. Sobral A, Vacavant A (2014) A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos. J Comput Vis Image Underst 122:4–21

    Article  Google Scholar 

  54. Sridhar S (2008) Digital image processing. Oxford Publication, 3rd edition

  55. Stauffer C, Grimson W (1999) Adaptive background mixture models for real-time tracking. IEEE Comput Soc Conf Comput Vis Pattern Recognit (CVPR’99) 2:246–252

    Google Scholar 

  56. Toth D, Aach T, Metzler V (2000) Bayesian spatio-temporal motion detection under varying illumination illumination-invariant change detection. In Proc. of X EUSIPCO, 3–7

  57. Toyama K, Krumm J, Brumitt B, Meyers B (1999) Wall flower: principles and practice of background maintenance. IEEE Int Conf Comput Vis (ICCV) 1:255–261

    Google Scholar 

  58. Wang H, Suter D (2005) Background initialization with a new robust statistical approach. IEEE int. workshop on visual surveillance and performance evaluation of tracking and surveillance

  59. Wren CR, Azarbayejani A, Darrell T, Pentland AP (1997) Pfinder: real-time tracking of the human body. IEEE Trans Pattern Anal Mach Intell 19(7):780–785

    Article  Google Scholar 

  60. Xiaoyan Z, Lingxia L, Xuchun Z (2007) An automatic video segmentation scheme. In Proceeding of IEEE international symposium on intelligent signal processing and communication systems, 272–275

  61. Zivkovic Z, van der Heijden F (2006) Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recogn Lett 27(7):773–780

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science &Engineering, Indian Institute of Technology (BHU), Varanasi, India

    Alok Kumar Singh Kushwaha & Rajeev Srivastava

Authors
  1. Alok Kumar Singh Kushwaha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajeev Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alok Kumar Singh Kushwaha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kushwaha, A.K.S., Srivastava, R. Automatic moving object segmentation methods under varying illumination conditions for video data: comparative study, and an improved method. Multimed Tools Appl 75, 16209–16264 (2016). https://doi.org/10.1007/s11042-015-2927-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2927-4

Keywords