Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

Tracking people across disjoint camera views by an illumination-tolerant appearance representation

  • Special issue paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Tracking single individuals as they move across disjoint camera views is a challenging task since their appearance may vary significantly between views. Major changes in appearance are due to different and varying illumination conditions and the deformable geometry of people. These effects are hard to estimate and take into account in real-life applications. Thus, in this paper we propose an illumination-tolerant appearance representation, which is capable of coping with the typical illumination changes occurring in surveillance scenarios. The appearance representation is based on an online k-means colour clustering algorithm, a data-adaptive intensity transformation and the incremental use of frames. A similarity measurement is also introduced to compare the appearance representations of any two arbitrary individuals. Post-matching integration of the matching decision along the individuals‘ tracks is performed in order to improve reliability and robustness of matching. Once matching is provided for any two views of a single individual, its tracking across disjoint cameras derives straightforwardly. Experimental results presented in this paper from a real surveillance camera network show the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bar-Shalom, Y., Jaffer, A.G.: Adaptive nonlinear filtering for tracking with measurements of uncertain origin. In: IEEE Conference Decision and Control, New Orleans, pp. 243–247 (1972)

  2. Wren C., Azarbayejani A., Darrell T. and Pentland A. (1997). Pfinder: real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19(7): 780–785

    Article  Google Scholar 

  3. Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Who? When? Where? What? A real time system for detection and tracking people. In: IEEE Conference on Automatic Face and Gesture Recognit, pp. 222–227 (1998)

  4. Lipton, A., Fujiyoshi, H., Patil, R.: Moving target classification and tracking from real-time video. In: Proceedings of the IEEE Image Understanding Workshop, pp. 129–136 (1998)

  5. Varona, X., Gonzalez, J., Roca, F.X., Villanueva, J.J.: Track: image-based probabilistic tracking of people. Int. Conf. Pattern Recognit. 3:1110–1113 (2000)

    Google Scholar 

  6. McKenna, S., Raja, Y., Gong, S.: Tracking color objects using adaptive mixture models. Image Vis. Comput. 17:225–231 (1999)

    Google Scholar 

  7. Fuentes, L.M., Velastin, S.A.: People tracking in surveillance applications. In: Proceedings of the IEEE Workshop on Performance Evaluation of Tracking and Surveillance (PETS2001) (2001)

  8. Tao H., Sawhney H.S. and Kumar R. (2002). Object tracking with Bayesian estimation of dynamic layer representations. IEEE Trans. Pattern Anal. Mach. Intelli. 24(1): 75–8

    Article  Google Scholar 

  9. Zhao T. and Nevatia R. (2004). Tracking multiple humans in complex situations. IEEE Trans. Pattern Anal. Mach. Intell. 26(9): 1208–1221

    Article  Google Scholar 

  10. Huang, T., Russell, S.J.: Object identification in a Bayesian context. In: Proceedings of IJCAI 1997, pp. 1276–1283 (1997)

  11. Orwell, J., Remagnino, P., Jones, G.A.: Multi-camera colour tracking. In: Proceedings of the IEEE International Workshop on Visual Surveillance, June 26, Fort Collins, Co, pp. 14–21 (1999)

  12. Chang, T.H., Gong, T.H.: Tracking multiple people with a multi-camera system. In: Proceedings of the IEEE Workshop on Multi-Object Tracking, pp. 19–26 (2001)

  13. Javed O., Rasheed Z., Shafique K. and Shah M. (2003). Tracking across multiple cameras with disjoint views. IEEE Int. Conf. Compu. Vis. 2: 952–957

    Article  Google Scholar 

  14. Javed O., Shafique K. and Shah M. (2005). Appearance modeling for tracking in multiple non-overlapping cameras. IEEE CS Conf. Comput. Vis. Pattern Recognit. 2: 26–33

    Google Scholar 

  15. Piccardi, M., Cheng, E.D.: Multi-frame moving objects track matching based on an incremental Major Color Spectrum histogram matching algorithm. In: IEEE International Workshop on Object Tracking and Classification in and Beyond the Visible Spectrum (OTCBVS’05), San Diego, CA, USA, June 20, 2005

  16. Weiss Y. (2001). Deriving intrinsic images from image sequences. IEEE Conf. Comput. Vis. 2: 68–75

    Google Scholar 

  17. Matsushita Y., Nishino K., Ikeuchi K. and Sakauchi M. (2004). Illumination normalization with time-dependent intrinsic images for video surveillance. IEEE Trans. Pattern Anal. Mach. Intell. 26(10): 1336–1347

    Article  Google Scholar 

  18. Li, L., Leung, M.K.H.: Robust change detection by fusing intensity and texture differences. In: Proceedings CVPR 2001, vol. 1, pp. 777–784 (2001)

  19. Zhang H.J., Wu J., Zhong D. and Smoliar S.W. (1997). An integrated system for content-based video retrieval and browsing. Pattern Recognit. 30(4): 643–658

    Article  Google Scholar 

  20. Rubner Y., Tomasi C. and Guibas L.J. (2000). The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2): 99–121

    Article  MATH  Google Scholar 

  21. Hu J. and Mojsolovic A. (2000). Optimum color composition matching of images. IEEE Conf. Pattern Recognit. 4: 47–51

    Google Scholar 

  22. Lu W. and Tan Y.P. (2001). A color histogram based people tracking system. IEEE Int. Symp. Circuits Syst. 2: 137–140

    Google Scholar 

  23. Senior, A., Hampapur, A., Tian, Y.-L., Brown, L., Pankanti, S., Bolle, R.: Appearance models for occlusion handling PETS. , (2001)

  24. Zivkovic, Z., Krose, B.: An EM-like algorithm for color-histogram-based object tracking. IEEE Conf. Comput. Vis. Pattern Recognit. (2004)

  25. Li, L., Huang, W., Gu, I.Y.H., Leman, K., Tian, Q.: Principal color representation for tracking persons. In: Proceedings of SMC 2003, vol. 1, pp. 1007–1012 (2003)

  26. Lloyd S.P. (1982). Least squares quantization in PCM. IEEE Trans. Inform. Theory 28: 129–137

    Article  MATH  MathSciNet  Google Scholar 

  27. Zhou S.K. and Chellappa R. (2006). From sample similarity to ensemble similarity: probabilistic distance measures in reproducing kernel Hilbert space. IEEE Trans. Pattern Anal. Machine Intell. 28(6): 917–929

    Article  Google Scholar 

  28. Madden, C., Piccardi, M.: Height measurement as a session-based biometric for people matching across disjoint camera views. In: IEEE Conference on Image and Vision Computing New Zealand, Dunedin, New Zealand, pp. 282–286 (2005)

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, University of Technology, Sydney (UTS), PO Box 123, Broadway, NSW, 2007, Australia

    Christopher Madden, Eric Dahai Cheng & Massimo Piccardi

Authors
  1. Christopher Madden
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eric Dahai Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Massimo Piccardi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Massimo Piccardi.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Madden, C., Cheng, E.D. & Piccardi, M. Tracking people across disjoint camera views by an illumination-tolerant appearance representation. Machine Vision and Applications 18, 233–247 (2007). https://doi.org/10.1007/s00138-007-0070-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-007-0070-6

Keywords

Search

Navigation