Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2426656.2426686acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

Efficient background subtraction for real-time tracking in embedded camera networks

Published: 06 November 2012 Publication History

Abstract

Background subtraction is often the first step of many computer vision applications. For a background subtraction method to be useful in embedded camera networks, it must be both accurate and computationally efficient because of the resource constraints on embedded platforms. This makes many traditional background subtraction algorithms unsuitable for embedded platforms because they use complex statistical models to handle subtle illumination changes. These models make them accurate but the computational requirement of these complex models is often too high for embedded platforms. In this paper, we propose a new background subtraction method which is both accurate and computational efficient. The key idea is to use compressive sensing to reduce the dimensionality of the data while retaining most of the information. By using multiple datasets, we show that the accuracy of our proposed background subtraction method is comparable to that of the traditional background subtraction methods. Moreover, real implementation on an embedded camera platform shows that our proposed method is at least 5 times faster, and consumes significantly less energy and memory resources than the conventional approaches. Finally, we demonstrated the feasibility of the proposed method by the implementation and evaluation of an end-to-end real-time embedded camera network target tracking application.

References

[1]
M. Afanasyev, D. O'Rourke, B. Kusy, and W. Hu. Heterogeneous traffic performance comparison for 6lowpan enabled low-power transceivers. In Proceedings of the 6th Workshop on Hot Topics in Embedded Networked Sensors (HotEmNets '10), pages 10:1--10:5, New York, NY, USA, 2010. ACM.
[2]
Y. Benezeth, P. Jodoin, B. Emile, H. Laurent, and C. Rosenberger. Review and evaluation of commonly-implemented background subtraction algorithms. In 19th International Conference on Pattern Recognition (ICPR '08), pages 1--4, Dec 2008.
[3]
Z. I. Botev, J. F. Grotowski, and D. P. Kroese. Kernel density estimation via diffusion. Annals of Statistics, 38:2916--2957, 2010.
[4]
E. Candes and E. J. The restricted isometry property and its implications for compressed sensing. Comptes Rendus Mathematique., 346:589--592, 2008.
[5]
E. Candes, J. Romberg, and T. Tao. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 52:489--509, Feb 2006.
[6]
V. Cevher, A. Sankaranarayanan, M. F. Duarte, D. Reddy, R. G. Baraniuk, and R. Chellappa. Compressive sensing for background subtraction. In Proceedings of the 10th European Conference on Computer Vision (ECCV '08), pages 155--168, Berlin, Heidelberg, 2008. Springer-Verlag.
[7]
P. Corke, J. Liu, D. Moore, and T. Wark. Design and evaluation of an image analysis platform for low-power, low-bandwidth camera networks. In Workshop on Applications, Systems, and Algorithms for Image Sensing (ImageSense '08), Nov 2008.
[8]
M. Cossalter, M. Tagliasacchi, and G. Valenzise. Privacy-enabled object tracking in video sequences using compressive sensing. In 6th IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '09), pages 436--441, Sept 2009.
[9]
D. Donoho. Compressed sensing. IEEE Transactions on Information Theory, 52:1289--1306, April 2006.
[10]
M. Duarte, M. Davenport, D. Takhar, J. Laska, T. Sun, K. Kelly, and R. Baraniuk. Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine, 25:83--91, March 2008.
[11]
A. M. Elgammal, D. Harwood, and L. S. Davis. Non-parametric model for background subtraction. In Proceedings of the 6th European Conference on Computer Vision (ECCV '00), pages 751--767, London, UK, 2000. Springer-Verlag.
[12]
A. O. Ercan, A. El Gamal, and L. J. Guibas. Object tracking in the presence of occlusions via a camera network. In Proceedings of the 6th International Conference on Information Processing in Sensor Networks (IPSN '07), pages 509--518, New York, NY, USA, 2007. ACM.
[13]
N. Friedman and S. Russell. Image segmentation in video sequences: a probabilistic approach. In Proceedings of the 13th conference on Uncertainty in artificial intelligence (UAI '97), pages 175--181, San Francisco, CA, USA, 1997. Morgan Kaufmann Publishers Inc.
[14]
S. Funiak, C. Guestrin, M. Paskin, and R. Sukthankar. Distributed localization of networked cameras. In Proceedings of the 5th International Conference on Information Processing in Sensor Networks (IPSN '06), pages 34--42, New York, NY, USA, 2006. ACM.
[15]
E. Hayman and J.-O. Eklundh. Statistical background subtraction for a mobile observer. In 9th IEEE International Conference on Computer Vision (ICCV '03), pages 67--74, Oct 2003.
[16]
L. Jacques, P. Vandergheynst, A. Bibet, V. Majidzadeh, A. Schmid, and Y. Leblebici. CMOS compressed imaging by random convolution. In 34th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '09), pages 1113--1116, April 2009.
[17]
A. Kamthe, L. Jiang, M. Dudys, and A. Cerpa. Scopes: Smart cameras object position estimation system. In Proceedings of the 6th European Conference on Wireless Sensor Networks (EWSN '09), pages 279--295, Berlin, Heidelberg, 2009. Springer-Verlag.
[18]
D.-U. Lee, H. Kim, S. Tu, M. Rahimi, D. Estrin, and J. D. Villasenor. Energy-optimized image communication on resource-constrained sensor platforms. In Proceedings of the 6th International Conference on Information Processing in Sensor Networks (IPSN '07), pages 216--225, New York, NY, USA, 2007. ACM.
[19]
F. Li, J. Barabas, and A. L. Santos. Live photo mosaic with a group of wireless image sensors. In Proceedings of the 7th ACM Conference on Embedded Networked Sensor Systems (Sensys '09), pages 359--360, New York, NY, USA, 2009. ACM.
[20]
S. Mallat and Z. Zhang. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing, 41:3397--3415, Dec 1993.
[21]
J. Pilet, C. Strecha, and P. Fua. Making background subtraction robust to sudden illumination changes. In European Conference on Computer Vision (ECCV '08), pages 567--580. Springer Berlin Heidelberg, 2008.
[22]
M. Prasant, H. Wen, Y. Mingrui, and S. Jha. Efficient cross-correlation via sparse representation in sensor networks. In Proceedings of the 11th International Conference on Information Proceeding in Sensor Networks (IPSN '12). ACM, 2012.
[23]
D. Reddy, A. Sankaranarayanan, V. Cevher, and R. Chellappa. Compressed sensing for multi-view tracking and 3-d voxel reconstruction. In 15th IEEE International Conference on Image Processing (ICIP '08), pages 221--224, Oct 2008.
[24]
J. Romberg. Compressive sensing by random convolution. SIAM Journal on Imaging Sciences, 2:1098--1128, 2009.
[25]
D. Russell and S. Gong. A highly efficient block-based dynamic background model. In 3th IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '05), pages 417--422, Sept 2005.
[26]
C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. In 12th IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '99), pages 246--252, 1999.
[27]
Z. Tang and Z. Miao. Fast background subtraction and shadow elimination using improved gaussian mixture model. In IEEE International Workshop on Haptic, Audio and Visual Environments and Games (HAVE '07), pages 38--41, Oct 2007.
[28]
P. H. S. Torr and A. Zisserman. Feature based methods for structure and motion estimation. In Proceedings of the International Workshop on Vision Algorithms: Theory and Practice (ICCV '09), pages 278--294, London, UK, 2000. Springer-Verlag.
[29]
C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland. Pfinder: real-time tracking of the human body. In IEEE Transaction on Pattern Analysis and Machine Intelligence, volume 19, pages 780--785, Jul 1997.
[30]
C. Wu, H. Aghajan, and R. Kleihorst. Real-time human posture reconstruction in wireless smart camera networks. In Proceedings of the 7th International Conference on Information Processing in Sensor Networks (IPSN '08), pages 321--331, Washington, DC, USA, 2008. IEEE Computer Society.
[31]
X. Wu and M. Liu. In-situ soil moisture sensing: measurement scheduling and estimation using compressive sensing. In Proceedings of the 11th International Conference on Information Processing in Sensor Networks (IPSN '12), New York, NY, USA, 2012. ACM.
[32]
T. Yan, D. Ganesan, and R. Manmatha. Distributed image search in camera sensor networks. In Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (Sensys' 08), pages 155--168, New York, NY, USA, 2008. ACM.
[33]
Z. Zivkovic. Improved adaptive gaussian mixture model for background subtraction. In 17th International Conference on Pattern Recognition (ICPR '04), volume 2, pages 28--31, Aug 2004.

Cited By

View all
  • (2023)An Efficient Low Complexity Region-of-Interest Detection for Video Coding in Wireless Visual SurveillanceIEEE Access10.1109/ACCESS.2023.324806711(26793-26806)Online publication date: 2023
  • (2023)Computer vision-based hand gesture recognition for human-robot interaction: a reviewComplex & Intelligent Systems10.1007/s40747-023-01173-610:1(1581-1606)Online publication date: 19-Jul-2023
  • (2021)An Overview of Machine Learning within Embedded and Mobile Devices–Optimizations and ApplicationsSensors10.3390/s2113441221:13(4412)Online publication date: 28-Jun-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SenSys '12: Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
November 2012
404 pages
ISBN:9781450311694
DOI:10.1145/2426656
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Gaussian mixture models
  2. background subtraction
  3. compressive sensing
  4. embedded camera networks
  5. object tracking

Qualifiers

  • Research-article

Conference

Acceptance Rates

Overall Acceptance Rate 174 of 867 submissions, 20%

Upcoming Conference

SenSys '24

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)13
  • Downloads (Last 6 weeks)2
Reflects downloads up to 03 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2023)An Efficient Low Complexity Region-of-Interest Detection for Video Coding in Wireless Visual SurveillanceIEEE Access10.1109/ACCESS.2023.324806711(26793-26806)Online publication date: 2023
  • (2023)Computer vision-based hand gesture recognition for human-robot interaction: a reviewComplex & Intelligent Systems10.1007/s40747-023-01173-610:1(1581-1606)Online publication date: 19-Jul-2023
  • (2021)An Overview of Machine Learning within Embedded and Mobile Devices–Optimizations and ApplicationsSensors10.3390/s2113441221:13(4412)Online publication date: 28-Jun-2021
  • (2019)From Real to ComplexACM Transactions on Sensor Networks10.1145/333802615:3(1-32)Online publication date: 9-Aug-2019
  • (2019)OmniTrack: Orientation-aware RFID Tracking with Centimeter-level AccuracyIEEE Transactions on Mobile Computing10.1109/TMC.2019.2949412(1-1)Online publication date: 2019
  • (2019)GaitLock: Protect Virtual and Augmented Reality Headsets Using GaitIEEE Transactions on Dependable and Secure Computing10.1109/TDSC.2018.280004816:3(484-497)Online publication date: 1-May-2019
  • (2018)Sensor-Assisted Multi-View Face Recognition System on Smart GlassIEEE Transactions on Mobile Computing10.1109/TMC.2017.270263417:1(197-210)Online publication date: 1-Jan-2018
  • (2018)Data-Driven Background Subtraction Algorithm for In-Camera Acceleration in Thermal ImageryIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2017.271125928:9(2090-2104)Online publication date: Sep-2018
  • (2018)Orientation-aware RFID tracking with centimeter-level accuracyProceedings of the 17th ACM/IEEE International Conference on Information Processing in Sensor Networks10.1109/IPSN.2018.00057(290-301)Online publication date: 11-Apr-2018
  • (2018)CS-CNN: Enabling Robust and Efficient Convolutional Neural Networks Inference for Internet-of-Things ApplicationsIEEE Access10.1109/ACCESS.2018.28102646(13439-13448)Online publication date: 2018
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media