Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Target coverage in camera networks for manufacturing workplaces

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

In this paper, we investigate the camera network placement problem for target coverage in manufacturing workplaces. The problem is formulated to find the minimum number of cameras of different types and their best configurations to maximise the coverage of the monitored workplace such that the given set of target points of interest are each k-covered with a predefined minimum spatial resolution. Since the problem is NP-complete, and even NP-hard to approximate, a novel method based on Simulated Annealing is presented to solve the optimisation problem. A new neighbourhood generation function is proposed to handle the discrete nature of the problem. The visual coverage is modelled using realistic and coherent assumptions of camera intrinsic and extrinsic parameters making it suitable for many real world camera based applications. Task-specific quality of coverage measure is proposed to assist selecting the best among the set of camera network placements with equal coverage. A 3D CAD of the monitored space is used to examine physical occlusions of target points. The results show the accuracy, efficiency and scalability of the presented solution method; which can be applied effectively in the design of practical camera networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  • Agarwal, K., & Shivpuri, R. (2013). On line prediction of surface defects in hot bar rolling based on bayesian hierarchical modeling. Journal of Intelligent Manufacturing pp. 1–16.

  • Ai, J., & Abouzeid, A. A. (2006). Coverage by directional sensors in randomly deployed wireless sensor networks. Journal of Combinatorial Optimization, 11, 21–41.

    Article  Google Scholar 

  • Alsadik, B. S., Gerke, M., & Vosselman, G. (2012). Optimal camera network design for 3D modeling of cultural heritage. ISPRS annals of photogrammetry, remote sensing and spatial information sciences I–3, 7–12.

  • Álvares, A. J., Ferreira, J. C. E., & Lorenzo, R. M. (2008). An integrated web-based CAD/CAPP/CAM system for the remote design and manufacture of feature-based cylindrical parts. Journal of Intelligent Manufacturing, 19(6), 643–659.

    Article  Google Scholar 

  • Bodor, R., Drenner, A., Schrater, P., & Papanikolopoulos, N. (2007). Optimal camera placement for automated surveillance tasks. Journal of Intelligent and Robotic Systems, 50(3), 257–295.

    Article  Google Scholar 

  • Chen, H., Wu, H., & Tzeng, N. F. (2004). Grid-based approach for working node selection in wireless sensor networks. In: Communications, 2004 IEEE international conference on, Vol. 6, pp. 3673–3678.

  • Chen, J., Khatibi, S., & Kulesza, W. (2007). Planning of a multi stereo visual sensor system—depth accuracy and variable baseline approach. In: 3DTV conference, 2007, pp. 1–4.

  • Chen, S. H., & Perng, D. B. (2014). Automatic optical inspection system for IC molding surface. Journal of Intelligent Manufacturing pp. 1–12.

  • Chen, U. R., Chiou, B. S., Chen, J. M., & Lin, W. (2008). An adjustable target coverage method in directional sensor networks. In: Asia-Pacific services computing conference, 2008. APSCC ’08. IEEE, pp. 174–180.

  • Cheng, W., Li, S., Liao, X., Changxiang, S., & Chen, H. (2007). Maximal coverage scheduling in randomly deployed directional sensor networks. In: Parallel processing workshops, 2007. ICPPW 2007. International conference on, pp. 68–68.

  • Cowan, C., & Kovesi, P. (1988). Automatic sensor placement from vision task requirements. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(3), 407–416.

    Article  Google Scholar 

  • Debaque, B., Jedidi, R., & Prevost, D. (2009). Optimal video camera network deployment to support security monitoring. In: Information Fusion, 2009. FUSION ’09. 12th International conference on, pp. 1730–1736.

  • Eglese, R. W. (1990). Simulated annealing: A tool for operational research. European Journal of Operational Research, 46(3), 271–281.

    Article  Google Scholar 

  • Ehrgott, M., & Gandibleux, X. (2000). A survey and annotated bibliography of multiobjective combinatorial optimization. OR-Spektrum, 22(4), 425–460.

    Article  Google Scholar 

  • Erdem, U. M., & Sclaroff, S. (2003). Automated placement of cameras in a floorplan to satisfy task-specific constraints. Tech. rep.: Boston University.

    Google Scholar 

  • Erdem, U. M., & Sclaroff, S. (2006). Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements. Computer Vision and Image Understanding, 103(3), 156–169.

    Article  Google Scholar 

  • Fleischer, R., & Wang, Y. (2009). On the camera placement problem. In Y. Dong, D. Z. Du, & O. Ibarra (Eds.), Algorithms and Computation (Vol. 5878, pp. 255–264)., Lecture notes in computer science Berlin: Springer.

    Chapter  Google Scholar 

  • Fusco, G., & Gupta, H. (2009). Selection and orientation of directional sensors for coverage maximization. In: Sensor, Mesh and Ad Hoc Communications and networks, 2009. SECON ’09. 6th Annual IEEE communications society conference on, pp. 1–9.

  • Fusco, G., & Gupta, H. (2010). Placement and orientation of rotating directional sensors. In: Sensor Mesh and Ad Hoc communications and networks (SECON), 2010 7th annual IEEE communications society conference on, pp. 1–9.

  • Gonzalez-Barbosa, J. J., Garcia-Ramirez, T., Salas, J., Hurtado-Ramos, J. B., & Rico-Jimenez, J. d. J. (2009). Optimal camera placement for total coverage. In: Robotics and automation, 2009. ICRA ’09. IEEE international conference on, pp. 844–848.

  • Hanoun, S., & Nahavandi, S. (2012). A greedy heuristic and simulated annealing approach for a bicriteria flowshop scheduling problem with precedence constraints - a practical manufacturing case. The International Journal of Advanced Manufacturing Technology, 60(9–12), 1087–1098.

    Article  Google Scholar 

  • Hoffmann, M., Wittke, M., Hähner, J., & Müller-Schloer, C. (2008). Spatial partitioning in self-organizing smart camera systems. IEEE Journal of Selected Topics in Signal Processing, 2(4), 480–492.

    Article  Google Scholar 

  • Hörster, E., & Lienhart, R. (2006a). Approximating optimal visual sensor placement. In: Multimedia and Expo, 2006 IEEE international conference on, pp. 1257–1260.

  • Hörster, E., & Lienhart, R. (2006b). Calibrating and optimizing poses of visual sensors in distributed platforms. Multimedia Systems, 12(3), 195–210.

    Article  Google Scholar 

  • Hörster, E., & Lienhart, R. (2006c). On the optimal placement of multiple visual sensors. Proceedings of the 4th ACM international workshop on video surveillance and sensor networks (pp. 111–120). VSSN ’06 New York, NY: ACM.

  • Huang, C. F., & Tseng, Y. C. (2003). The coverage problem in a wireless sensor network. Proceedings of the 2nd ACM international conference on wireless sensor networks and applications (pp. 115–121). WSNA ’03 New York, NY: ACM.

  • Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220(4598), 671–680.

    Article  Google Scholar 

  • Krüger, J., Lien, T., & Verl, A. (2009). Cooperation of human and machines in assembly lines. CIRP Annals Manufacturing Technology, 58(2), 628–646.

    Article  Google Scholar 

  • Krüger, J., Nickolay, B., Heyer, P., & Seliger, G. (2005). Image based 3D surveillance for flexible man-robot-cooperation. CIRP Annals Manufacturing Technology, 54(1), 19–22.

    Article  Google Scholar 

  • Ma, H., & Liu, Y. (2007). Some problems of directional sensor networks. International Journal of Sensor Networks, 2(1/2), 44–52.

    Article  Google Scholar 

  • Mason, S. O., & Grüen, A. (1995). Automatic sensor placement for accurate dimensional inspection. Computer Vision and Image Understanding, 61(3), 454–467.

    Article  Google Scholar 

  • Megahed, F., & Camelio, J. (2012). Real-time fault detection in manufacturing environments using face recognition techniques. Journal of Intelligent Manufacturing, 23(3), 393–408.

    Article  Google Scholar 

  • Mirsanei, H., Zandieh, M., Moayed, M., & Khabbazi, M. (2011). A simulated annealing algorithm approach to hybrid flow shop scheduling with sequence-dependent setup times. Journal of Intelligent Manufacturing, 22(6), 965–978.

    Article  Google Scholar 

  • Morsly, Y., Aouf, N., Djouadi, M., & Richardson, M. (2012). Particle swarm optimization inspired probability algorithm for optimal camera network placement. IEEE Sensors Journal, 12(5), 1402–1412.

    Article  Google Scholar 

  • Mostafavi, S. A., & Dehghan, M. (2011). Optimal visual sensor placement for coverage based on target location profile. Ad Hoc Networks, 9(4), 528–541.

    Article  Google Scholar 

  • Olague, G., & Mohr, R. (1998). Optimal camera placement to obtain accurate 3D point positions. In: Pattern recognition, 1998. Proceedings. fourteenth international conference on, Vol. 1, pp. 8–10.

  • Olague, G., & Mohr, R. (2002). Optimal camera placement for accurate reconstruction. Pattern Recognition, 35(4), 927–944.

    Article  Google Scholar 

  • Park, J., Bhat, P. C., & Kak, A. C. (2006). A look-up table based approach for solving the camera selection problem in large camera networks. In: Proceedings of the international workshop on distributed smart cameras.

  • Ramachandram, D., & Rajeswari, M. (2004). Neural network-based robot visual positioning for intelligent assembly. Journal of Intelligent Manufacturing, 15(2), 219–231.

    Article  Google Scholar 

  • Saadatseresht, M., Samadzadegan, F., & Azizi, A. (2005). Automatic camera placement in vision metrology based on a fuzzy inference system. Photogrammetric engineering and remote sensing, 71(12), 1375.

    Article  Google Scholar 

  • Shen, C., Zhang, C., & Fels, S. (2007). A multi-camera surveillance system that estimates quality-of-view measurement. In: Image processing, 2007. ICIP 2007. IEEE international conference on, 3, III–193–III–196.

  • Soro, S., & Heinzelman, W. (2007). Camera selection in visual sensor networks. In: Advanced video and signal based surveillance, 2007. AVSS 2007. IEEE conference on, pp. 81–86.

  • Sreedevi, I., Chaitanya, M., Chaudhury, S., & Bhattacharyya, A. (2008). Optimal visual sensor placement using evolutionary algorithm. In: First Biennial national conference on computer vision, pattern recognition, image processing and graphics (NCVPRIPG).

  • Sreedevi, I., Mittal, N. R., Chaudhury, S., & Bhattacharyya, A. (2011). Camera placement for surveillance applications, chap. 22. InTech, Prof. Weiyao Lin (Ed.).

  • Suman, B., & Kumar, P. (2006). A survey of simulated annealing as a tool for single and multiobjective optimization. Journal of the Operational Research Society, 57(18), 1143–1160.

    Article  Google Scholar 

  • Tarabanis, K., Tsai, R., & Allen, P. (1995). The MVP sensor planning system for robotic vision tasks. IEEE Transactions on Robotics and Automation, 11(1), 72–85.

    Article  Google Scholar 

  • Wang, C., Qi, F., & Shi, G. M. (2009a). Nodes placement for optimizing coverage of visual sensor networks. In P. Muneesawang, F. Wu, I. Kumazawa, A. Roeksabutr, M. Liao, & X. Tang (Eds.), Advances in multimedia information processing PCM 2009 (Vol. 5879, pp. 1144–1149)., Lecture notes in computer science Berlin: Springer.

    Chapter  Google Scholar 

  • Wang, J., Niu, C., & Shen, R. (2009b). Priority-based target coverage in directional sensor networks using a genetic algorithm. Computers & Mathematics with Applications, 57(11–12), 1915–1922.

    Article  Google Scholar 

  • Wang, Z., & Bovik, A. (2009). Mean squared error: Love it or leave it? A new look at signal fidelity measures. Signal Processing Magazine, IEEE, 26(1), 98–117.

    Article  Google Scholar 

  • Winkler, B. (2007). Safe space sharing human-robot cooperation using a 3D time-of-flight camera. In: Robotic industries association: International robots & vision show: Technical conference proceedings, Rosemont (Chicago), IL, pp. 1–8.

  • Xu, Y. C., Lei, B., & Hendriks, E. A. (2011). Camera network coverage improving by particle swarm optimization. EURASIP Journal on Image and Video Processing, 2011, 3:1–3:10.

  • Zhao, J., Cheung, S., & Nguyen, T. (2008). Optimal camera network configurations for visual tagging. IEEE Journal of Selected Topics in Signal Processing, 2(4), 464–479.

    Article  Google Scholar 

  • Zhao, J., Haws, D., Yoshida, R., & Cheung, S. (2011). Approximate techniques in solving optimal camera placement problems. In: Computer vision workshops (ICCV Workshops), 2011 IEEE international conference on, pp. 1705–1712.

Download references

Acknowledgments

The authors would like to thank the anonymous referees for their constructive comments and suggestions which helped to improve the work presented in this paper.

Author information

Authors and Affiliations

  1. Centre for Intelligent Systems Research, Deakin University, Geelong, VIC, Australia

    Samer Hanoun, Asim Bhatti, Doug Creighton & Saeid Nahavandi

  2. Boeing Research & Technology, Melbourne, VIC, Australia

    Phillip Crothers

  3. GM Holden, Melbourne, VIC, Australia

    Celeste Gloria Esparza

Authors
  1. Samer Hanoun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Asim Bhatti
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Doug Creighton
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Saeid Nahavandi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Phillip Crothers
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Celeste Gloria Esparza
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Samer Hanoun.

Additional information

This work is supported under the Australian Research Council (ARC) Grant Number LP110200364.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hanoun, S., Bhatti, A., Creighton, D. et al. Target coverage in camera networks for manufacturing workplaces. J Intell Manuf 27, 1221–1235 (2016). https://doi.org/10.1007/s10845-014-0946-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-014-0946-z

Keywords

Search

Navigation