Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

An IoT‐based human detection system for complex industrial environment with deep learning architectures and transfer learning

Published: 29 December 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Artificial intelligence (AI), combined with the Internet of Things (IoT), plays a beneficial role in various fields, including intelligent surveillance applications. With IoT and 5G advancement, intelligent sensors, and devices in the surveillance environment collect large amounts of data in the form of videos and images. These collected data require intelligent information processing solutions, help analyze the recorded videos and images to detect and identify various objects in the scene, particularly humans. In this study, an automated human detection system is presented for a complex industrial environment, in which people are monitored/detected from a top view perspective. A top view is usually preferred because it can provide sufficient coverage and enough visibility of a scene. This study demonstrates the applications, efficiency, and effectiveness of deep learning architectures, that is, Faster Region Convolutional Neural Network (Faster R‐CNN), Single Shot MultiBox Detector (SSD), and You Only Look Once (YOLOv3), with transfer learning. Experimental results reveal that with additional training and transfer learning, the performance of all detection architectures is significantly improved. The detection results are also compared using the same data set. The deep learning architectures achieve promising results with maximum true‐positive rate of 93%, 94%, and 94% for Faster‐RCNN, SSD, and YOLOv3, respectively. Furthermore, a detailed study is performed on output results that highlight challenges and probable future trends.

    References

    [1]
    Ahmed I, Ahmad M, Nawaz M, Haseeb K, Khan S, Jeon G. Efficient topview person detector using point based transformation and lookup table. Comput Commun. 2019;147:188‐197.
    [2]
    Ahmed I, Adnan A. A robust algorithm for detecting people in overhead views. Cluster Comput. 2018;21(1):633‐654. https://doi.org/10.1007/s10586-017-0968-3
    [3]
    Ahmad M, Ahmed I, Ullah K, Khan I, Khattak A, Adnan A. Energy efficient camera solution for video surveillance. Int J Adv Comput Sci Appl. 2019;10(3). https://doi.org/10.14569/IJACSA.2019.0100367
    [4]
    Ren S, He K, Girshick R, Sun J., Faster R. CNN: towards real‐time object detection with region proposal networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R, eds. Advances in Neural Information Processing Systems. Vol 28. Curran Associates, Inc.; 2015:91‐99.
    [5]
    Liu W, Anguelov D, Erhan D, et al. Ssd: Single shot multibox detector. In: European Conference on Computer Vision. Springer; 2016:21‐37.
    [6]
    Redmon J, Farhadi A. Yolov3: an incremental improvement. ArXiv. 2018;abs/1804.02767.
    [7]
    Doulamis A, Kosmopoulos D, Sardis M, Varvarigou T. an architecture for a self configurable video supervision. In: Proceedings of the 1st ACM Workshop on Analysis and Retrieval of Events/Actions and Workflows in Video Streams; 2008:97‐104.
    [8]
    Ahmed I, Carter JN. A robust person detector for overhead views. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012); 2012:1483‐1486.
    [9]
    Iguernaissi R, Merad D, Drap P. People Counting based on Kinect Depth Data. In: Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods—Volume 1: ICPRAM, INSTICC, SciTePress; 2018:364‐370.
    [10]
    Tseng T, Liu A, Hsiao P, Huang C, Fu L. Real‐time people detection and tracking for indoor surveillance using multiple top‐view depth cameras. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems; 2014:4077‐4082.
    [11]
    Pang Y, Yuan Y, Li X, Pan J. Efficient HOG human detection. Signal Processing. 2011;91(4):773‐781.
    [12]
    Ahmed I, Ahmad A, Piccialli F, Sangaiah AK, Jeon G. A robust features‐based person tracker for overhead views in industrial environment. IEEE Internet Things J. 2018;5(3):1598‐1605.
    [13]
    Ahmed I, Ahmad M, Adnan A, Ahmad A, Khan M. Person detector for different overhead views using machine learning. Int J Mach Learn Cybernet. 2019;10(10):2657‐2668. https://doi.org/10.1007/s13042-019-00950-5
    [14]
    Ullah K, Ahmed I, Ahmad M, Rahman AU, Nawaz M, Adnan A. Rotation invariant person tracker using top view. J Ambient Intell Humanized Comput. 2019:1‐17.
    [15]
    Ertler C, Possegger H, Opitz M, Bischof H. Pedestrian detection in RGB‐D images from an elevated viewpoint In: Kropatsch W, Janusch I, Artner N, eds. Proceedings of the 22nd Computer Vision Winter Workshop Austria. TU Wien, Pattern Recongition and Image Processing Group; 2017.
    [16]
    Ahmed I, Din S, Jeon G, Piccialli F. Exploring deep learning models for overhead view multiple object detection. IEEE Internet Things J. 2020;7(7):5737‐5744.
    [17]
    Ahmad M, Ahmed I, Khan FA, Qayum F, Aljuaid H. Convolutional neural network‐based person tracking using overhead views. Int J Distributed Sensor Networks. 2020;16(6).
    [18]
    Ahmed I, Ahmad M, Khan FA, Asif M. Comparison of deep‐learning‐based segmentation models: using top view person images. IEEE Access. 2020;8:136361‐136373.
    [19]
    Ahmed I, Din S, Jeon G, Piccialli F, Fortino G. Towards collaborative robotics in top view surveillance: a framework for multiple object tracking by detection using deep learning. IEEE/CAA J Autom Sin. 2020. https://doi.org/10.1109/JAS.2020.1003453
    [20]
    Lin TY, Maire M, Belongie S, Hays J, Perona P, Ramanan D, et al. Microsoft COCO: Common objects in context. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T, eds. Computer Vision—ECCV 2014. Cham: Springer International Publishing; 2014:740‐755.
    [21]
    Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2014:580‐587.
    [22]
    Erhan D, Szegedy C, Toshev A, Anguelov D. Scalable object detection using deep neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2014:2147‐2154.
    [23]
    Redmon J, Divvala S, Girshick RB, Farhadi A. You only look once: unified, real‐time object detection. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016:779‐788.
    [24]
    Kingma DP, Ba J. Adam: a method for stochastic optimization. CoRR. 2015;abs/1412.6980.

    Cited By

    View all
    • (2023)A Hierarchical Authentication System for Access Equipment in Internet of ThingsInternational Journal of Intelligent Systems10.1155/2023/88996972023Online publication date: 1-Jan-2023

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image International Journal of Intelligent Systems
    International Journal of Intelligent Systems  Volume 37, Issue 12
    December 2022
    2488 pages
    ISSN:0884-8173
    DOI:10.1002/int.v37.12
    Issue’s Table of Contents

    Publisher

    John Wiley and Sons Ltd.

    United Kingdom

    Publication History

    Published: 29 December 2022

    Author Tags

    1. artificial intelligence
    2. complex industrial environment
    3. deep learning
    4. internet of things
    5. person detection
    6. top view

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 11 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)A Hierarchical Authentication System for Access Equipment in Internet of ThingsInternational Journal of Intelligent Systems10.1155/2023/88996972023Online publication date: 1-Jan-2023

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media