Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

IRGA: An Intelligent Implicit Real-time Gait Authentication System in Heterogeneous Complex Scenarios

Published: 19 May 2023 Publication History

Abstract

Gait authentication as a technique that can continuously provide identity recognition on mobile devices for security has been investigated by academics in the community for decades. However, most of the existing work achieves insufficient generalization to complex real-world environments due to the complexity of the noisy real-world gait data. To address this limitation, we propose an intelligent Implicit Real-time Gait Authentication (IRGA) system based on Deep Neural Networks (DNNs) for enhancing the adaptability of gait authentication in practice. In the proposed system, the gait data (whether with complex interference signals) will first be processed sequentially by the imperceptible collection module and data preprocessing module for improving data quality. In order to illustrate and verify the suitability of our proposal, we provide analysis of the impact of individual gait changes on data feature distribution. Finally, a fusion neural network composed of a Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) is designed to perform feature extraction and user authentication. We evaluate the proposed IRGA system in heterogeneous complex scenarios and present start-of-the-art comparisons on three datasets. Extensive experiments demonstrate that the IRGA system achieves improved performance simultaneously in several different metrics.

References

[1]
Mohammed Abuhamad, Ahmed Abusnaina, DaeHun Nyang, and David Mohaisen. 2020. Sensor-based continuous authentication of smartphones’ users using behavioral biometrics: A contemporary survey. IEEE Internet of Things Journal 8, 1 (2020), 65–84.
[2]
Mohammed Abuhamad, Ahmed Abusnaina, DaeHun Nyang, and David Mohaisen. 2020. Sensor-based continuous authentication of smartphones’ users using behavioral biometrics: A contemporary survey. IEEE Internet of Things Journal 8, 1 (2020), 65–84.
[3]
Michal Aharon, Michael Elad, and Alfred Bruckstein. 2006. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing 54, 11 (2006), 4311–4322.
[4]
Hind Alobaidi, Nathan Clarke, Fudong Li, and Abdulrahman Alruban. 2022. Real-world smartphone-based gait recognition. Computers & Security 113 (2022), 102557.
[5]
Asish Bera and Debotosh Bhattacharjee. 2017. Human identification using selected features from finger geometric profiles. IEEE Transactions on Systems, Man, and Cybernetics: Systems 50, 3 (2017), 747–761.
[6]
Donald J. Berndt and James Clifford. 1994. Using dynamic time warping to find patterns in time series. In KDD Workshop. AAAI Press, Seattle, WA, 359–370.
[7]
John D. Bustard and Mark S. Nixon. 2010. Toward unconstrained ear recognition from two-dimensional images. IEEE Transactions on Systems, Man, and Cybernetics– Part A: Systems and Humans 40, 3 (2010), 486–494.
[8]
Jagmohan Chauhan, Young D. Kwon, Pan Hui, and Cecilia Mascolo. 2020. ContAuth: Continual learning framework for behavioral-based user authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1–23.
[9]
Tianshui Chen, Liang Lin, Xiaolu Hui, Riquan Chen, and Hefeng Wu. 2022. Knowledge-guided multi-label few-shot learning for general image recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 3 (2022), 1371–1384.
[10]
Hongju Cheng, Zhe Xie, Yushi Shi, and Naixue Xiong. 2019. Multi-step data prediction in wireless sensor networks based on one-dimensional CNN and bidirectional LSTM. IEEE Access 7 (2019), 117883–117896.
[11]
Wenzheng Chi, Jiaole Wang, and Max Q.-H. Meng. 2017. A gait recognition method for human following in service robots. IEEE Transactions on Systems, Man, and Cybernetics: Systems 48, 9 (2017), 1429–1440.
[12]
Omar Costilla-Reyes, Ruben Vera-Rodriguez, Patricia Scully, and Krikor B. Ozanyan. 2018. Analysis of spatio-temporal representations for robust footstep recognition with deep residual neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 2 (2018), 285–296.
[13]
Matteo Gadaleta and Michele Rossi. 2018. IDNet: Smartphone-based gait recognition with convolutional neural networks. Pattern Recognition 74 (2018), 25–37.
[14]
Davrondzhon Gafurov, Einar Snekkenes, and Patrick Bours. 2007. Spoof attacks on gait authentication system. IEEE Transactions on Information Forensics and Security 2, 3 (2007), 491–502.
[15]
Jing Gao, Peishang Gu, Qing Ren, Jinde Zhang, and Xin Song. 2019. Abnormal gait recognition algorithm based on LSTM-CNN fusion network. IEEE Access 7 (2019), 163180–163190.
[16]
Yongbin Gao, Xuehao Xiang, Naixue Xiong, Bo Huang, Hyo Jong Lee, Rad Alrifai, Xiaoyan Jiang, and Zhijun Fang. 2018. Human action monitoring for healthcare based on deep learning. IEEE Access 6 (2018), 52277–52285.
[17]
Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep Learning. MIT Press, London, England.
[18]
Steven A. Grosz, Joshua J. Engelsma, Eryun Liu, and Anil K. Jain. 2021. C2CL: Contact to contactless fingerprint matching. IEEE Transactions on Information Forensics and Security 17 (2021), 196–210.
[19]
Bufu Huang, Meng Chen, Panfeng Huang, and Yangsheng Xu. 2007. Gait modeling for human identification. In Proceedings 2007 IEEE International Conference on Robotics and Automation. IEEE, Rome, Italy, 4833–4838.
[20]
Govind Jeevan, Geevar C. Zacharias, Madhu S. Nair, and Jeny Rajan. 2022. An empirical study of the impact of masks on face recognition. Pattern Recognition 122 (2022), 108308.
[21]
Jongkil Jay Jeong, Yevhen Zolotavkin, and Robin Doss. 2022. Examining the current status and emerging trends in continuous authentication technologies through citation network analysis. Computing Surveys 55, 6 (2022), 1–31.
[22]
Lai Jiang, Mai Xu, Zulin Wang, and Leonid Sigal. 2021. DeepVS2.0: A saliency-structured deep learning method for predicting dynamic visual attention. International Journal of Computer Vision 129, 1 (2021), 203–224.
[23]
Ashika Ramesh Kothamachu and Basabi Chakraborty. 2021. Real time gait based person authentication using deep hybrid network. In 2021 IEEE 4th International Conference on Knowledge Innovation and Invention (ICKII’21). IEEE, Taichung, Taiwan, 155–159.
[24]
Li Yang, Zhuoru Ma, Chenghui Zhang, and Qingqi Pei. 2019. Mobile platform continuous authentication scheme based on gait characteristics. Journal on Communications 40, 7 (2019), 126.
[25]
Yunji Liang, Sagar Samtani, Bin Guo, and Zhiwen Yu. 2020. Behavioral biometrics for continuous authentication in the Internet-of-Things era: An artificial intelligence perspective. IEEE Internet of Things Journal 7, 9 (2020), 9128–9143.
[26]
Guoqiong Liao, Xiaomei Huang, Naixue Xiong, Changxuan Wan, and Mingsong Mao. 2021. Softwarized attention-based context-aware group recommendation technology in event-based industrial cyber-physical systems. IEEE Transactions on Industrial Informatics 17, 10 (2021), 6894–6905.
[27]
Xiaofeng Lu, Shengfei Zhang, Pan Hui, and Pietro Lio. 2020. Continuous authentication by free-text keystroke based on CNN and RNN. Computers & Security 96 (2020), 101861.
[28]
Yu Lu, Shiqian Wu, Zhijun Fang, Naixue Xiong, Sook Yoon, and Dong Sun Park. 2017. Exploring finger vein based personal authentication for secure IoT. Future Generation Computer Systems 77 (2017), 149–160.
[29]
Chenfei Mao, Ye Li, and Fangmin Sun. 2018. Accelerometer-based gait recognition using PCA & LDA algorithms. In 2018 IEEE 23rd International Conference on Digital Signal Processing (DSP’18). IEEE, Shanghai, China, 1–4.
[30]
Sky McKinley and Megan Levine. 1998. Cubic spline interpolation. College of the Redwoods 45, 1 (1998), 1049–1060.
[31]
Pratik Musale, Duin Baek, Nuwan Werellagama, Simon S. Woo, and Bong Jun Choi. 2019. You walk, we authenticate: Lightweight seamless authentication based on gait in wearable IoT systems. IEEE Access 7 (2019), 37883–37895.
[32]
Thanh Trung Ngo, Yasushi Makihara, Hajime Nagahara, Yasuhiro Mukaigawa, and Yasushi Yagi. 2014. The largest inertial sensor-based gait database and performance evaluation of gait-based personal authentication. Pattern Recognition 47, 1 (2014), 228–237.
[33]
Francisco Javier Ordóñez and Daniel Roggen. 2016. Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors 16, 1 (2016), 115.
[34]
Anshul Rai, Krishna Kant Chintalapudi, Venkata N. Padmanabhan, and Rijurekha Sen. 2012. Zee: Zero-effort crowdsourcing for indoor localization. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking. ACM, Istanbul, Turkey, 293–304.
[35]
Aaqib Saeed, Tanir Ozcelebi, and Johan Lukkien. 2019. Multi-task self-supervised learning for human activity detection. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 1–30.
[36]
Alireza Sepas-Moghaddam and Ali Etemad. 2022. Deep gait recognition: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 1 (2022), 264–284.
[37]
Chao Shen, Yuanxun Li, Yufei Chen, Xiaohong Guan, and Roy A. Maxion. 2017. Performance analysis of multi-motion sensor behavior for active smartphone authentication. IEEE Transactions on Information Forensics and Security 13, 1 (2017), 48–62.
[38]
Fangmin Sun, Chenfei Mao, Xiaomao Fan, and Ye Li. 2018. Accelerometer-based speed-adaptive gait authentication method for wearable IoT devices. IEEE Internet of Things Journal 6, 1 (2018), 820–830.
[39]
Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, 11 (2008), 2579–2605.
[40]
George Vavoulas, Charikleia Chatzaki, Thodoris Malliotakis, Matthew Pediaditis, and Manolis Tsiknakis. 2016. The MobiAct dataset: Recognition of activities of daily living using smartphones. In International Conference on Information and Communication Technologies for Ageing Well and e-Health, Vol. 2. SCITEPRESS, Rome, Italy, 143–151.
[41]
T. Verlekar. 2019. Gait analysis in unconstrained environments. PhD thesis, Ph. D. dissertation, Electrical and Computer Engineering, Instituto Superior.
[42]
Yandong Wen, Kaipeng Zhang, Zhifeng Li, and Yu Qiao. 2016. A discriminative feature learning approach for deep face recognition. In European Conference on Computer Vision. Springer, Cham, 499–515.
[43]
Weitao Xu, Guohao Lan, Qi Lin, Sara Khalifa, Mahbub Hassan, Neil Bergmann, and Wen Hu. 2018. KEH-Gait: Using kinetic energy harvesting for gait-based user authentication systems. IEEE Transactions on Mobile Computing 18, 1 (2018), 139–152.
[44]
Weitao Xu, Yiran Shen, Yongtuo Zhang, Neil Bergmann, and Wen Hu. 2017. Gait-Watch: A context-aware authentication system for smart watch based on gait recognition. In Proceedings of the 2nd International Conference on Internet-of-Things Design and Implementation. ACM, New York, NY, 59–70.
[45]
Xin Zeng, Xiaomei Zhang, Shuqun Yang, Zhicai Shi, and Chihung Chi. 2021. Gait-based implicit authentication using edge computing and deep learning for mobile devices. Sensors 21, 13 (2021), 4592.
[46]
Bob Zhang, Wei Li, Pei Qing, and David Zhang. 2013. Palm-print classification by global features. IEEE Transactions on Systems, Man, and Cybernetics: Systems 43, 2 (2013), 370–378.
[47]
Yuting Zhang, Gang Pan, Kui Jia, Minlong Lu, Yueming Wang, and Zhaohui Wu. 2014. Accelerometer-based gait recognition by sparse representation of signature points with clusters. IEEE Transactions on Cybernetics 45, 9 (2014), 1864–1875.
[48]
Ziyuan Zhang, Luan Tran, Feng Liu, and Xiaoming Liu. 2022. On learning disentangled representations for gait recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 1 (2022), 345–360.
[49]
Qin Zou, Yanling Wang, Qian Wang, Yi Zhao, and Qingquan Li. 2020. Deep learning-based gait recognition using smartphones in the wild. IEEE Transactions on Information Forensics and Security 15 (2020), 3197–3212.

Cited By

View all
  • (2024)ANALYSIS OF HUMAN LOWER LIMB DYNAMICS AND GAIT RECONSTRUCTIONJournal of Mechanics in Medicine and Biology10.1142/S021951942440027X24:02Online publication date: 28-Feb-2024
  • (2023)Human Identification Based on Gaits Analysis Using Sensors-Based Data Bands2023 IEEE 6th International Conference on Electronic Information and Communication Technology (ICEICT)10.1109/ICEICT57916.2023.10244981(1318-1321)Online publication date: 21-Jul-2023
  • (2023)Recurring Gaitset: A Gait Recognition Method Based on Deep Learning and Recurring Layer Transformer2023 5th International Academic Exchange Conference on Science and Technology Innovation (IAECST)10.1109/IAECST60924.2023.10503545(576-579)Online publication date: 8-Dec-2023

Index Terms

  1. IRGA: An Intelligent Implicit Real-time Gait Authentication System in Heterogeneous Complex Scenarios

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Internet Technology
    ACM Transactions on Internet Technology  Volume 23, Issue 2
    May 2023
    276 pages
    ISSN:1533-5399
    EISSN:1557-6051
    DOI:10.1145/3597634
    • Editor:
    • Ling Liu
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 May 2023
    Online AM: 26 April 2023
    Accepted: 17 April 2023
    Revised: 13 March 2023
    Received: 24 May 2022
    Published in TOIT Volume 23, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Continuous authentication
    2. gait analysis
    3. fusion neural network
    4. heterogeneous complex scenarios

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)173
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)ANALYSIS OF HUMAN LOWER LIMB DYNAMICS AND GAIT RECONSTRUCTIONJournal of Mechanics in Medicine and Biology10.1142/S021951942440027X24:02Online publication date: 28-Feb-2024
    • (2023)Human Identification Based on Gaits Analysis Using Sensors-Based Data Bands2023 IEEE 6th International Conference on Electronic Information and Communication Technology (ICEICT)10.1109/ICEICT57916.2023.10244981(1318-1321)Online publication date: 21-Jul-2023
    • (2023)Recurring Gaitset: A Gait Recognition Method Based on Deep Learning and Recurring Layer Transformer2023 5th International Academic Exchange Conference on Science and Technology Innovation (IAECST)10.1109/IAECST60924.2023.10503545(576-579)Online publication date: 8-Dec-2023

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media