Wi-Exercise: : An Indoor Human Movement Detection Method Based on Bidirectional LSTM Attention
Authors: 
ZhanJun Hao, YunZhu Kang, XiaoChao Dang, Ying An Academic Editor: Mario Muñoz-OrganeroAuthors Info & Claims
ZhanJun Hao, YunZhu Kang, XiaoChao Dang, Ying An Academic Editor: Mario Muñoz-OrganeroAuthors Info & ClaimsAbstract
Human motion recognition has become a hot topic in the field of human-computer interaction. Due to the traditional method of detecting human movement in indoor environments, there are still problems such as high hardware costs, influenced by the environment and the need for experimenters to be equipped with relevant equipment. With the large-scale deployment of wireless devices and the establishment of wireless network infrastructure, indoor personnel movement recognition systems based on wireless signals are gradually proposed. In this paper, we propose a device-independent motion-detection method Wi-exercise based on temporal recurrent neural networks. The acquired channel state information (CSI) is preprocessed by wavelet transform, and the output CSI matrix is filtered by the principal component analysis (PCA) to extract the feature values. The wavelet function is processed to further remove the noise also to make the action data more distinctive, and then PCA is used to track the entire CSI time series to improve and maintain its dimensional energy. The preprocessed data are subjected to feature extraction to obtain CSI of human motion and establish feature sequences, and then the action model is trained using the bidirectional long short-term memory attention (ABLSTM) mechanism to finally realize human motion recognition. Finally, the robustness of Wi-exercise is tested experimentally, and its performance is compared with that of existing recognition methods. The experimental results show that the average recognition rate of the method is 94.43% in the complex indoor environment, and the method is better than the traditional classifier method for action recognition, with lower and higher recognition accuracy.
References
[1]
Y. Lu, S. Lu, and X. Wang, “Research review of human behavior sensing technology based on WiFi signal,” Chinese Journal of Computer Science, vol. 42, no. 2, pp. 3–23, 2019, (in Chinese).
[2]
W. Zhang, S. Zhou, L. Yang, L. Ou, and Z. Xiao, “WiFiMap+: high-level indoor semantic inference with WiFi human activity and environment,” IEEE Transactions on Vehicular Technology, vol. PP (99), pp. 1–1, 2019.
[3]
Z. Hao, Y. Duan, X. Dang, Y. Liu, and D. Zhang, “Wi-SL: contactless fine-grained gesture recognition uses channel state information,” Sensors, vol. 20, no. 14, p. 4025, 2020.
[4]
M. Ali, T. El Batt, and M. Youssef, “SenseIO: Realistic Ubiquitous Indoor Outdoor Detection System Using Smartphones,” IEEE Sensors Journal, vol. 18, no. 9, pp. 3684–3693, 2018.
[5]
J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore, “Real-time human pose recognition in parts from single depth images,” Communications of the ACM, vol. 56, no. 1, pp. 116–124, 2013.
[6]
C. Chen, R. Jafari, and N. Kehtarnavaz, “Improving human action recognition using fusion of depth camera and inertial sensors,” IEEE Transactions on Human-Machine Systems, vol. 45, no. 1, pp. 51–61, 2015.
[7]
L. Zhang, K. Liu, Y. Jiang, X. Y. Li, Y. Liu, P. Yang, and Z. Li, “Montage: combine frames with movement continuity for realtime multi-user tracking,” IEEE Transactions on Mobile Computing, vol. 16, no. 4, pp. 1019–1031, 2017.
[8]
T. Li, C. An, Z. Tian, A. T. Campbell, and X. Zhou, “Human Sensing Using Visible Light Communication,” in International Conference on Mobile Computing & Networking, Paris France, 2015.
[9]
Y. Zhang, D. Li, and Y. Wang, “An indoor passive positioning method using CSI fingerprint based on Adaboost,” IEEE Sensors Journal, vol. 19, no. 14, pp. 5792–5800, 2019.
[10]
H. Abdelnasser, K. A. Harras, and M. Youssef, “A ubiquitous WiFi-based fine-grained gesture recognition system,” IEEE Transactions on Mobile Computing, vol. 18, no. 11, pp. 2474–2487, 2019.
[11]
B. Sheng, Y. Fang, F. Xiao, and L. Sun, “An accurate device-free action recognition system using two-stream network,” IEEE Transactions on Vehicular Technology, vol. 99, pp. 7930–7939, 2020.
[12]
K. Qian, C. Wu, Z. Yang, Y. Liu, F. He, and T. Xing, “Enabling contactless detection of moving humans with dynamic speeds using CSI,” ACM Transactions on Embedded Computing Systems, vol. 17, no. 2, pp. 1–18, 2018.
[13]
S. Wan, L. Qi, X. Xu, C. Tong, and Z. Gu, “Deep learning models for real-time human activity recognition with smartphones,” Mobile Networks & Applications, vol. 25, no. 2, pp. 743–755, 2020.
[14]
J. Maitre, K. Bouchard, and S. Gaboury, “Alternative deep learning architectures for feature-level fusion in human activity recognition,” Mobile Networks and Applications, vol. 26, no. 5, pp. 2076–2086, 2021.
[15]
T. Mahmud, S. S. Akash, S. A. Fattah, W. P. Zhu, and M. O. Ahmad, “Human activity recognition from multi-modal wearable sensor data using deep multi-stage LSTM architecture based on temporal feature aggregation,” in 2020 IEEE 63rd International Midwest Symposium on Circuits and Systems (MWSCAS), pp. 249–252, Springfield, MA, USA, 2020.
[16]
L. Chen, X. Liu, L. Peng, and M. Wu, “Deep learning based multimodal complex human activity recognition using wearable devices,” Applied Intelligence, vol. 51, no. 6, pp. 4029–4042, 2021.
[17]
K. Xia, J. Huang, and H. Wang, “LSTM-CNN architecture for human activity recognition,” IEEE Access, vol. 8, pp. 56855–56866, 2020.
[18]
W. Zhenyu and Z. Lei, “Sensor motion recognition based on deep convolution and gated recurrent neural networks,” Journal of Electronic Measurement and Instrumentation, vol. 32, no. 1, p. 9, 2020.
[19]
M. Youssef, “Challenges: device-free passive localization for wireless environments,” in Proceedings of the 13th annual ACM international conference on Mobile computing and networking, Montréal Québec Canada, 2007.
[20]
Z. Gao, Y. Gao, S. Wang, D. Li, and Y. Xu, “CRISLoc: reconstructable CSI fingerprinting for indoor smartphone localization,” IEEE Internet of Things Journal, vol. 8, pp. 3422–3437, 2020.
[21]
X. Yang, X. Yu, L. Xie, M. Zhou, and Q. Jiang, “Sleep apnea monitoring system based on Channel State Information,” in International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness, Springer, Cham, 2021.
[22]
S. Yousefi, H. Narui, S. Dayal, S. Ermon, and S. Valaee, “A survey on behavior recognition using WiFi channel state information,” IEEE Communications Magazine, vol. 55, no. 10, pp. 98–104, 2017.
[23]
M. Jaderberg, K. Simonyan, A. Zisserman et al., “Spatial transformer networks computer,” Science, vol. 4, pp. 2017–2025, 2015.
[24]
C. Han, K. Wu, Y. Wang, and L. M. Ni, “WiFall: device-free fall detection by wireless networks,” in IEEE INFOCOM 2014- IEEE Conference on Computer Communications, Toronto, ON, Canada, 2014.
[25]
C. G. Keller and D. M. Gavrila, “Will the pedestrian cross? A study on pedestrian path prediction,” IEEE Transactions on Intelligent Transportation Systems, vol. 15, no. 2, pp. 494–506, 2014.
[26]
T. Xin, B. Guo, Z. Wang, P. Wang, and Z. Yu, “FreeSense: human-behavior understanding using Wi-Fi signals,” Journal of Ambient Intelligence and Humanized Computing, vol. 9, no. 5, pp. 1611–1622, 2018.
[27]
J. Lv, D. Man, W. Yang, L. Gong, X. du, and M. Yu, “Robust device-free intrusion detection using physical layer information of WiFi signals,” Applied Sciences, vol. 9, no. 1, p. 175, 2019.
[28]
X. Wang, L. Gao, P. Wang, X. Sun, and X. Liu, “Two-stream 3-D convNet fusion for action recognition in videos with arbitrary size and length,” IEEE Transactions on Multimedia, vol. 20, no. 3, pp. 634–644, 2018.
[29]
K. P. Nkabiti and Y. Chen, “Application of solely self-attention mechanism in CSI-fingerprinting-based indoor localization,” Neural Computing and Applications, vol. 33, no. 15, pp. 9185–9198, 2021.
[30]
S. Sigg, M. Scholz, S. Shi, Y. Ji, and M. Beigl, “RF-sensing of activities from non-cooperative subjects in device-free recognition systems using ambient and local signals,” IEEE Transactions on Mobile Computing, vol. 13, no. 4, pp. 907–920, 2014.
[31]
Y. Xu, Z. Wang, C. Li, and J. He, “Common-mode voltage reduction and fault-tolerant operation of four-leg CSI-fed motor drives,” IEEE Transactions on Power Electronics, vol. 36, no. 8, pp. 8570–8574, 2021.
[32]
O. Francisco and R. Daniel, “Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition,” Sensors, vol. 16, no. 1, p. 115, 2016.
Recommendations
MIMO CSI-based Super-resolution AoA Estimation for Wi-Fi Indoor Localization
ICMLC '20: Proceedings of the 2020 12th International Conference on Machine Learning and ComputingIndoor localization technology has always been a research hotspot in industry and academia. Indoor localization research using channel state information (CSI) of Wi-Fi signals has also received more and more attention. The existing Angle of Arrival (AoA)...
Cross-assistive approach for PDR and Wi-Fi positioning
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationIn indoor positioning using Wi-Fi, there is a problem that the accuracy is not stable by the occurrence of large errors. Large errors tend to occur when density of wireless LAN access points is low or the radio wave condition is unstable. Furthermore, ...
A Wi-Fi Positioning Method Considering Radio Attenuation of Human Body
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable ComputersAs it is generally difficult to utilize GPS positioning indoors, methods such as Wi-Fi positioning and PDR positioning are proposed. In particular, in addition to being able to estimate the absolute position, the Wi-Fi positioning has attracted ...
Comments
Information & Contributors
Information
Published In
Copyright © 2022 ZhanJun Hao et al.
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Publisher
IOS Press
Netherlands
Publication History
Published: 01 January 2022
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Dec 2024