XFall: Domain Adaptive Wi-Fi-Based Fall Detection With Cross-Modal Supervision
Authors: 
Guoxuan Chi, 
Guidong Zhang, Xuan Ding, Qiang Ma, Zheng Yang, Zhenguo Du, Houfei Xiao, Zhuang LiuAuthors Info & Claims
Guoxuan Chi, Guidong Zhang, Xuan Ding, Qiang Ma, Zheng Yang, Zhenguo Du, Houfei Xiao, Zhuang LiuAuthors Info & ClaimsPages 2457 - 2471
Abstract
Recent years have witnessed an increasing demand for human fall detection systems. Among all existing methods, Wi-Fi-based fall detection has become one of the most promising solutions due to its pervasiveness. However, when applied to a new domain, existing Wi-Fi-based solutions suffer from severe performance degradation caused by low generalizability. In this paper, we propose XFall, a domain-adaptive fall detection system based on Wi-Fi. XFall overcomes the generalization problem from three aspects. To advance cross-environment sensing, XFall exploits an environment-independent feature called speed distribution profile, which is irrelevant to indoor layout and device deployment. To ensure sensitivity across all fall types, an attention-based encoder is designed to extract the general fall representation by associating both the spatial and temporal dimensions of the input. To train a large model with limited amounts of Wi-Fi data, we design a cross-modal learning framework, adopting a pre-trained visual model for supervision during the training process. We implement and evaluate XFall on one of the latest commercial wireless products through a year-long deployment in real-world settings. The result shows XFall achieves an overall accuracy of 96.8%, with a miss alarm rate of 3.1% and a false alarm rate of 3.3%, outperforming the state-of-the-art solutions in both in-domain and cross-domain evaluation.
References
[1]
(2021). Falls. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/falls
[2]
G. Mastorakis and D. Makris, “Fall detection system using Kinect’s infrared sensor,” J. Real-Time Image Process., vol. 9, pp. 635–646, Dec. 2014.
[3]
C. Krupitzer, T. Sztyler, J. Edinger, M. Breitbach, H. Stuckenschmidt, and C. Becker, “Hips do lie! A position-aware mobile fall detection system,” in Proc. IEEE Int. Conf. Pervasive Comput. Commun., Mar. 2018, pp. 1–10.
[4]
Z.-P. Bian, J. Hou, L.-P. Chau, and N. Magnenat-Thalmann, “Fall detection based on body part tracking using a depth camera,” IEEE J. Biomed. Health Informat., vol. 19, no. 2, pp. 430–439, Mar. 2015.
[5]
L.-J. Kau and C.-S. Chen, “A smart phone-based pocket fall accident detection, positioning, and rescue system,” IEEE J. Biomed. Health Informat., vol. 19, no. 1, pp. 44–56, Jan. 2015.
[6]
T. Theodoridis, V. Solachidis, N. Vretos, and P. Daras, “Human fall detection from acceleration measurements using a recurrent neural network,” in Proc. Int. Conf. Biomed. Health Informat., 2017, pp. 145–149.
[7]
Y. Tian, G.-H. Lee, H. He, C.-Y. Hsu, and D. Katabi, “RF-based fall monitoring using convolutional neural networks,” Proc. ACM Interact., Mobile, Wearable Ubiquitous Technol., vol. 2, no. 3, pp. 1–24, Sep. 2018.
[8]
Y. Li, K. C. Ho, and M. Popescu, “A microphone array system for automatic fall detection,” IEEE Trans. Biomed. Eng., vol. 59, no. 5, pp. 1291–1301, May 2012.
[9]
Y. Wang, J. Liu, Y. Chen, M. Gruteser, J. Yang, and H. Liu, “E-eyes: Device-free location-oriented activity identification using fine-grained WiFi signatures,” in Proc. 20th Annu. Int. Conf. Mobile Comput. Netw., Sep. 2014, pp. 617–628.
[10]
W. Wang, A. X. Liu, M. Shahzad, K. Ling, and S. Lu, “Understanding and modeling of WiFi signal based human activity recognition,” in Proc. 21st Annu. Int. Conf. Mobile Comput. Netw., Sep. 2015, pp. 65–76.
[11]
G. Chi et al., “Wi-Drone: Wi-Fi-based 6-DoF tracking for indoor drone flight control,” in Proc. 20th Annu. Int. Conf. Mobile Syst. Appl. Serv., 2022, pp. 56–68.
[12]
Y. Gao, G. Chi, G. Zhang, and Z. Yang, “Wi-Prox: Proximity estimation of non-directly connected devices via Sim2Real transfer learning,” in Proc. IEEE Global Commun. Conf., Dec. 2023, pp. 5629–5634.
[13]
G. Chi et al., “RF-diffusion: Radio signal generation via time-frequency diffusion,” 2024, arXiv:2404.09140.
[14]
Y. Wang, K. Wu, and L. M. Ni, “Wifall: Device-free fall detection by wireless networks,” IEEE Trans. Mobile Comput., vol. 16, no. 2, pp. 581–594, Feb. 2016.
[15]
S. Palipana, D. Rojas, P. Agrawal, and D. Pesch, “FallDeFi: Ubiquitous fall detection using commodity Wi-Fi devices,” Proc. ACM Interact., Mobile, Wearable Ubiquitous Technol., vol. 1, no. 4, pp. 1–25, Jan. 2018.
[16]
Y. Hu, F. Zhang, C. Wu, B. Wang, and K. J. R. Liu, “DeFall: Environment-independent passive fall detection using WiFi,” IEEE Internet Things J., vol. 9, no. 11, pp. 8515–8530, Jun. 2022.
[17]
H. Wang, D. Zhang, Y. Wang, J. Ma, Y. Wang, and S. Li, “RT-Fall: A real-time and contactless fall detection system with commodity WiFi devices,” IEEE Trans. Mobile Comput., vol. 16, no. 2, pp. 511–526, Feb. 2017.
[18]
L. Zhang, Z. Wang, and L. Yang, “Commercial Wi-Fi based fall detection with environment influence mitigation,” in Proc. 16th Annu. IEEE Int. Conf. Sens., Commun., Netw. (SECON), Jun. 2019, pp. 1–9.
[19]
Y. Zheng et al., “Zero-effort cross-domain gesture recognition with Wi-Fi,” in Proc. 17th Annu. Int. Conf. Mobile Syst. Appl. Services, 2019, pp. 313–325.
[20]
S. Ding, Z. Chen, T. Zheng, and J. Luo, “RF-Net: A unified meta-learning framework for RF-enabled one-shot human activity recognition,” in Proc. 18th Conf. Embedded Netw. Sens. Syst., 2020, pp. 517–530.
[21]
A. Romero, N. Ballas, S. Ebrahimi Kahou, A. Chassang, C. Gatta, and Y. Bengio, “FitNets: Hints for thin deep nets,” 2014, arXiv:1412.6550.
[22]
Y. Wang, S. Yang, F. Li, Y. Wu, and Y. Wang, “FallViewer: A fine-grained indoor fall detection system with ubiquitous Wi-Fi devices,” IEEE Internet Things J., vol. 8, no. 15, pp. 12455–12466, Aug. 2021.
[23]
E. E. Stone and M. Skubic, “Fall detection in homes of older adults using the Microsoft Kinect,” IEEE J. Biomed. Health Informat., vol. 19, no. 1, pp. 290–301, Jan. 2015.
[24]
J. Wang, Z. Zhang, B. Li, S. Lee, and R. S. Sherratt, “An enhanced fall detection system for elderly person monitoring using consumer home networks,” IEEE Trans. Consum. Electron., vol. 60, no. 1, pp. 23–29, Feb. 2014.
[25]
P. Pierleoni, A. Belli, L. Palma, M. Pellegrini, L. Pernini, and S. Valenti, “A high reliability wearable device for elderly fall detection,” IEEE Sensors J., vol. 15, no. 8, pp. 4544–4553, Aug. 2015.
[26]
Q. T. Huynh, U. D. Nguyen, L. B. Irazabal, N. Ghassemian, and B. Q. Tran, “Optimization of an accelerometer and gyroscope-based fall detection algorithm,” J. Sensors, vol. 2015, pp. 1–8, Aug. 2015.
[27]
Y. Zhang, W. Hou, Z. Yang, and C. Wu, “Vecare: Statistical acoustic sensing for automotive in-cabin monitoring,” in Proc. 20th USENIX Symp. Networked Syst. Design Implement., 2023, pp. 1185–1200.
[28]
W. Wang, A. X. Liu, and M. Shahzad, “Gait recognition using WiFi signals,” in Proc. ACM Int. Joint Conf. Pervasive Ubiquitous Comput., 2016, pp. 363–373.
[29]
X. Li et al., “IndoTrack: Device-free indoor human tracking with commodity Wi-Fi,” Proc. ACM Interact., Mobile, Wearable Ubiquitous Technol., vol. 1, no. 3, pp. 1–22, Sep. 2017.
[30]
K. Qian, C. Wu, Z. Yang, Y. Liu, and K. Jamieson, “Widar: Decimeter-level passive tracking via velocity monitoring with commodity Wi-Fi,” in Proc. 18th ACM Int. Symp. Mobile Ad Hoc Netw. Comput., 2017, pp. 1–10.
[31]
F. Zhang, C. Chen, B. Wang, and K. J. Ray Liu, “WiSpeed: A statistical electromagnetic approach for device-free indoor speed estimation,” IEEE Internet Things J., vol. 5, no. 3, pp. 2163–2177, Jun. 2018.
[32]
C. Wu, F. Zhang, Y. Hu, and K. J. R. Liu, “GaitWay: Monitoring and recognizing gait speed through the walls,” IEEE Trans. Mobile Comput., vol. 20, no. 6, pp. 2186–2199, Jun. 2021.
[33]
W. Jiang et al., “Towards environment independent device free human activity recognition,” in Proc. 24th Annu. Int. Conf. Mobile Comput. Netw., 2018, pp. 289–304.
[34]
J. Zhang, Z. Tang, M. Li, D. Fang, P. Nurmi, and Z. Wang, “CrossSense: Towards cross-site and large-scale WiFi sensing,” in Proc. 24th Annu. Int. Conf. Mobile Comput. Netw., 2018, pp. 305–320.
[35]
Z. Yang, Y. Zhang, K. Qian, and C. Wu, “SLNet: A spectrogram learning neural network for deep wireless sensing,” in Proc. 20th USENIX Symp. Netw. Syst. Design Implement., 2023, pp. 1221–1236.
[36]
C. Li, Z. Cao, and Y. Liu, “Deep AI enabled ubiquitous wireless sensing: A survey,” ACM Comput. Surveys, vol. 54, no. 2, pp. 1–35, 2021.
[37]
Y. Zhang, Y. Zheng, G. Zhang, K. Qian, C. Qian, and Z. Yang, “GaitSense: Towards ubiquitous gait-based human identification with Wi-Fi,” ACM Trans. Sensor Netw., vol. 18, no. 1, pp. 1–24, Feb. 2022.
[38]
D. Tse and P. Viswanath, Fundamentals of Wireless Communication. Cambridge, U.K.: Cambridge Univ. Press, 2005.
[39]
F. Zhang, C. Wu, B. Wang, H.-Q. Lai, Y. Han, and K. J. R. Liu, “WiDetect: Robust motion detection with a statistical electromagnetic model,” Proc. ACM Interact., Mobile, Wearable Ubiquitous Technol., vol. 3, no. 3, pp. 1–24, Sep. 2019.
[40]
A. Vaswani et al., “Attention is all you need,” in Proc. Adv. Neural Inf. Process. Syst., vol. 30, 2017, pp. 1–11.
[41]
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2016, pp. 770–778.
[42]
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” 2018, arXiv:1810.04805.
[43]
D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri, “Learning spatiotemporal features with 3D convolutional networks,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2015, pp. 4489–4497.
[44]
F. Tung and G. Mori, “Similarity-preserving knowledge distillation,” in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), Oct. 2019, pp. 1365–1374.
[45]
T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” in Proc. 22nd ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, Aug. 2016, pp. 785–794. 10.1145/2939672.2939785.
[46]
L. Breiman, “Random forests,” Mach. Learn., vol. 45, pp. 5–32, Oct. 2001.
Index Terms
- XFall: Domain Adaptive Wi-Fi-Based Fall Detection With Cross-Modal Supervision
Index terms have been assigned to the content through auto-classification.
Recommendations
Cross-assistive approach for PDR and Wi-Fi positioning
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct PublicationIn indoor positioning using Wi-Fi, there is a problem that the accuracy is not stable by the occurrence of large errors. Large errors tend to occur when density of wireless LAN access points is low or the radio wave condition is unstable. Furthermore, ...
Multitarget device-free localization via cross-domain Wi-Fi RSS training data and attentional prior fusion
AAAI'24/IAAI'24/EAAI'24: Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial IntelligenceDevice-free localization (DFL) using easily-obtained Wi-Fi received signal strength (RSS) has wide real-world applications for not requiring people to carry trackable devices. However, accurate multitarget DFL remains challenging due to the unknown ...
AFall: Wi-Fi-Based Device-Free Fall Detection System Using Spatial Angle of Arrival
Falling is a common health problem for elderly people. Early detection of falls allows earlier rescue measures to be implemented. Most existing Wi-Fi-based fall detection systems employ learning-based methods, which require large amounts of labeled data ...
Comments
Information & Contributors
Information
Published In
0733-8716 © 2024 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 01 September 2024
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 23 Jan 2025