Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Self-Supervised Representation Learning and Temporal-Spectral Feature Fusion for Bed Occupancy Detection

Published: 09 September 2024 Publication History

Abstract

In automated sleep monitoring systems, bed occupancy detection is the foundation or the first step before other downstream tasks, such as inferring sleep activities and vital signs. The existing methods do not generalize well to real-world environments due to single environment settings and rely on threshold-based approaches. Manually selecting thresholds requires observing a large amount of data and may not yield optimal results. In contrast, acquiring extensive labeled sensory data poses significant challenges regarding cost and time. Hence, developing models capable of generalizing across diverse environments with limited data is imperative. This paper introduces SeismoDot, which consists of a self-supervised learning module and a spectral-temporal feature fusion module for bed occupancy detection. Unlike conventional methods that require separate pre-training and fine-tuning, our self-supervised learning module is co-optimized with the primary target task, which directs learned representations toward a task-relevant embedding space while expanding the feature space. The proposed feature fusion module enables the simultaneous exploitation of temporal and spectral features, enhancing the diversity of information from both domains. By combining these techniques, SeismoDot expands the diversity of embedding space for both the temporal and spectral domains to enhance its generalizability across different environments. SeismoDot not only achieves high accuracy (98.49%) and F1 scores (98.08%) across 13 diverse environments, but it also maintains high performance (97.01% accuracy and 96.54% F1 score) even when trained with just 20% (4 days) of the total data. This demonstrates its exceptional ability to generalize across various environmental settings, even with limited data availability.

References

[1]
Andreas Braun, Martin Majewski, Reiner Wiehert, and Arjan Kuijper. 2016. Investigating low-cost wireless occupancy sensors for beds. In Distributed, Ambient and Pervasive Interactions: 4th International Conference, DAPI 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, July 17-22, 2016, Proceedings 4. Springer, 26--34.
[2]
Andreas Braun, Reiner Wichert, Arjan Kuijper, and Dieter W Fellner. 2015. Capacitive proximity sensing in smart environments. Journal of Ambient Intelligence and Smart Environments 7, 4 (2015), 483--510.
[3]
Lili Chen, Jie Xiong, Xiaojiang Chen, Sunghoon Ivan Lee, Daqing Zhang, Tao Yan, and Dingyi Fang. 2019. LungTrack: Towards Contactless and Zero Dead-Zone Respiration Monitoring with Commodity RFIDs. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 79 (sep 2019), 22 pages. https://doi.org/10.1145/3351237
[4]
Jose Clemente, Maria Valero, Fangyu Li, Chengliang Wang, and WenZhan Song. 2020. Helena: Real-time contact-free monitoring of sleep activities and events around the bed. In 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 1--10.
[5]
Shohreh Deldari, Hao Xue, Aaqib Saeed, Daniel V Smith, and Flora D Salim. 2022. Cocoa: Cross modality contrastive learning for sensor data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1--28.
[6]
Emadeldeen Eldele, Mohamed Ragab, Zhenghua Chen, Min Wu, Chee-Keong Kwoh, Xiaoli Li, and Cuntai Guan. 2023. Self-supervised contrastive representation learning for semi-supervised time-series classification. IEEE Transactions on Pattern Analysis and Machine Intelligence (2023).
[7]
Haoyi Fan, Fengbin Zhang, and Yue Gao. 2020. Self-supervised time series representation learning by inter-intra relational reasoning. arXiv preprint arXiv:2011.13548 (2020).
[8]
Arthur Gretton, Karsten Borgwardt, Malte Rasch, Bernhard Schölkopf, and Alex Smola. 2006. A kernel method for the two-sample-problem. Advances in neural information processing systems 19 (2006).
[9]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[10]
Yash Jain, Chi Ian Tang, Chulhong Min, Fahim Kawsar, and Akhil Mathur. 2022. Collossl: Collaborative self-supervised learning for human activity recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1--28.
[11]
Zhenhua Jia, Musaab Alaziz, Xiang Chi, Richard E Howard, Yanyong Zhang, Pei Zhang, Wade Trappe, Anand Sivasubramaniam, and Ning An. 2016. HB-phone: a bed-mounted geophone-based heartbeat monitoring system. In 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 1--12.
[12]
Zhenhua Jia, Amelie Bonde, Sugang Li, Chenren Xu, Jingxian Wang, Yanyong Zhang, Richard E Howard, and Pei Zhang. 2017. Monitoring a person's heart rate and respiratory rate on a shared bed using geophones. In Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems. 1--14.
[13]
Dani Kiyasseh, Tingting Zhu, and David A Clifton. 2021. Clocs: Contrastive learning of cardiac signals across space, time, and patients. In International Conference on Machine Learning. PMLR, 5606--5615.
[14]
Fangyu Li, Maria Valero, Jose Clemente, Zion Tse, and Wenzhan Song. 2020. Smart sleep monitoring system via passively sensing human vibration signals. IEEE Sensors Journal 21, 13 (2020), 14466--14473.
[15]
Chen Liu, Jie Xiong, Lin Cai, Lin Feng, Xiaojiang Chen, and Dingyi Fang. 2019. Beyond Respiration: Contactless Sleep Sound-Activity Recognition Using RF Signals. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 96 (sep 2019), 22 pages. https://doi.org/10.1145/3351254
[16]
Yunyoung Nam, Yeesock Kim, and Jinseok Lee. 2016. Sleep monitoring based on a tri-axial accelerometer and a pressure sensor. Sensors 16, 5 (2016), 750.
[17]
Aaron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748 (2018).
[18]
Madhurananda Pahar, Igor Miranda, Andreas Diacon, and Thomas Niesler. 2023. Accelerometer-based bed occupancy detection for automatic, non-invasive long-term cough monitoring. IEEE Access 11 (2023), 30739--30752.
[19]
Jaeyeon Park, Hyeon Cho, Rajesh Krishna Balan, and JeongGil Ko. 2020. Heartquake: Accurate low-cost non-invasive ecg monitoring using bed-mounted geophones. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--28.
[20]
Melanie Pouliot, Vilas Joshi, Rafik Goubran, and Frank Knoefel. 2012. Bed occupancy monitoring: Data processing and clinician user interface design. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 5810--5814.
[21]
Xin Qin, Jindong Wang, Shuo Ma, Wang Lu, Yongchun Zhu, Xing Xie, and Yiqiang Chen. 2023. Generalizable Low-Resource Activity Recognition with Diverse and Discriminative Representation Learning. arXiv preprint arXiv:2306.04641 (2023).
[22]
Racotech. 2024. RGI-4.5Hz Geophone. http://www.racotech.biz/parameter/RGI-4.5Hz%20Geophone.pdf
[23]
Aaqib Saeed, Tanir Ozcelebi, and Johan Lukkien. 2019. Multi-task self-supervised learning for human activity detection. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 2 (2019), 1--30.
[24]
Pritam Sarkar and Ali Etemad. 2020. Self-supervised ECG representation learning for emotion recognition. IEEE Transactions on Affective Computing 13, 3 (2020), 1541--1554.
[25]
Narayan Schütz, Hugo Saner, Angela Botros, Bruno Pais, Valérie Santschi, Philipp Buluschek, Daniel Gatica-Perez, Prabitha Urwyler, René M Müri, Tobias Nef, et al. 2021. Contactless sleep monitoring for early detection of health deteriorations in community-dwelling older adults: Exploratory study. JMIR mHealth and uHealth 9, 6 (2021), e24666.
[26]
Yingjian Song, Bingnan Li, Dan Luo, Zaipeng Xie, Bradley G. Phillips, Yuan Ke, and Wenzhan Song. 2024. Engagement-Free and Contactless Bed Occupancy and Vital Signs Monitoring. IEEE Internet of Things Journal 11, 5 (2024), 7935--7947. https://doi.org/10.1109/JIOT.2023.3316674
[27]
Matthew Taylor, Theresa Grant, Frank Knoefel, and Rafik Goubran. 2013. Bed occupancy measurements using under mattress pressure sensors for long term monitoring of community-dwelling older adults. In 2013 IEEE International Symposium on Medical Measurements and Applications (MeMeA). IEEE, 130--134.
[28]
Sana Tonekaboni, Danny Eytan, and Anna Goldenberg. 2021. Unsupervised representation learning for time series with temporal neighborhood coding. arXiv preprint arXiv:2106.00750 (2021).
[29]
Maria Valero, Jose Clemente, Fangyu Li, and WenZhan Song. 2021. Health and sleep nursing assistant for real-time, contactless, and non-invasive monitoring. Pervasive and mobile computing 75 (2021), 101422.
[30]
Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 170 (jan 2018), 20 pages. https://doi.org/10.1145/3161188
[31]
Ling Yang and Shenda Hong. 2022. Unsupervised time-series representation learning with iterative bilinear temporal-spectral fusion. In International Conference on Machine Learning. PMLR, 25038--25054.
[32]
Shichao Yue, Yuzhe Yang, Hao Wang, Hariharan Rahul, and Dina Katabi. 2020. BodyCompass: Monitoring Sleep Posture with Wireless Signals. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 66 (jun 2020), 25 pages. https://doi.org/10.1145/3397311
[33]
Zhihan Yue, Yujing Wang, Juanyong Duan, Tianmeng Yang, Congrui Huang, Yunhai Tong, and Bixiong Xu. 2022. Ts2vec: Towards universal representation of time series. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 8980--8987.
[34]
Camellia Zakaria, Gizem Yilmaz, Priyanka Mary Mammen, Michael Chee, Prashant Shenoy, and Rajesh Balan. 2023. SleepMore: Inferring Sleep Duration at Scale via Multi-Device WiFi Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 193 (jan 2023), 32 pages. https://doi.org/10.1145/3569489
[35]
Kexin Zhang, Qingsong Wen, Chaoli Zhang, Liang Sun, and Yong Liu. 2022. Time Series Anomaly Detection using Skip-Step Contrastive Predictive Coding. In NeurIPS 2022 Workshop: Self-Supervised Learning-Theory and Practice.
[36]
Xiang Zhang, Ziyuan Zhao, Theodoros Tsiligkaridis, and Marinka Zitnik. 2022. Self-supervised contrastive pre-training for time series via time-frequency consistency. Advances in Neural Information Processing Systems 35 (2022), 3988--4003.
[37]
Yunhao Zhang and Junchi Yan. 2022. Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting. In The Eleventh International Conference on Learning Representations.
[38]
Langcheng Zhao, Rui Lyu, Qi Lin, Anfu Zhou, Huanhuan Zhang, Huadong Ma, Jingjia Wang, Chunli Shao, and Yida Tang. 2024. mmArrhythmia: Contactless Arrhythmia Detection via mmWave Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 1, Article 30 (mar 2024), 25 pages. https://doi.org/10.1145/3643549
[39]
Yang Zhao, Peter Tu, and Ming-Ching Chang. 2019. Occupancy sensing and activity recognition with cameras and wireless sensors. In Proceedings of the 2nd Workshop on Data Acquisition to Analysis. 1--6.
[40]
Hao Zhou, Taiting Lu, Yilin Liu, Shijia Zhang, and Mahanth Gowda. 2022. Learning on the Rings: Self-Supervised 3D Finger Motion Tracking Using Wearable Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--31.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 3
August 2024
1782 pages
EISSN:2474-9567
DOI:10.1145/3695755
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2024
Published in IMWUT Volume 8, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Bed Occupancy
  2. Self-Supervised Learning
  3. Spectrum-temporal feature fusion

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National Heart Lung and Blood Institute

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 150
    Total Downloads
  • Downloads (Last 12 months)150
  • Downloads (Last 6 weeks)150
Reflects downloads up to 16 Oct 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media