Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3357384.3357831acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article
Public Access

Learning to Predict Human Stress Level with Incomplete Sensor Data from Wearable Devices

Published: 03 November 2019 Publication History
  • Get Citation Alerts
  • Abstract

    Stress is a common problem in modern life that can bring both psychological and physical disorder. Wearable sensors are commonly used to study the relationship between physical records and mental status. Although sensor data generated by wearable devices provides an opportunity to identify stress in people for predictive medicine, in practice, the data are typically complicated and vague and also often fragmented. In this paper, we propose DataCompletion with Diurnal Regularizers (DCDR) and TemporallyHierarchical Attention Network (THAN) to address the fragmented data issue and predict human stress level with recovered sensor data. We model fragmentation as a sparsity issue. The nuclear norm minimization method based on the low-rank assumption is first applied to derive unobserved sensor data with diurnal patterns of human behaviors. A hierarchical recurrent neural network with the attention mechanism then models temporally structural information in the reconstructed sensor data, thereby inferring the predicted stress level. Data for this study were from 75 undergraduate students (taken from a sample of a larger study) who provided sensor data from smart wristbands. They also completed weekly stress surveys as ground-truth labels about their stress levels. This survey lasted 12 weeks and the sensor records are also in this period. The experimental results demonstrate that our approach significantly outperforms conventional methods in both data completion and stress level prediction. Moreover, an in-depth analysis further shows the effectiveness and robustness of our approach.

    References

    [1]
    Mart'in Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et almbox. 2016. Tensorflow: A system for large-scale machine learning. In 12th $$USENIX$$ Symposium on Operating Systems Design and Implementation ($$OSDI$$ 16) . 265--283.
    [2]
    Eirik Årsand, Miroslav Muzny, Meghan Bradway, Jan Muzik, and Gunnar Hartvigsen. 2015. Performance of the first combined smartwatch and smartphone diabetes diary application study. Journal of diabetes science and technology, Vol. 9, 3 (2015), 556--563.
    [3]
    American Psychological Association et almbox. 2017. Stress in America: The state of our nation. Stress in AmericaTM Survey (2017).
    [4]
    Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014).
    [5]
    Jorn Bakker, Mykola Pechenizkiy, and Natalia Sidorova. 2011. What's your current stress level? Detection of stress patterns from GSR sensor data. In 2011 IEEE 11th international conference on data mining workshops. IEEE, 573--580.
    [6]
    Andrey Bogomolov, Bruno Lepri, Michela Ferron, Fabio Pianesi, and Alex Sandy Pentland. 2014. Daily stress recognition from mobile phone data, weather conditions and individual traits. In Proceedings of the 22nd ACM international conference on Multimedia. ACM, 477--486.
    [7]
    Aeron M Buchanan and Andrew W Fitzgibbon. 2005. Damped newton algorithms for matrix factorization with missing data. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Vol. 2. IEEE, 316--322.
    [8]
    Jian-Feng Cai, Emmanuel J Candès, and Zuowei Shen. 2010. A singular value thresholding algorithm for matrix completion. SIAM Journal on Optimization, Vol. 20, 4 (2010), 1956--1982.
    [9]
    Emmanuel J Candes and Yaniv Plan. 2010. Matrix completion with noise. Proc. IEEE, Vol. 98, 6 (2010), 925--936.
    [10]
    Emmanuel J Candès and Terence Tao. 2009. The power of convex relaxation: Near-optimal matrix completion. arXiv preprint arXiv:0903.1476 (2009).
    [11]
    Luca Canzian and Mirco Musolesi. 2015. Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. ACM, 1293--1304.
    [12]
    Jinhui Chen and Jian Yang. 2013. Low-Rank Matrix Completion Based on Maximum Likelihood Estimation. In 2013 2nd IAPR Asian Conference on Pattern Recognition. IEEE, 261--265.
    [13]
    Kemeng Chen, Wolfgang Fink, Janet Roveda, Richard D Lane, John Allen, and Johnny Vanuk. 2015. Wearable sensor based stress management using integrated respiratory and ECG waveforms. In 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, 1--6.
    [14]
    Bo Cheng. 2011. Emotion recognition from physiological signals using AdaBoost. In International Conference on Applied Informatics and Communication. Springer, 412--417.
    [15]
    Mohamed Amine Chikh, Meryem Saidi, and Nesma Settouti. 2012. Diagnosis of diabetes diseases using an artificial immune recognition system2 (AIRS2) with fuzzy k-nearest neighbor. Journal of medical systems, Vol. 36, 5 (2012), 2721--2729.
    [16]
    Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
    [17]
    Mostafa Dehghani, Sascha Rothe, Enrique Alfonseca, and Pascal Fleury. 2017. Learning to attend, copy, and generate for session-based query suggestion. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. ACM, 1747--1756.
    [18]
    Susan Folkman. 2013. Stress: appraisal and coping .Springer.
    [19]
    Renee Garett, Sam Liu, and Sean D Young. 2017. A longitudinal analysis of stress among incoming college freshmen. Journal of American college health, Vol. 65, 5 (2017), 331--338.
    [20]
    Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016. Deep learning .MIT press.
    [21]
    Gábor Gosztolya, Róbert Busa-Fekete, and László Tóth. 2013. Detecting autism, emotions and social signals using AdaBoost. Interspeech.
    [22]
    Nils Y Hammerla, Shane Halloran, and Thomas Plötz. 2016. Deep, convolutional, and recurrent models for human activity recognition using wearables. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. AAAI Press, 1533--1540.
    [23]
    Xu Han, Jiasong Wu, Lu Wang, Yang Chen, Lotfi Senhadji, and Huazhong Shu. 2014. Linear total variation approximate regularized nuclear norm optimization for matrix completion. In Abstract and Applied Analysis, Vol. 2014. Hindawi.
    [24]
    John HL Hansen and Brian D Womack. 1996. Feature analysis and neural network-based classification of speech under stress. IEEE Transactions on Speech and Audio Processing, Vol. 4, 4 (1996), 307--313.
    [25]
    Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation, Vol. 9, 8 (1997), 1735--1780.
    [26]
    Natasha Jaques, Sara Taylor, Akane Sano, Rosalind Picard, et almbox. 2017. Predicting tomorrow's mood, health, and stress level using personalized multitask learning and domain adaptation. In IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing. 17--33.
    [27]
    Hayeon Jeong, Heepyung Kim, Rihun Kim, Uichin Lee, and Yong Jeong. 2017. Smartwatch wearing behavior analysis: a longitudinal study. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 1, 3 (2017), 60.
    [28]
    He Jiang, Xin Chen, Shuwei Zhang, Xin Zhang, Weiqiang Kong, and Tao Zhang. 2015. Software for wearable devices: Challenges and opportunities. In 2015 IEEE 39th Annual Computer Software and Applications Conference, Vol. 3. IEEE, 592--597.
    [29]
    Jyun-Yu Jiang and Wei Wang. 2018. RIN: Reformulation Inference Network for Context-Aware Query Suggestion. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 197--206.
    [30]
    Jyun-Yu Jiang, Mingyang Zhang, Cheng Li, Michael Bendersky, Nadav Golbandi, and Marc Najork. 2019. Semantic Text Matching for Long-Form Documents. In The World Wide Web Conference. ACM, 795--806.
    [31]
    Rafal Jozefowicz, Wojciech Zaremba, and Ilya Sutskever. 2015. An empirical exploration of recurrent network architectures. In Proceedings of the 32nd International Conference on Machine Learning (ICML '15). 2342--2350.
    [32]
    Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
    [33]
    Anil C Kokaram, Robin D Morris, William J Fitzgerald, and Peter JW Rayner. 1995. Interpolation of missing data in image sequences. IEEE Transactions on Image Processing, Vol. 4, 11 (1995), 1509--1519.
    [34]
    Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 8 (2009), 30--37.
    [35]
    Guokun Lai, Wei-Cheng Chang, Yiming Yang, and Hanxiao Liu. 2018. Modeling long-and short-term temporal patterns with deep neural networks. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval . ACM, 95--104.
    [36]
    Richard S Lazarus. 2006. Stress and emotion: A new synthesis .Springer Publishing Company.
    [37]
    Robert LiKamWa, Yunxin Liu, Nicholas D Lane, and Lin Zhong. 2013. Moodscope: Building a mood sensor from smartphone usage patterns. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services . ACM, 389--402.
    [38]
    Thang Luong, Hieu Pham, and Christopher D Manning. 2015. Effective Approaches to Attention-based Neural Machine Translation. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing . 1412--1421.
    [39]
    Denali Molitor and Deanna Needell. 2018. Matrix Completion for Structured Observations. arXiv preprint arXiv:1801.09657 (2018).
    [40]
    Oscar Martinez Mozos, Virginia Sandulescu, Sally Andrews, David Ellis, Nicola Bellotto, Radu Dobrescu, and Jose Manuel Ferrandez. 2017. Stress detection using wearable physiological and sociometric sensors. International journal of neural systems, Vol. 27, 02 (2017), 1650041.
    [41]
    Pentti Paatero and Unto Tapper. 1994. Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values. Environmetrics, Vol. 5, 2 (1994), 111--126.
    [42]
    Emily A Pierceall and Marybelle C Keim. 2007. Stress and coping strategies among community college students. Community College Journal of Research and Practice, Vol. 31, 9 (2007), 703--712.
    [43]
    Benjamin Recht, Maryam Fazel, and Pablo A Parrilo. 2010. Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM review, Vol. 52, 3 (2010), 471--501.
    [44]
    Robert S Sandler, James E Everhart, Mark Donowitz, Elizabeth Adams, Kelly Cronin, Clifford Goodman, Eric Gemmen, Shefali Shah, Aida Avdic, and Robert Rubin. 2002. The burden of selected digestive diseases in the United States. Gastroenterology, Vol. 122, 5 (2002), 1500--1511.
    [45]
    Aarti Sathyanarayana, Shafiq Joty, Luis Fernandez-Luque, Ferda Ofli, Jaideep Srivastava, Ahmed Elmagarmid, Teresa Arora, and Shahrad Taheri. 2016. Sleep quality prediction from wearable data using deep learning. JMIR mHealth and uHealth, Vol. 4, 4 (2016), e125.
    [46]
    Joseph L Schafer and John W Graham. 2002. Missing data: our view of the state of the art. Psychological methods, Vol. 7, 2 (2002), 147.
    [47]
    Mai Shouman, Tim Turner, and Rob Stocker. 2012. Applying k-nearest neighbour in diagnosing heart disease patients. International Journal of Information and Education Technology, Vol. 2, 3 (2012), 220--223.
    [48]
    Feng-Tso Sun, Cynthia Kuo, Heng-Tze Cheng, Senaka Buthpitiya, Patricia Collins, and Martin Griss. 2010. Activity-aware mental stress detection using physiological sensors. In International conference on Mobile computing, applications, and services. Springer, 282--301.
    [49]
    Lieven Vandenberghe and Stephen Boyd. 1996. Semidefinite programming. SIAM review, Vol. 38, 1 (1996), 49--95.
    [50]
    Yuxi Wang, Kaishun Wu, and Lionel M Ni. 2016. Wifall: Device-free fall detection by wireless networks. IEEE Transactions on Mobile Computing, Vol. 16, 2 (2016), 581--594.
    [51]
    Junfeng Yang and Xiaoming Yuan. 2013. Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization. Mathematics of computation, Vol. 82, 281 (2013), 301--329.
    [52]
    Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1480--1489.
    [53]
    Mi Zhang and Alexander A Sawchuk. 2013. Human daily activity recognition with sparse representation using wearable sensors. IEEE journal of Biomedical and Health Informatics, Vol. 17, 3 (2013), 553--560.
    [54]
    Tong Zhang, Jue Wang, Liang Xu, and Ping Liu. 2006. Using wearable sensor and NMF algorithm to realize ambulatory fall detection. In International conference on natural computation. Springer, 488--491.

    Cited By

    View all
    • (2024)Personalized Stress Detection Using Biosignals from Wearables: A Scoping ReviewSensors10.3390/s2410322124:10(3221)Online publication date: 18-May-2024
    • (2024)The Performance of Wearable AI in Detecting Stress Among Students: Systematic Review and Meta-AnalysisJournal of Medical Internet Research10.2196/5262226(e52622)Online publication date: 31-Jan-2024
    • (2024)Intelligent Wearable Systems: Opportunities and Challenges in Health and SportsACM Computing Surveys10.1145/364846956:7(1-42)Online publication date: 14-Feb-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management
    November 2019
    3373 pages
    ISBN:9781450369763
    DOI:10.1145/3357384
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 November 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. attention mechanism
    2. hierarchical recurrent neural networks
    3. human stress level prediction
    4. sensor data completion

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CIKM '19
    Sponsor:

    Acceptance Rates

    CIKM '19 Paper Acceptance Rate 202 of 1,031 submissions, 20%;
    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)134
    • Downloads (Last 6 weeks)8
    Reflects downloads up to

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Personalized Stress Detection Using Biosignals from Wearables: A Scoping ReviewSensors10.3390/s2410322124:10(3221)Online publication date: 18-May-2024
    • (2024)The Performance of Wearable AI in Detecting Stress Among Students: Systematic Review and Meta-AnalysisJournal of Medical Internet Research10.2196/5262226(e52622)Online publication date: 31-Jan-2024
    • (2024)Intelligent Wearable Systems: Opportunities and Challenges in Health and SportsACM Computing Surveys10.1145/364846956:7(1-42)Online publication date: 14-Feb-2024
    • (2023)A Mobile Health Application Using Geolocation for Behavioral Activity TrackingSensors10.3390/s2318791723:18(7917)Online publication date: 15-Sep-2023
    • (2023)Survey on Emotion Sensing Using Mobile DevicesIEEE Transactions on Affective Computing10.1109/TAFFC.2022.322048414:4(2678-2696)Online publication date: 1-Oct-2023
    • (2023)Incorporating Forthcoming Events and Personality Traits in Social Media Based Stress PredictionIEEE Transactions on Affective Computing10.1109/TAFFC.2021.307629414:1(603-621)Online publication date: 1-Jan-2023
    • (2022)Stress prediction using micro-EMA and machine learning during COVID-19 social isolationSmart Health10.1016/j.smhl.2021.10024223(100242)Online publication date: Mar-2022
    • (2021)STRETCH: Stress and Behavior Modeling with Tensor Decomposition of Heterogeneous DataIEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology10.1145/3486622.3493967(453-462)Online publication date: 14-Dec-2021
    • (2020)The Adaptive Behavioral Components (ABC) Model for Planning Longitudinal Behavioral Technology-Based Health Interventions: A Theoretical FrameworkJournal of Medical Internet Research10.2196/1556322:6(e15563)Online publication date: 26-Jun-2020

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media