Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Data and Expert Models for Sleep Timing and Chronotype Estimation from Smartphone Context Data and Simulations

Published: 18 September 2018 Publication History

Abstract

We present a sleep timing estimation approach that combines data-driven estimators with an expert model and uses smartphone context data. Our data-driven methodology comprises a classifier trained on features from smartphone sensors. Another classifier uses time as input. Expert knowledge is incorporated via the human circadian and homeostatic two process model. We investigate the two process model as output filter on classifier results and as fusion method to combine sensor and time classifiers. We analyse sleep timing estimation performance, in data from a two-week free-living study of 13 participants and sensor data simulations of arbitrary sleep schedules, amounting to 98280 nights. Five intuitive sleep parameters were derived to control the simulation. Moreover, we investigate model personalisation, by retraining classifiers based on participant feedback. The joint data and expert model yields an average relative estimation error of -2±62 min for sleep onset and -5±70 min for wake (absolute errors 40±48 min and 42±57 min, mean median absolute deviation 22 min and 15 min), which significantly outperforms data-driven methods. Moreover, the data and expert models combination remains robust under varying sleep schedules. Personalising data models with user feedback from the last two days showed the largest performance gain of 57% for sleep onset and 59% for wake up. Our power-efficient smartphone app makes convenient everyday sleep monitoring finally realistic.

Supplementary Material

wahl (wahl.zip)
Supplemental movie, appendix, image and software files for, Data and Expert Models for Sleep Timing and Chronotype Estimation from Smartphone Context Data and Simulations

References

[1]
Saeed Abdullah, Mark Matthews, Elizabeth L. Murnane, Geri Gay, and Tanzeem Choudhury. 2014. Towards Circadian Computing: Early to Bed and Early to Rise Makes Some of Us Unhealthy and Sleep Deprived. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 673--684.
[2]
Gorka Azkune, Aitor Almeida, Diego López-de Ipiña, and Liming Chen. 2015. Extending Knowledge-Driven Activity Models through Data-Driven Learning Techniques. Expert Systems with Applications 42, 6 (2015), 3115--3128.
[3]
Marko Bohanec and Boris Delibašić. 2015. Data-Mining and Expert Models for Predicting Injury Risk in Ski Resorts. In International Conference on Decision Support System Technology. Springer, 46--60.
[4]
Marko Borazio and Kristof Van Laerhoven. 2011. Predicting Sleeping Behaviors in Long-Term Studies with Wrist-Worn Sensor Data. In AMI 2011: Proceedings of the International Joint Conference on Ambient Intelligence (Lecture Notes in Computer Science), Vol. 7040. Springer, 151--156.
[5]
Marko Borazio and Kristof Van Laerhoven. 2012. Combining Wearable and Environmental Sensing into an Unobtrusive Tool for Long-Term Sleep Studies. In Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium. ACM, 71--80.
[6]
Alexander A. Borbély and Peter Achermann. 1999. Sleep Homeostasis and Models of Sleep Regulation. J Biol Rhythms 14, 6 (Dec. 1999), 559--570.
[7]
Centers for Disease Control and Prevention (CDC). 2009. Perceived Insufficient Rest or Sleep among Adults - United States, 2008. MMWR Morb. Mortal. Wkly. Rep. 58, 42 (Oct. 2009), 1175--1179.
[8]
Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '16). ACM, New York, NY, USA, 785--794.
[9]
Zhenyu Chen, Mu Lin, Fanglin Chen, Nicholas D. Lane, Giuseppe Cardone, Rui Wang, Tianxing Li, Yiqiang Chen, Tonmoy Choudhury, and Andrew T. Campbell. 2013. Unobtrusive Sleep Monitoring Using Smartphones. In Pervasive Computing Technologies for Healthcare (PervasiveHealth), 2013 7th International Conference On. IEEE, 145--152.
[10]
Eun Kyoung Choe, Sunny Consolvo, Nathaniel F Watson, and Julie A Kientz. 2011. Opportunities for Computing Technologies to Support Healthy Sleep Behaviors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3053--3062.
[11]
Cisco. 2014. Cisco Connected World Technology Report. http://www.cisco.com/c/en/us/solutions/enterprise/connected-world-technology-report/index.html.
[12]
James Clawson, Jessica A. Pater, Andrew D. Miller, Elizabeth D. Mynatt, and Lena Mamykina. 2015. No Longer Wearing: Investigating the Abandonment of Personal Health-Tracking Technologies on Craigslist. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 647--658.
[13]
S. Daan, D. G. Beersma, and Alexander A. Borbély. 1984. Timing of Human Sleep: Recovery Process Gated by a Circadian Pacemaker. American Journal of Physiology - Regulatory, Integrative and Comparative Physiology 246, 2 (Feb. 1984), R161--R183.
[14]
M. Duarte. 2015. Notes on Scientific Computing for Biomechanics and Motor Control. GitHub repository (2015).
[15]
Usama Fayyad, Gregory Piatetsky-Shapiro, and Padhraic Smyth. 1996. The KDD Process for Extracting Useful Knowledge from Volumes of Data. Commun.ACM 39, 11 (1996), 27--34.
[16]
A. Fleury, M. Vacher, and N. Noury. 2010. SVM-Based Multimodal Classification of Activities of Daily Living in Health Smart Homes: Sensors, Algorithms, and First Experimental Results. IEEE Trans Inf Technol Biomed 14, 2 (2010), 274--283.
[17]
Frédéric Flouvat, Jérémy Sanhes, Claude Pasquier, Nazha Selmaoui-Folcher, and Jean-François Boulicaut. 2014. Improving Pattern Discovery Relevancy by Deriving Constraints from Expert Models. In Proceedings of the Twenty-First European Conference on Artificial Intelligence. IOS Press, 327--332.
[18]
Max Hirshkowitz, Kaitlyn Whiton, Steven M. Albert, Cathy Alessi, Oliviero Bruni, Lydia DonCarlos, Nancy Hazen, John Herman, Paula J. Adams Hillard, Eliot S. Katz, Leila Kheirandish-Gozal, David N. Neubauer, Anne E. O'Donnell, Maurice Ohayon, John Peever, Robert Rawding, Ramesh C. Sachdeva, Belinda Setters, Michael V. Vitiello, and J. Catesby Ware. 2015. National Sleep Foundation's Updated Sleep Duration Recommendations: Final Report. Sleep Health: Journal of the National Sleep Foundation 1, 4 (Dec. 2015), 233--243.
[19]
Thomas Kantermann and Till Roenneberg. 2009. Is Light-at-Night a Health Risk Factor or a Health Risk Predictor? Chronobiol Int 26, 6 (Aug. 2009), 1069--1074.
[20]
Matthew Kay, Eun Kyoung Choe, Jesse Shepherd, Benjamin Greenstein, Nathaniel Watson, Sunny Consolvo, and Julie A. Kientz. 2012. Lullaby: A Capture 8 Access System for Understanding the Sleep Environment. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 226--234.
[21]
Jun-Ki Min, Afsaneh Doryab, Jason Wiese, Shahriyar Amini, John Zimmerman, and Jason I. Hong. 2014. Toss'n'turn: Smartphone as Sleep and Sleep Quality Detector. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 477--486.
[22]
Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless Sleep Apnea Detection on Smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 45--57.
[23]
Jacob Poushter. 2016. Smartphone Ownership and Internet Usage Continues to Climb in Emerging Economies. Pew Research Center 22 (2016).
[24]
Tauhidur Rahman, Alexander T. Adams, Ruth Vinisha Ravichandran, Mi Zhang, Shwetak N. Patel, Julie A. Kientz, and Tanzeem Choudhury. 2015. Dopplesleep: A Contactless Unobtrusive Sleep Sensing System Using Short-Range Doppler Radar. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 39--50.
[25]
Till Roenneberg, Karla V. Allebrandt, Martha Merrow, and Céline Vetter. 2012. Social Jetlag and Obesity. Current Biology 22, 10 (May 2012), 939--943.
[26]
Till Roenneberg, Tim Kuehnle, Myriam Juda, Thomas Kantermann, Karla Allebrandt, Marijke Gordijn, and Martha Merrow. 2007. Epidemiology of the Human Circadian Clock. Sleep Medicine Reviews 11, 6 (Dec. 2007), 429--438.
[27]
Till Roenneberg, Anna Wirz-Justice, and Martha Merrow. 2003. Life between Clocks: Daily Temporal Patterns of Human Chronotypes. Journal of biological rhythms 18, 1 (2003), 80--90.
[28]
Mahsan Rofouei, Mike Sinclair, Ray Bittner, Tom Blank, Nick Saw, Gerald DeJean, and Jeff Heffron. 2011. A Non-Invasive Wearable Neck-Cuff System for Real-Time Sleep Monitoring. In Body Sensor Networks (BSN), 2011 International Conference On. IEEE, 156--161.
[29]
Ann E. Rogers, Claire C. Caruso, and Michael S. Aldrich. 1993. Reliability of Sleep Diaries for Assessment of Sleep/Wake Patterns. Nursing research 42, 6 (1993), 368--371.
[30]
Sohrab Saeb, Thaddeus R. Cybulski, Stephen M. Schueller, Konrad P. Kording, and David C. Mohr. 04 18, 2017. Scalable Passive Sleep Monitoring Using Mobile Phones: Opportunities and Obstacles. J. Med. Internet Res. 19, 4 (04 18, 2017), e118.
[31]
Dimitri P. Solomatine and Avi Ostfeld. 2008. Data-Driven Modelling: Some Past Experiences and New Approaches. Journal of hydroinformatics 10, 1 (2008), 3--22.
[32]
Elsa Vulliamy. 2016. These Pictures Show Why You Should Never Charge Your Phone under Your Pillow. http://www.independent.co.uk/news/world/americas/the-pictures-that-show-why-you-should-never-charge-your-phone-under-your-pillow-a6883796.html.
[33]
Olivia J. Walch, Amy Cochran, and Daniel B. Forger. 2016. A Global Quantification of "Normal" Sleep Schedules Using Smartphone Data. Science Advances 2, 5 (May 2016), e1501705.
[34]
Marc Wittmann, Jenny Dinich, Martha Merrow, and Till Roenneberg. 2006. Social Jetlag: Misalignment of Biological and Social Time. Chronobiology International 23, 1-2 (Jan. 2006), 497--509.
[35]
Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S. Jaakkola, and Matt T. Bianchi. 2017. Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture. In International Conference on Machine Learning. 4100--4109.

Cited By

View all
  • (2024)SleepNetProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435088:1(1-34)Online publication date: 6-Mar-2024
  • (2022)Handling Missing Data For Sleep Monitoring Systems2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953832(1-8)Online publication date: 18-Oct-2022
  • (2022)AIM in Wearable and Implantable ComputingArtificial Intelligence in Medicine10.1007/978-3-030-64573-1_299(1187-1201)Online publication date: 18-Feb-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 3
September 2018
1536 pages
EISSN:2474-9567
DOI:10.1145/3279953
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2018
Accepted: 01 September 2018
Revised: 01 May 2018
Received: 01 February 2018
Published in IMWUT Volume 2, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. domain expert knowledge
  2. machine learning
  3. personalisation
  4. sleep detection
  5. smartphone sensors

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)41
  • Downloads (Last 6 weeks)1
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)SleepNetProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435088:1(1-34)Online publication date: 6-Mar-2024
  • (2022)Handling Missing Data For Sleep Monitoring Systems2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII55700.2022.9953832(1-8)Online publication date: 18-Oct-2022
  • (2022)AIM in Wearable and Implantable ComputingArtificial Intelligence in Medicine10.1007/978-3-030-64573-1_299(1187-1201)Online publication date: 18-Feb-2022
  • (2021)Effect of Sleep and Biobehavioral Patterns on Multidimensional Cognitive Performance: Longitudinal, In-the-Wild StudyJournal of Medical Internet Research10.2196/2393623:2(e23936)Online publication date: 18-Feb-2021
  • (2021)Fine-Grained and Context-Aware Behavioral Biometrics for Pattern Lock on SmartphonesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34480805:1(1-30)Online publication date: 30-Mar-2021
  • (2021)AIM in Wearable and Implantable ComputingArtificial Intelligence in Medicine10.1007/978-3-030-58080-3_299-1(1-16)Online publication date: 18-Sep-2021
  • (2020)Inferring Circadian Rhythms of Cognitive Performance in Everyday LifeIEEE Pervasive Computing10.1109/MPRV.2020.299491419:3(14-23)Online publication date: 1-Jul-2020

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media