Performance of a Multisensor Smart Ring to Evaluate Sleep: In-Lab and Home-Based Evaluation Relative to Polysomnography and Actigraphy: Importance of Generalized Versus Personalized Scoring
ABSTRACT
Study Objectives Wearable sleep technology has rapidly expanded across the consumer market due to advances in technology and increased interest in personalized sleep assessment to improve health and mental performance. In this study, we tested the performance of a novel device, the Happy Ring, alongside other commercial wearables, against in-lab polysomnography (PSG) and an at-home EEG-derived sleep monitoring device, the Dreem 2 Headband.
Methods 36 healthy adults with no diagnosed sleep disorders and no recent use of medications or substances known to affect sleep pattern were assessed across 77 nights while wearing the Happy Ring, as well as a set of other consumer wearable devices. Subjects participated in a single night of in-lab PSG and 2 nights of at-home data collection. The Happy Ring includes sensors for skin conductance, movement, heart rate, and skin temperature. The Happy Ring utilized two machine-learning derived scoring algorithms: a “generalized” algorithm that applied broadly to all users, and a “personalized” algorithm that adapted to individual subjects’ data. Epoch-by-epoch analyses compared the wearable devices to both in-lab PSG and to the Dreem 2 EEG Headband (“Dreem 2 Headband”) at home.
Results Compared to in-lab PSG, the “generalized” and “personalized” algorithms demonstrated good sensitivity (94% and 93%, respectively) and specificity (70% and 83%, respectively). Accuracy was 91% for “generalized” and 92% for “personalized” algorithms. The generalized algorithm demonstrated an accuracy of 67%, 85%, and 85% for light, deep, and REM sleep, respectively. The personalized algorithm was 81%, 95%, and 92% accurate for light, deep, and REM sleep, respectively.
Conclusions The Happy Ring performed well at home and in the lab, especially regarding sleep detection. The personalized algorithm demonstrated improved detection accuracy over the generalized approach and other devices, suggesting that adaptable, dynamic algorithms can enhance sleep detection accuracy.
Competing Interest Statement
Zohar Bromberg, Aaron Hadley, Zoe Morrell, Arnulf Graf and Dustin Freckleton are employees of Happy Health, Inc. Michael Grander reports grants from Jazz Pharmaceuticals and CeraZ, and has re-ceived consulting fees in the past 24 months from Fitbit, Natrol, Casper, Athleta, Smartypants Vit-amins, Idorsia, Jazz Pharmaceuticals, New York University, and University of Maryland. Stephen Hutchinson reports no potential conflicts.
Funding Statement
This study did not receive any funding.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Solutions Institutional Review Board gave ethical approval for this work.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Data Accessibility statement: Data from this study are not available due to the raw data being important intellectual property for Happy Health, Inc.
An additional author was added to the manuscript (Aaron Hadley). The manuscript has been revised for clarity, including additional information on statistical significance in differences between devices in an effort to strengthen the validity of the findings. Tables 2 + 4 were combined, and Tables 3 + 5 were moved to Supplemental Materials. Figure 1 was pared down and moved to Supplemental Materials, Figure 2 was pared down, Figures 3 +4 were modified for clarity.
Data Availability
Data from this study are not available due to the raw data being important intellectual property for Happy Health, Inc.
Subject Area
- Addiction Medicine (349)
- Allergy and Immunology (671)
- Anesthesia (181)
- Cardiovascular Medicine (2657)
- Dermatology (224)
- Emergency Medicine (401)
- Epidemiology (12254)
- Forensic Medicine (10)
- Gastroenterology (765)
- Genetic and Genomic Medicine (4116)
- Geriatric Medicine (387)
- Health Economics (681)
- Health Informatics (2666)
- Health Policy (1007)
- Hematology (364)
- HIV/AIDS (854)
- Medical Education (399)
- Medical Ethics (109)
- Nephrology (440)
- Neurology (3899)
- Nursing (210)
- Nutrition (579)
- Oncology (2038)
- Ophthalmology (586)
- Orthopedics (242)
- Otolaryngology (306)
- Pain Medicine (250)
- Palliative Medicine (75)
- Pathology (473)
- Pediatrics (1116)
- Primary Care Research (452)
- Public and Global Health (6542)
- Radiology and Imaging (1407)
- Respiratory Medicine (871)
- Rheumatology (411)
- Sports Medicine (343)
- Surgery (452)
- Toxicology (54)
- Transplantation (185)
- Urology (166)