research-article

FluSense: A Contactless Syndromic Surveillance Platform for Influenza-Like Illness in Hospital Waiting Areas

Authors:

Forsad Al Hossain,

Andrew A. Lover,

George A. Corey,

Nicholas G. Reich,

Tauhidur RahmanAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 4, Issue 1

Article No.: 1, Pages 1 - 28

https://doi.org/10.1145/3381014

Published: 18 March 2020 Publication History

Abstract

We developed a contactless syndromic surveillance platform FluSense that aims to expand the current paradigm of influenza-like illness (ILI) surveillance by capturing crowd-level bio-clinical signals directly related to physical symptoms of ILI from hospital waiting areas in an unobtrusive and privacy-sensitive manner. FluSense consists of a novel edge-computing sensor system, models and data processing pipelines to track crowd behaviors and influenza-related indicators, such as coughs, and to predict daily ILI and laboratory-confirmed influenza caseloads. FluSense uses a microphone array and a thermal camera along with a neural computing engine to passively and continuously characterize speech and cough sounds along with changes in crowd density on the edge in a real-time manner. We conducted an IRB-approved 7 month-long study from December 10, 2018 to July 12, 2019 where we deployed FluSense in four public waiting areas within the hospital of a large university. During this period, the FluSense platform collected and analyzed more than 350,000 waiting room thermal images and 21 million non-speech audio samples from the hospital waiting areas. FluSense can accurately predict daily patient counts with a Pearson correlation coefficient of 0.95. We also compared signals from FluSense with the gold standard laboratory-confirmed influenza case data obtained in the same facility and found that our sensor-based features are strongly correlated with laboratory-confirmed influenza trends.

References

[1]

[n. d.]. ETSI Binaural sound database. https://docbox.etsi.org/stq/Open/TS103224BackgroundNoiseDatabase/Binaural. ([n. d.]).

[2]

[n. d.]. Incidence rate. https://wiki.ecdc.europa.eu/fem/w/wiki/incidence-rate.

[3]

[n. d.]. Intel Neural Compute Stick 2. https://software.intel.com/en-us/neural-compute-stick. ([n. d.]).

[4]

Harshavardhan Achrekar, Avinash Gandhe, Ross Lazarus, Ssu-Hsin Yu, and Benyuan Liu. 2011. Predicting flu trends using twitter data. In 2011 IEEE conference on computer communications workshops (INFOCOM WKSHPS). IEEE, 702--707.

[5]

Benjamin M Althouse, Yih Yng Ng, and Derek AT Cummings. 2011. Prediction of dengue incidence using search query surveillance. PLoS neglected tropical diseases 5, 8 (2011), e1258.

[6]

J. Amoh and K. Odame. 2016. Deep Neural Networks for Identifying Cough Sounds. IEEE Transactions on Biomedical Circuits and Systems 10, 5 (Oct 2016), 1003--1011. https://doi.org/10.1109/TBCAS.2016.2598794

[7]

Samantha J. Barry, Adrie D. Dane, Alyn H. Morice, and Anthony D. Walmsley. 2006. The automatic recognition and counting of cough. Cough 2 (28 Sep 2006), 8--8. https://doi.org/10.1186/1745-9974-2-8 1745-9974-2-8[PII].

[8]

Matthew Biggerstaff, Krista Kniss, Daniel B Jernigan, Lynnette Brammer, Joseph Bresee, Shikha Garg, Erin Burns, and Carrie Reed. 2017. Systematic assessment of multiple routine and near real-time indicators to classify the severity of influenza seasons and pandemics in the United States, 2003-2004 through 2015-2016. American journal of epidemiology 187, 5 (2017), 1040--1050.

[9]

David A Broniatowski, Michael J Paul, and Mark Dredze. 2013. National and local influenza surveillance through Twitter: an analysis of the 2012-2013 influenza epidemic. PloS one 8, 12 (2013), e83672.

[10]

Vivek Charu, Scott Zeger, Julia Gog, Ottar N Bjørnstad, Stephen Kissler, Lone Simonsen, Bryan T Grenfell, and Cécile Viboud. 2017. Human mobility and the spatial transmission of influenza in the United States. PLoS computational biology 13, 2 (2017), e1005382.

[11]

P. Dollar, C. Wojek, B. Schiele, and P. Perona. 2009. Pedestrian detection: A benchmark. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. 304--311. https://doi.org/10.1109/CVPR.2009.5206631

[12]

Wen Dong, Tong Guan, Bruno Lepri, and Chunming Qiao. 2019. PocketCare: Tracking the Flu with Mobile Phones using Partial Observations of Proximity and Symptoms. arXiv preprint arXiv:1905.02607 (2019).

[13]

Andrea Freyer Dugas, Mehdi Jalalpour, Yulia Gel, Scott Levin, Fred Torcaso, Takeru Igusa, and Richard E Rothman. 2013. Influenza forecasting with Google flu trends. PloS one 8, 2 (2013), e56176.

[14]

Gunther Eysenbach. 2006. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. In AMIA Annual Symposium Proceedings, Vol. 2006. American Medical Informatics Association, 244.

[15]

Ashley Fowlkes, Sharoda Dasgupta, Edward Chao, Jennifer Lemmings, Kate Goodin, Meghan Harris, Karen Martin, Michelle Feist, Winfred Wu, Rachelle Boulton, et al. 2013. Estimating influenza incidence and rates of influenza-like illness in the outpatient setting. Influenza and other respiratory viruses 7, 5 (2013), 694--700.

[16]

Marla J Friedman and Magdy W Attia. 2004. Clinical predictors of influenza in children. Archives of pediatrics & adolescent medicine 158, 4 (2004), 391--394.

[17]

L.; Fisher W.; Fiscus J.; Pallett D.; Dahlgren N. Garofolo, J.; Lamel. 1990. TIMIT Acoustic-Phonetic Continuous Speech Corpus CD-ROM. (1990).

[18]

J. F. Gemmeke, D. P. W. Ellis, D. Freedman, A. Jansen, W. Lawrence, R. C. Moore, M. Plakal, and M. Ritter. 2017. Audio Set: An ontology and human-labeled dataset for audio events. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 776--780. https://doi.org/10.1109/ICASSP.2017.7952261

[19]

Jack M Gwaltney Jr. 2002. Clinical significance and pathogenesis of viral respiratory infections. The American journal of medicine 112, 6 (2002), 13--18.

[20]

Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. CoRR abs/1704.04861 (2017).

[21]

Jonathan Huang, Vivek Rathod, Chen Sun, Menglong Zhu, Anoop Korattikara Balan, Alireza Fathi, Ian Fischer, Zbigniew Wojna, Yang Song, Sergio Guadarrama, and Kevin Murphy. 2017. Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017), 3296--3297.

[22]

M. Jeub, M. Schafer, and P. Vary. 2009. A binaural room impulse response database for the evaluation of dereverberation algorithms. In 2009 16th International Conference on Digital Signal Processing. 1--5. https://doi.org/10.1109/ICDSP.2009.5201259

[23]

C. H. Knapp and G. Clifford Carter. 1976. The generalized correlation method for estimation of time delay.

[24]

E.C. Larson, T. Lee, S. Liu, M. Rosenfeld, and S.N. Patel. 2011. Accurate and Privacy Preserving Cough Sensing Using a Low-cost Microphone (UbiComp '11). 375--384.

[25]

David Lazer, Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014. The parable of Google Flu: traps in big data analysis. Science 343, 6176 (2014), 1203--1205.

[26]

S. Le and W. Hu. 2013. Cough sound recognition based on Hilbert marginal spectrum. 03 (Dec 2013), 1346--1350. https://doi.org/10.1109/CISP.2013.6743882

[27]

Tsung-Yi Lin, Michael Maire, Serge J. Belongie, Lubomir D. Bourdev, Ross B. Girshick, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. In ECCV.

[28]

J. Liu, M. You, G. Li, Z. Wang, X. Xu, Z. Qiu, W. Xie, C. An, and S. Chen. 2013. Cough signal recognition with Gammatone Cepstral Coefficients. In 2013 IEEE China Summit and International Conference on Signal and Information Processing. 160--164. https://doi.org/10.1109/ChinaSIP.2013.6625319

[29]

Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott E. Reed, Cheng-Yang Fu, and Alexander C. Berg. 2016. SSD: Single Shot MultiBox Detector. In ECCV.

[30]

S. Matos, S. S. Birring, I. D. Pavord, and H. Evans. 2006. Detection of cough signals in continuous audio recordings using hidden Markov models. IEEE Transactions on Biomedical Engineering 53, 6 (June 2006), 1078--1083. https://doi.org/10.1109/TBME.2006.873548

[31]

Noelle-Angelique M Molinari, Ismael R Ortega-Sanchez, Mark L Messonnier, William W Thompson, Pascale M Wortley, Eric Weintraub, and Carolyn B Bridges. 2007. The annual impact of seasonal influenza in the US: measuring disease burden and costs. Vaccine 25, 27 (2007), 5086--5096.

[32]

Arnold S Monto, Stefan Gravenstein, Michael Elliott, Michael Colopy, and Jo Schweinle. 2000. Clinical signs and symptoms predicting influenza infection. Archives of internal medicine 160, 21 (2000), 3243--3247.

[33]

Vinod Nair and Geoffrey E. Hinton. 2010. Rectified Linear Units Improve Restricted Boltzmann Machines. In Proceedings of the 27th International Conference on International Conference on Machine Learning (ICML'10). Omnipress, USA, 807--814. http://dl.acm.org/citation.cfm?id=3104322.3104425

Digital Library

[34]

Elaine O Nsoesie, Patrick Butler, Naren Ramakrishnan, Sumiko R Mekaru, and John S Brownstein. 2015. Monitoring disease trends using hospital traffic data from high resolution satellite imagery: A feasibility study. Scientific reports 5 (2015), 9112.

[35]

Dave Osthus, Ashlynn R Daughton, and Reid Priedhorsky. 2019. Even a good influenza forecasting model can benefit from internet-based nowcasts, but those benefits are limited. PLoS computational biology 15, 2 (2019), e1006599.

[36]

Philip M Polgreen, Yiling Chen, David M Pennock, Forrest D Nelson, and Robert A Weinstein. 2008. Using internet searches for influenza surveillance. Clinical infectious diseases 47, 11 (2008), 1443--1448.

[37]

Sourabh Ravindran, David V. Anderson, and Malcolm Slaney. 2006. Improving the noise-robustness of mel-frequency cepstral coefficients for speech processing. In SAPA@INTERSPEECH.

[38]

Shaoqing Ren, Kaiming He, Ross B. Girshick, and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (2015), 1137--1149.

Digital Library

[39]

Bernhard R Ruf and Markus Knuf. 2014. The burden of seasonal and pandemic influenza in infants and children. European journal of pediatrics 173, 3 (2014), 265--276.

[40]

Tara N. Sainath and Carolina Parada. 2015. Convolutional neural networks for small-footprint keyword spotting. In INTERSPEECH.

[41]

Jeffrey Shaman, Sasikiran Kandula, Wan Yang, and Alicia Karspeck. 2017. The use of ambient humidity conditions to improve influenza forecast. PLoS computational biology 13, 11 (2017), e1005844.

[42]

Alessio Signorini, Alberto Maria Segre, and Philip M Polgreen. 2011. The use of Twitter to track levels of disease activity and public concern in the US during the influenza A H1N1 pandemic. PloS one 6, 5 (2011), e19467.

[43]

Christian Szegedy, Sergey Ioffe, and Vincent Vanhoucke. 2016. Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. In AAAI.

[44]

Shinya Takahashi, Tsuyoshi Morimoto, Sakashi Maeda, and Naoyuki Tsuruta. 2004. Cough detection in spoken dialogue system for home health care. In INTERSPEECH.

[45]

J. Thiemann, N. Ito, and E. Vincent. 2013. The diverse environments multi-channel acoustic noise database: A database of multichannel environmental noise recordings. Acoustical Society of America Journal 133 (2013), 3591. https://doi.org/10.1121/1.4806631

[46]

https://www.alere.com/en/home/product-details/id-now.html. [n.d.]. ([n.d.]). Abbott ID NOW Rapit Influenza Test.

[47]

https://www.thermal.com/compact-series.html/. [n. d.]. ([n. d.]). Seek CompactPRO: Thermal Camera.

[48]

http://wiki.seeedstudio.com/ReSpeaker_Mic_Array_v2.0/. [n.d.]. ([n.d.]). ReSpeaker: Microphone Array V2.

[49]

US Centers for Disease Control and Prevention. 2018. Overview of Influenza Surveillance in the United States. (2018). https://www.cdc.gov/flu/weekly/overview.htm.

[50]

US Centers for Disease Control and Prevention. 2018. Past Seasons Estimated Influenza Disease Burden. (2018). https://www.cdc.gov/flu/about/burden/past-seasons.html.

[51]

Yuxin Wu and Kaiming He. 2018. Group Normalization. In ECCV.

[52]

C. Zhu, L. Tian, X. Li, H. Mo, and Z. Zheng. 2013. Recognition of cough using features improved by sub-band energy transformation. In 2013 6th International Conference on Biomedical Engineering and Informatics. 251--255. https://doi.org/10.1109/BMEI.2013.6746943

Cited By

Al Hossain FTonmoy MNuvvula SChapman BGupta RLover ADinglasan RCarreiro SRahman T(2024)Syndromic surveillance of population-level COVID-19 burden with cough monitoring in a hospital emergency waiting roomFrontiers in Public Health10.3389/fpubh.2024.127939212Online publication date: 28-Mar-2024
https://doi.org/10.3389/fpubh.2024.1279392
Singh KKaur NPrabhu A(2024)Combating COVID-19 Crisis using Artificial Intelligence (AI) Based Approach: Systematic ReviewCurrent Topics in Medicinal Chemistry10.2174/011568026628217924012407212124:8(737-753)Online publication date: Mar-2024
https://doi.org/10.2174/0115680266282179240124072121
Bahrami MTorooghi Haghighat AMehdipour F(2024)Empowering Medical Staff: IoT-Based Smart Shield for Early Detection of Acute Respiratory DiseasesProceedings of the 2024 9th International Conference on Multimedia and Image Processing10.1145/3665026.3665037(72-77)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3665026.3665037
Show More Cited By

Index Terms

FluSense: A Contactless Syndromic Surveillance Platform for Influenza-Like Illness in Hospital Waiting Areas
1. Applied computing
  1. Life and medical sciences

Recommendations

FluSense: Harnessing Syndromic Signals of Influenza-Like Illness from Hospital Waiting Room Crowd with Contactless Sensing System

Influenza is a highly contagious respiratory infection that leads to regular seasonal epidemics. It is a major contributor to morbidity and mortality, and in the United States, since 2010, it has infected between 9.2 million and 60.8 million people and ...
Influenza surveillance and forecast with smartphone sensors

In this paper we introduce an influenza surveillance and forecast system (ISFS) that can track the proliferation of influenza and predict potential infections by analyzing smartphone sensor readings. While previous studies investigate social ...
Intelligent monitoring for infectious diseases with fuzzy systems and edge computing: A survey
Abstract
Infectious diseases usually have the characteristics of rapid spread with a large impact range. Once they break out, they will cause a large area of infection, which creates tremendous health and security risks. Thus, early infectious ...
Highlights
- The novel technologies based on fuzzy systems are summarized.
- The applications ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 4, Issue 1

March 2020

1006 pages

EISSN:2474-9567

DOI:10.1145/3388993

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2020

Published in IMWUT Volume 4, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Institutes of Health

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

74
Total Citations
View Citations
2,348
Total Downloads

Downloads (Last 12 months)181
Downloads (Last 6 weeks)17

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Al Hossain FTonmoy MNuvvula SChapman BGupta RLover ADinglasan RCarreiro SRahman T(2024)Syndromic surveillance of population-level COVID-19 burden with cough monitoring in a hospital emergency waiting roomFrontiers in Public Health10.3389/fpubh.2024.127939212Online publication date: 28-Mar-2024
https://doi.org/10.3389/fpubh.2024.1279392
Singh KKaur NPrabhu A(2024)Combating COVID-19 Crisis using Artificial Intelligence (AI) Based Approach: Systematic ReviewCurrent Topics in Medicinal Chemistry10.2174/011568026628217924012407212124:8(737-753)Online publication date: Mar-2024
https://doi.org/10.2174/0115680266282179240124072121
Bahrami MTorooghi Haghighat AMehdipour F(2024)Empowering Medical Staff: IoT-Based Smart Shield for Early Detection of Acute Respiratory DiseasesProceedings of the 2024 9th International Conference on Multimedia and Image Processing10.1145/3665026.3665037(72-77)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3665026.3665037
Chhaglani BZakaria CPeltier RGummeson JShenoy P(2024)AeroSense: Sensing Aerosol Emissions from Indoor Human ActivitiesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595938:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659593
Al Hossain FTonmoy MLover ACorey GAlam MRahman TXu CDavies N(2024)Crowdotic: A Privacy-Preserving Hospital Waiting Room Crowd Density Estimation with Non-speech AudioProceedings of the 25th International Workshop on Mobile Computing Systems and Applications10.1145/3638550.3641133(79-85)Online publication date: 28-Feb-2024
https://dl.acm.org/doi/10.1145/3638550.3641133
Liang KChen JHe TWang WSingh ARawat DSong HLyu Z(2024)Review of the Open Data Sets for Contactless SensingIEEE Internet of Things Journal10.1109/JIOT.2024.335183811:11(19000-19022)Online publication date: 1-Jun-2024
https://doi.org/10.1109/JIOT.2024.3351838
Kim SNam HChoi SPark Y(2024)Real-Time Sound Recognition System for Human Care Robot Considering Custom Sound EventsIEEE Access10.1109/ACCESS.2024.337809612(42279-42294)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3378096
Li CYe GJiang YWang ZYu HYang M(2024)Artificial Intelligence in battling infectious diseases: A transformative roleJournal of Medical Virology10.1002/jmv.2935596:1Online publication date: 5-Jan-2024
https://doi.org/10.1002/jmv.29355
Prasad PNair PPatil APatil NChaturvedi ATaqui SAlmoallim HAlharbi SRaghavan S(2023)An application development for smart monitoring of COVID patients using six stage microbiological health systemsJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23189945:3(4383-4393)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.3233/JIFS-231899
Barata FCleres DTinschert PIris Shih CRassouli FBoesch MBrutsche MFleisch E(2023)Nighttime Continuous Contactless Smartphone-Based Cough Monitoring for the Ward: Validation StudyJMIR Formative Research10.2196/384397(e38439)Online publication date: 20-Feb-2023
https://doi.org/10.2196/38439
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents