Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A Review of Cognitive Assistants for Healthcare: Trends, Prospects, and Future Directions

Published: 02 February 2021 Publication History

Abstract

Healthcare cognitive assistants (HCAs) are intelligent systems or agents that interact with users in a context-aware and adaptive manner to improve their health outcomes by augmenting their cognitive abilities or complementing a cognitive impairment. They assist a wide variety of users ranging from patients to their healthcare providers (e.g., general practitioner, specialist, surgeon) in several situations (e.g., remote patient monitoring, emergency response, robotic surgery). While HCAs are critical to ensure personalized, scalable, and efficient healthcare, there exists a knowledge gap in finding the emerging trends, key challenges, design guidelines, and state-of-the-art technologies suitable for developing HCAs. This survey aims to bridge this gap for researchers from multiple domains, including but not limited to cyber-physical systems, artificial intelligence, human-computer interaction, robotics, and smart health. It provides a comprehensive definition of HCAs and outlines a novel, practical categorization of existing HCAs according to their target user role and the underlying application goals. This survey summarizes and assorts existing HCAs based on their characteristic features (i.e., interactive, context-aware, and adaptive) and enabling technological aspects (i.e., sensing, actuation, control, and computation). Finally, it identifies critical research questions and design recommendations to accelerate the development of the next generation of cognitive assistants for healthcare.

Supplementary Material

a130-preum-supp.pdf (preum.zip)
Supplemental movie, appendix, image and software files for, A Review of Cognitive Assistants for Healthcare: Trends, Prospects, and Future Directions

References

[1]
Azizi Ab Aziz, Ali Saad Fahad, and Faudziah Ahmad. 2017. CAKNA: A personalized robot-based platform for anxiety states therapy. In Intelligent Environments (Workshops). IOS Press, 141--150.
[2]
Saleh Ahmed, Mahboob Qaosar, Rizka Wakhidatus Sholikah, and Yasuhiko Morimoto. 2018. Early dementia detection through conversations to virtual personal assistant. In Proceedings of the AAAI Spring Symposium Series (AAAI’18).
[3]
Dragan Ahmetovic, Cole Gleason, Chengxiong Ruan, Kris Kitani, Hironobu Takagi, and Chieko Asakawa. 2016. NavCog: A navigational cognitive assistant for the blind. In Proceedings of the 18th International Conference on Human-computer Interaction with Mobile Devices and Services. ACM, 90--99.
[4]
Rodolfo S. Antunes, Lucas A. Seewald, Vinicius F. Rodrigues, Cristiano A. Da Costa, Rodrigo R. Righi, Andreas Maier, Björn Eskofier, Malte Ollenschläger, Farzad Naderi, Rebecca Fahrig, et al. 2018. A survey of sensors in healthcare workflow monitoring. ACM Comput. Surv. 51, 2 (2018), 42.
[5]
Babylon. 2019. Babylon Talk-to-a-Doctor: Our end-to-end services enable providers to deliver flexible, accessible healthcare. Retrieved from https://www.babylonhealth.com/us/our-services/talk-to-a-doctor.
[6]
Omar Badawi and Michael J. Breslow. 2012. Readmissions and death after ICU discharge: Development and validation of two predictive models. PloS One 7, 11 (2012).
[7]
Shahram Bahadori, Amedeo Cesta, Giorgio Grisetti, Luca Iocchi, R. Leone, Daniele Nardi, Angelo Oddi, Federico Pecora, and Riccardo Rasconi. 2003. Robocare: An integrated robotic system for the domestic care of the elderly. In Proceedings of the Workshop on Ambient Intelligence. Citeseer.
[8]
Jérémy Bauchet, Hélène Pigot, Sylvain Giroux, Dany Lussier-Desrochers, Yves Lachapelle, and Mounir Mokhtari. 2009. Designing judicious interactions for cognitive assistance: The acts of assistance approach. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 11--18.
[9]
Timothy W. Bickmore, Everlyne Kimani, Ha Trinh, Alexandra Pusateri, Michael K. Paasche-Orlow, and Jared W. Magnani. 2018. Managing chronic conditions with a smartphone-based conversational virtual agent. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. 119--124.
[10]
Marion Blount, Maria R. Ebling, J. Mikael Eklund, Andrew G. James, Carolyn McGregor, Nathan Percival, Kathleen P. Smith, and Daby Sow. 2010. Real-time analysis for intensive care. IEEE Eng. Med. Biol. Mag. 29, 2 (2010), 110.
[11]
Antonio Padilha Lanari Bo, Mitsuhiro Hayashibe, and Philippe Poignet. 2011. Joint angle estimation in rehabilitation with inertial sensors and its integration with Kinect. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 3479--3483.
[12]
Nathalie Bricon-Souf and Conrad R. Newman. 2007. Context awareness in health care: A review. Int. J. Med. Inf. 76, 1 (2007), 2--12.
[13]
Elizabeth Broadbent, Rebecca Stafford, and Bruce MacDonald. 2009. Acceptance of healthcare robots for the older population: Review and future directions. Int. J. Social Robot. 1, 4 (2009), 319.
[14]
Manuel G. Calvo and Daniel Lundqvist. 2008. Facial expressions of emotion (KDEF): Identification under different display-duration conditions. Behav. Res. Meth. 40, 1 (2008), 109--115.
[15]
Leo Anthony Celi, Benjamin Fine, and David J. Stone. 2019. An awakening in medicine: The partnership of humanity and intelligent machines. Lancet Dig. Health 1, 6 (2019), e255–e257.
[16]
Chien-Yen Chang, Belinda Lange, Mi Zhang, Sebastian Koenig, Phil Requejo, Noom Somboon, Alexander A. Sawchuk, and Albert A. Rizzo. 2012. Towards pervasive physical rehabilitation using Microsoft Kinect. In Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth’12) and Workshops. IEEE, 159--162.
[17]
Yao-Jen Chang, Shu-Fang Chen, and Jun-Da Huang. 2011. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disab. 32, 6 (2011), 2566--2570.
[18]
Yao-Jen Chang, Ya-Shu Kang, and Po-Chiao Huang. 2013. An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disab. 34, 10 (2013), 3049--3056.
[19]
Irene Alice Chicchi Giglioli, Federica Pallavicini, Elisa Pedroli, Silvia Serino, and Giuseppe Riva. 2015. Augmented reality: A brand new challenge for the assessment and treatment of psychological disorders. Comput. Math. Meth. Med. 2015 (2015).
[20]
Ângelo Costa, Ester Martinez-Martin, Angel P. Del Pobil, Ricardo Simoes, and Paulo Novais. 2013. Find it–An assistant home agent. In Trends in Practical Applications of Agents and Multiagent Systems. Springer, 121--128.
[21]
Angelo Croatti, Sara Montagna, and Alessandro Ricci. 2017. A personal medical digital assistant agent for supporting human operators in emergency scenarios. In Agents and Multi-agent Systems for Health Care. Springer, 59--75.
[22]
Angelo Croatti, Sara Montagna, Alessandro Ricci, Emiliano Gamberini, Vittorio Albarello, and Vanni Agnoletti. 2019. BDI personal medical assistant agents: The case of trauma tracking and alerting. Artif. Intell. Med. 96 (2019), 187--197.
[23]
David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, et al. 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of the International Conference on Autonomous Agents and Multi-agent Systems. 1061--1068.
[24]
NHS Digital. 2018. Overview—Laryngeal (larynx) cancer. Retrieved from https://www.nhs.uk/conditions/laryngeal-cancer/.
[25]
Felipe Augusto dos Santos Mendes, José Eduardo Pompeu, Alexandra Modenesi Lobo, Keyte Guedes da Silva, Tatiana de Paula Oliveira, Andrea Peterson Zomignani, and Maria Elisa Pimentel Piemonte. 2012. Motor learning, retention and transfer after virtual-reality-based training in Parkinson’s disease-Effect of motor and cognitive demands of games: A longitudinal, controlled clinical study. Physiotherapy 98, 3 (2012), 217--223.
[26]
Joanna Ejdys and Katarzyna Halicka. 2018. Sustainable adaptation of new technology—The case of humanoids used for the care of older adults. Sustainability 10, 10 (2018), 3770.
[27]
Susan Feldman. 2000. The answer machine. Searcher 8, 1 (2000).
[28]
George Ferguson, Jill Quinn, Cecilia Horwitz, M. Swift, J. Allen, and Lucian Galescu. 2010. Towards a personal health management assistant. J. Biomed. Inform. 43, 5 (2010), S13–S16.
[29]
Lorenzo Fernandez Maimo, Alberto Huertas Celdran, Angel L. Perales Gomez, García Clemente, J. Félix, James Weimer, and Insup Lee. 2019. Intelligent and dynamic ransomware spread detection and mitigation in integrated clinical environments. Sensors 19, 5 (2019), 1114.
[30]
Brian French, Divya Tyamagundlu, Daniel P. Siewiorek, Asim Smailagic, and Dan Ding. 2008. Towards a virtual coach for manual wheelchair users. In Proceedings of the 12th IEEE International Symposium on Wearable Computers. IEEE, 77--80.
[31]
Yarin Gal. 2016. Uncertainty in Deep Learning. Ph.D. Dissertation. University of Cambridge.
[32]
Luciano Gamberini, Francesco Martino, Bruno Seraglia, Anna Spagnolli, Malena Fabregat, Francisco Ibanez, Mariano Alcaniz, and Javier Montesa Andrés. 2009. Eldergames project: An innovative mixed reality table-top solution to preserve cognitive functions in elderly people. In Proceedings of the 2nd Conference on Human System Interactions. IEEE, 164--169.
[33]
Asma Ghandeharioun, Daniel McDuff, Mary Czerwinski, and Kael Rowan. 2018. EMMA: An emotionally intelligent personal assistant for improving wellbeing. arXiv preprint arXiv:1812.11423 (2018).
[34]
Shameek Ghosh, Sammi Bhatia, and Abhi Bhatia. 2018. Quro: Facilitating user symptom check using a personalised chatbot-oriented dialogue system. Stud. Health Technol. Inform. 252 (2018), 51--56.
[35]
Alex Gillespie, Catherine Best, and Brian O’Neill. 2012. Cognitive function and assistive technology for cognition: A systematic review. J. Int. Neuropsychol. Society 18, 1 (2012), 1--19.
[36]
Sylvain Giroux, Nathalie Bier, Hélène Pigot, Bruno Bouchard, Abdenour Bouzouane, Mélanie Levasseur, Mélanie Couture, Carolina Bottari, Bonnie Swaine, Pierre-Yves Therriault, et al. 2015. Cognitive assistance to meal preparation: Design, implementation, and assessment in a living lab. In Proceedings of the AAAI Spring Symposium Series.
[37]
Reginald G. Golledge et al. 1999. Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes. JHU press.
[38]
Pedro Pablo Gomez, Ross E. Willis, and Kent R. Van Sickle. 2015. Development of a virtual reality robotic surgical curriculum using the da Vinci SI surgical system. Surg. Endosc. 29, 8 (2015), 2171--2179.
[39]
D. González-Ortega, F. J. Díaz-Pernas, Mario Martínez-Zarzuela, and Miriam Antón-Rodríguez. 2014. A Kinect-based system for cognitive rehabilitation exercises monitoring. Comput. Meth. Prog. Biomed. 113, 2 (2014), 620--631.
[40]
Kiryong Ha, Zhuo Chen, Wenlu Hu, Wolfgang Richter, Padmanabhan Pillai, and Mahadev Satyanarayanan. 2014. Towards wearable cognitive assistance. In Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 68--81.
[41]
Glenn I. Hawe, Graham Coates, Duncan T. Wilson, and Roger S. Crouch. 2012. Agent-based simulation for large-scale emergency response: A survey of usage and implementation. ACM Comput. Surv. 45, 1 (2012), 8.
[42]
Marion Hersh. 2015. Overcoming barriers and increasing independence-Service robots for elderly and disabled people. Int. J. Adv. Robot. Syst. 12, 8 (2015), 114.
[43]
Ramón Hervás, José Bravo, and Jesús Fontecha. 2013. An assistive navigation system based on augmented reality and context awareness for people with mild cognitive impairments. IEEE J. Biomed. Health Inform. 18, 1 (2013), 368--374.
[44]
Jesse Hoey, Craig Boutilier, Pascal Poupart, Patrick Olivier, Andrew Monk, and Alex Mihailidis. 2012. People, sensors, decisions: Customizable and adaptive technologies for assistance in healthcare. ACM Trans. Interact. Intell. Syst. 2, 4 (2012), 20.
[45]
Hossein Mousavi Hondori, Maryam Khademi, Lucy Dodakian, Steven C. Cramer, and Cristina Videira Lopes. 2013. A spatial augmented reality rehab system for post-stroke hand rehabilitation. In Stud. Health Technol. Inform. 184. 279--285.
[46]
Enamul Hoque, Robert F. Dickerson, Sarah M. Preum, Mark Hanson, Adam Barth, and John A. Stankovic. 2015. Holmes: A comprehensive anomaly detection system for daily in-home activities. In Proceedings of the International Conference on Distributed Computing in Sensor Systems. IEEE, 40--51.
[47]
John Hu, Aaron Edsinger, Yi-Je Lim, Nick Donaldson, Mario Solano, Aaron Solochek, and Ronald Marchessault. 2011. An advanced medical robotic system augmenting healthcare capabilities-robotic nursing assistant. In Proceedings of the IEEE International Conference on Robotics and Automation. IEEE, 6264--6269.
[48]
Rajibul Huq, Patricia Kan, Robby Goetschalckx, Debbie Hébert, Jesse Hoey, and Alex Mihailidis. 2011. A decision-theoretic approach in the design of an adaptive upper-limb stroke rehabilitation robot. In Proceedings of the IEEE International Conference on Rehabilitation Robotics. IEEE, 1--8.
[49]
Inc Intuitive Surgical. 2019. SimNow from da Vinci. Retrieved from https://tinyurl.com/y5ubtgdt.
[50]
Sajid Iqbal, Wasif Altaf, Muhammad Aslam, Waqar Mahmood, and Muhammad Usman Ghani Khan. 2016. Application of intelligent agents in health-care. Artif. Intell. Rev. 46, 1 (2016), 83--112.
[51]
David Isern and Antonio Moreno. 2016. A systematic literature review of agents applied in healthcare. J. Med. Syst. 40, 2 (2016), 43.
[52]
François Jammes, Antoine Mensch, and Harm Smit. 2007. Service-oriented device communications using the devices profile for web services. In Proceedings of the 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW’07), Vol. 1. IEEE, 947--955.
[53]
Minoa Jung, A. Hoerbst, W. O. Hackl, F. Kirrane, D. Borbolla, M. W. Jaspers, M. Oertle, V. Koutkias, L. Ferret, P. Massari, et al. 2013. Attitude of physicians towards automatic alerting in computerized physician order entry systems. Meth. Inf. Med. 52, 02 (2013), 99--108.
[54]
Leslie Kay. 1974. A sonar aid to enhance spatial perception of the blind: Engineering design and evaluation. Radio Electron. Eng. 44, 11 (1974), 605--627.
[55]
John E. Kelly III and Steve Hamm. 2013. Smart Machines: IBM’s Watson and the Era of Cognitive Computing. Columbia University Press.
[56]
Maryam Khademi, Hossein Mousavi Hondori, Cristina Videira Lopes, Lucy Dodakian, and Steve C. Cramer. 2012. Haptic augmented reality to monitor human arm’s stiffness in rehabilitation. In Proceedings of the IEEE-EMBS Conference on Biomedical Engineering and Sciences. IEEE, 892--895.
[57]
Naofumi Kitsunezaki, Eijiro Adachi, Takashi Masuda, and Jun-ichi Mizusawa. 2013. KINECT applications for the physical rehabilitation. In Proceedings of the IEEE International Symposium on Medical Measurements and Applications (MeMeA’13). IEEE, 294--299.
[58]
M. Sun Kohn, J. Sun, S. Knoop, A. Shabo, B. Carmeli, D. Sow, T. Syed-Mahmood, and W. Rapp. 2014. IBM’s health analytics and clinical decision support. Yearb. Med. Inform. 23, 01 (2014), 154--162.
[59]
Matthieu Komorowski, Leo A. Celi, Omar Badawi, Anthony C. Gordon, and A. Aldo Faisal. 2018. The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat. Med. 24, 11 (2018), 1716--1720.
[60]
Belinda Lange, Chien-Yen Chang, Evan Suma, Bradley Newman, Albert Skip Rizzo, and Mark Bolas. 2011. Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 1831--1834.
[61]
Liliana Laranjo, Adam G. Dunn, Huong Ly Tong, Ahmet Baki Kocaballi, Jessica Chen, Rabia Bashir, Didi Surian, Blanca Gallego, Farah Magrabi, Annie Y. S. Lau, et al. 2018. Conversational agents in healthcare: A systematic review. J. Amer. Med. Inform. Assoc. 25, 9 (2018), 1248--1258.
[62]
Young Hoon Lee and Gérard Medioni. 2011. RGB-D camera based navigation for the visually impaired. In Proceedings of the Robotics: Science and Systems Conference (RSS’11).
[63]
Young Hoon Lee and Gerard Medioni. 2014. Wearable RGBD indoor navigation system for the blind. In Proceedings of the European Conference on Computer Vision. Springer, 493--508.
[64]
Manning Li, Jie Hou, Henry Zhang, et al. 2014. A tale of two virtual advisors: An empirical study investigating the empowerment effect of mobile mental-health advisory systems on emergency rescuers. In Proceedings of the Pacific Asia Conference on Information Systems (PACIS’14). 227.
[65]
Manning Li, Zhenhui Jack Jiang, Zhiping Fan, and Jie Hou. 2017. Expert or peer? Understanding the implications of virtual advisor identity on emergency rescuer empowerment in mobile psychological self-help services. Inf. Manag. 54, 7 (2017), 866--886.
[66]
Ruijiao Li, Bowen Lu, and Klaus D. McDonald-Maier. 2015. Cognitive assisted living ambient system: A survey. Dig. Commun. Netw. 1, 4 (2015), 229--252.
[67]
Christine Lisetti, Reza Amini, Ugan Yasavur, and Naphtali Rishe. 2013. I can help you change! An empathic virtual agent delivers behavior change health interventions. ACM Trans. Manag. Inf. Syst. 4, 4 (2013), 19.
[68]
Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C. Berg. 2016. SSD: Single shot multibox detector. In Proceedings of the European Conference on Computer Vision. Springer, 21--37.
[69]
Yang Liu, Noelle R. B. Stiles, and Markus Meister. 2018. Augmented reality powers a cognitive assistant for the blind. eLife 7 (2018), e37841.
[70]
MultiMedia LLC. 2016. Intelligent Cognitive Assistants: Workshop Summary and Recommendations. Retrieved from https://www.nsf.gov/crssprgm/nano/reports/2016-1003_ICA_Workshop_Final_Report_2016.pdf.
[71]
Jack M. Loomis, Reginald G. Golledge, and Roberta L. Klatzky. 1998. Navigation system for the blind: Auditory display modes and guidance. Presence 7, 2 (1998), 193--203.
[72]
Meiyi Ma, Sarah Masud Preum, and John A. Stankovic. 2017. Cityguard: A watchdog for safety-aware conflict detection in smart cities. In Proceedings of the 2nd International Conference on Internet-of-things Design and Implementation. 259--270.
[73]
Meiyi Ma, John A. Stankovic, and Lu Feng. 2018. CityResolver: A decision support system for conflict resolution in smart cities. In Proceedings of the ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS’18). IEEE, 55--64.
[74]
Andrea Britto Mattos and Dario Augusto Borges Oliveira. 2018. Multi-view mouth renderization for assisting lip-reading. In ACM Proc. Internet Access. Things. 28 (Apr. 2018) 1--10.
[75]
Alex Mihailidis, Brent Carmichael, and Jennifer Boger. 2004. The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home. IEEE Trans. Inf. Technol. Biomed. 8, 3 (2004), 238--247.
[76]
Inc Mimic Technologies. 2019. dV-Trainer. Retrieved from https://mimicsimulation.com/dv-trainer/.
[77]
Adam S. Miner, Nigam Shah, Kim D. Bullock, Bruce A. Arnow, Jeremy Bailenson, and Jeff Hancock. 2019. Key considerations for incorporating conversational AI in psychotherapy. Front. Psychi. 10 (2019).
[78]
Sara Montagna, Angelo Croatti, Alessandro Ricci, Vanni Agnoletti, Vittorio Albarello, and Emiliano Gamberini. 2020. Real-time tracking and documentation in trauma management. Health Inform. J. 26, 1 (2020), 328--341.
[79]
Fariba Mostajeran, Nikolaos Katzakis, Oscar Ariza, Jann Philipp Freiwald, and Frank Steinicke. 2019. Welcoming a holographic virtual coach for balance training at home: Two focus groups with older adults. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’19). IEEE, 1465--1470.
[80]
Sirajum Munir, Mohsin Ahmed, and John Stankovic. 2015. Eyephy: Detecting dependencies in cyber-physical system apps due to human-in-the-loop. In Proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. Citeseer, 170--179.
[81]
Sirajum Munir and John A. Stankovic. 2014. DepSys: Dependency aware integration of cyber-physical systems for smart homes. In Proceedings of the ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS’14). IEEE, 127--138.
[82]
David J. Musliner, James A. Hendler, Ashok K. Agrawala, Edmund H. Durfee, Jay K. Strosnider, and C. J. Paul. 1995. The challenges of real-time AI. Computer 28, 1 (1995), 58--66.
[83]
Alexander Neumann, Christof Elbrechter, Nadine Pfeiffer-Leßmann, Risto Kõiva, Birte Carlmeyer, Stefan Rüther, Michael Schade, André Ückermann, Sven Wachsmuth, and Helge J. Ritter. 2017. KogniChef: A cognitive cooking assistant. KI-Künstl. Intell. 31, 3 (2017), 273--281.
[84]
Quoc-Hung Nguyen, Hai Vu, Thanh-Hai Tran, and Quang-Hoan Nguyen. 2017. Developing a way-finding system on mobile robot assisting visually impaired people in an indoor environment. Multimedia Tools Applic. 76, 2 (2017), 2645--2669.
[85]
Ahmed K. Noor. 2015. Potential of cognitive computing and cognitive systems. Open Eng. 5, 1 (2015), 75--88.
[86]
John Oakley. 2018. Intelligent Cognitive Assistants: Workshop Summary and Recommendations. Retrieved from https://www.nsf.gov/crssprgm/nano/reports/ICA2_Workshop_Report_2018.pdf.
[87]
Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (2019), 447--453.
[88]
Eshed Ohn-Bar, Kris Kitani, and Chieko Asakawa. 2018. Personalized dynamics models for adaptive assistive navigation systems. In Proceedings of the Conference on Robot Learning. 16--39.
[89]
Nashwan Adnan Othman and Ilhan Aydin. 2018. A new deep learning application based on Movidius NCS for embedded object detection and recognition. In Proceedings of the 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT’18). IEEE, 1--5.
[90]
Nicolas Padoy, Tobias Blum, Seyed-Ahmad Ahmadi, Hubertus Feussner, Marie-Odile Berger, and Nassir Navab. 2012. Statistical modeling and recognition of surgical workflow. Med. Image Anal. 16, 3 (2012), 632--641.
[91]
Sarah Parsons and Peter Mitchell. 2002. The potential of virtual reality in social skills training for people with autistic spectrum disorders. J. Intell. Disab. Res. 46, 5 (2002), 430--443.
[92]
Paul Phamduy, John-Ross Rizzo, Todd E. Hudson, Marina Torre, Kalle Levon, and Maurizio Porfiri. 2017. Communicating through touch: Macro fiber composites for tactile stimulation on the abdomen. IEEE Trans. Haptics 11, 2 (2017), 174--184.
[93]
Martha E. Pollack, Laura Brown, Dirk Colbry, Cheryl Orosz, Bart Peintner, Sailesh Ramakrishnan, Sandra Engberg, Judith T. Matthews, Jacqueline Dunbar-Jacob, Colleen E. McCarthy, et al. 2002. Pearl: A mobile robotic assistant for the elderly. In Proceedings of the AAAI Workshop on Automation as Eldercare, Vol. 2002. 85--91.
[94]
Sarah Preum, Sile Shu, Mustafa Hotaki, Ronald Williams, John Stankovic, and Homa Alemzadeh. 2019. CognitiveEMS: A cognitive assistant system for emergency medical services. ACM SIGBED Rev. 16, 2 (2019), 51--60.
[95]
Sarah Masud Preum, Abu Sayeed Mondol, Meiyi Ma, Hongning Wang, and John A. Stankovic. 2017. Preclude: Conflict detection in textual health advice. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom’17). IEEE, 286--296.
[96]
Sarah Masud Preum, Abu Sayeed Mondol, Meiyi Ma, Hongning Wang, and John A. Stankovic. 2017. Preclude2: Personalized conflict detection in heterogeneous health applications. Pervas. Mob. Comput. 42 (2017).
[97]
Sarah Masud Preum, Md Rizwan Parvez, Kai-Wei Chang, and John Stankovic. 2018. A corpus of drug usage guidelines annotated with type of advice. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC’18).
[98]
Sarah Masud Preum, Sile Shu, Homa Alemzadeh, and John A. Stankovic. 2020. EMSContExt: EMS protocol-driven concept extraction for cognitive assistance in emergency response. In Proceedings of the AAAI Conference on Artificial Intelligence. 13350--13355.
[99]
Sarah Masud Preum, Sile Shu, Jonathan Ting, Vincent Lin, Ronald Williams, John Stankovic, and Homa Alemzadeh. 2018. Towards a cognitive assistant system for emergency response. In Proceedings of the ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS’18). IEEE, 347--348.
[100]
Sarah Masud Preum, John A. Stankovic, and Yanjun Qi. 2015. MAPer: A multi-scale adaptive personalized model for temporal human behavior prediction. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 433--442.
[101]
Long Qian, Anton Deguet, and Peter Kazanzides. 2018. ARssist: Augmented reality on a head-mounted display for the first assistant in robotic surgery. Healthc. Technol. Lett. 5, 5 (2018), 194--200.
[102]
M. Arif Rahman, Sarah Masud Preum, Ronald D. Williams, Homa Alemzadeh, and John A. Stankovic. 2020. GRACE: Generating summary reports automatically for cognitive assistance in emergency response. In Proceedings of the AAAI Conference on Artificial Intelligence. 13356--13362.
[103]
Vijay Rajanna, Raniero Lara-Garduno, Dev Jyoti Behera, Karthic Madanagopal, Daniel Goldberg, and Tracy Hammond. 2014. Step Up Life: A context aware health assistant. In Proceedings of the 3rd ACM SIGSPATIAL International Workshop on the Use of GIS in Public Health. ACM, 21--30.
[104]
Vijay Rajanna, Patrick Vo, Jerry Barth, Matthew Mjelde, Trevor Grey, Cassandra Oduola, and Tracy Hammond. 2016. KinoHaptics: An automated, wearable, haptic assisted, physio-therapeutic system for post-surgery rehabilitation and self-care. J. Med. Syst. 40, 3 (2016), 60.
[105]
Emad Rajih, Côme Tholomier, Beatrice Cormier, Vanessa Samouëlian, Thomas Warkus, Moishe Liberman, Hugues Widmer, Jean-Baptiste Lattouf, Abdullah M. Alenizi, Malek Meskawi, et al. 2017. Error reporting from the da Vinci surgical system in robotic surgery: A Canadian multispecialty experience at a single academic centre. Canad. Urolog. Assoc. J. 11, 5 (2017), E197.
[106]
Sarvapali D. Ramchurn, Feng Wu, Wenchao Jiang, Joel E. Fischer, Steve Reece, Stephen Roberts, Tom Rodden, Chris Greenhalgh, and Nicholas R. Jennings. 2016. Human–agent collaboration for disaster response. Auton. Agents Multi-agent Syst. 30, 1 (2016), 82--111.
[107]
Sandeep Reddy, Sonia Allan, Simon Coghlan, and Paul Cooper. 2020. A governance model for the application of AI in health care. J. Amer. Med. Inform. Assoc. 27, 3 (2020), 491--497.
[108]
Hadley Reynolds and Susan Feldman. 2014. Cognitive computing: Beyond the hype. KM World 27 (2014).
[109]
Flavio Ribeiro, Dinei Florencio, Philip A. Chou, and Zhengyou Zhang. 2012. Auditory augmented reality: Object sonification for the visually impaired. In Proceedings of the IEEE 14th International Workshop on Multimedia Signal Processing (MMSP’12). IEEE, 319--324.
[110]
Jaime A. Rincon, Angelo Costa, Paulo Novais, Vicente Julian, and Carlos Carrascosa. 2019. A new emotional robot assistant that facilitates human interaction and persuasion. Knowl. Inf. Syst. 60, 1 (2019), 363--383.
[111]
Albert Rizzo, Greg Reger, Greg Gahm, JoAnn Difede, and Barbara O. Rothbaum. 2009. Virtual reality exposure therapy for combat-related PTSD. In Post-traumatic Stress Disorder. Springer, 375--399.
[112]
Albert Rizzo, Thomas Talbot, C. D. Combs, J. A. Sokolowski, and C. M. Banks. 2015. Virtual reality standardized patients for clinical training. In The Digital Patient: Advancing Healthcare, Research, and Education. Wiley, 257--272.
[113]
Y. Rogers, H. Sharp, and J. Preece. 2011. Interaction Design: Beyond Human-computer Interaction. Wiley 8 Sons.
[114]
Caroline M. Ruminski, Matthew T. Clark, Douglas E. Lake, Rebecca R. Kitzmiller, Jessica Keim-Malpass, Matthew P. Robertson, Theresa R. Simons, J. Randall Moorman, and J. Forrest Calland. 2019. Impact of predictive analytics based on continuous cardiorespiratory monitoring in a surgical and trauma intensive care unit. J. Clin. Monit. Comput. 33, 4 (2019), 703--711.
[115]
Barret Rush, Leo Anthony Celi, and David J. Stone. 2019. Applying machine learning to continuously monitored physiological data. J. Clin. Monit. Comput. 33, 5 (2019), 887--893.
[116]
Barret Rush, David J. Stone, and Leo Anthony Celi. 2018. From big data to artificial intelligence: Harnessing data routinely collected in the process of care. Crit. Care Med. 46, 2 (2018), 345.
[117]
Gopala Sainarayanan, R. Nagarajan, and Sazali Yaacob. 2007. Fuzzy image processing scheme for autonomous navigation of human blind. Appl. Soft Comput. 7, 1 (2007), 257--264.
[118]
Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. NavCog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 270--279.
[119]
Mahadev Satyanarayanan, Wei Gao, and Brandon Lucia. 2019. The computing landscape of the 21st century. In Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 45--50.
[120]
Tobias Schwarze, Martin Lauer, Manuel Schwaab, Michailas Romanovas, Sandra Böhm, and Thomas Jürgensohn. 2016. A camera-based mobility aid for visually impaired people. KI-Künstl. Intell. 30, 1 (2016), 29--36.
[121]
Gaumard Scientific. 2019. Pediatric 8 Neonatal Care Simulators. Retrieved from https://www.gaumard.com/products/pediatric-neonatal.
[122]
Audrey Serna, Hélène Pigot, and Vincent Rialle. 2007. Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes. User Model. User-adapt. Interact. 17, 4 (2007), 415--438.
[123]
Azad Shademan, Ryan S. Decker, Justin D. Opfermann, Simon Leonard, Axel Krieger, and Peter C. W. Kim. 2016. Supervised autonomous robotic soft tissue surgery. Sci. Translat. Med.icine 8, 337 (2016), 337ra64–337ra64.
[124]
Afzal Hussain Shahid and M. P. Singh. 2019. Computational intelligence techniques for medical diagnosis and prognosis: Problems and current developments. Biocyber. Biomed. Eng. 39, 3 (2019), 638--672.
[125]
Shraga Shoval, Johann Borenstein, and Yoram Koren. 1998. The Navbelt-A computerized travel aid for the blind based on mobile robotics technology. IEEE Trans. Biomed. Eng. 45, 11 (1998), 1376--1386.
[126]
Sile Shu, Sarah Preum, Haydon Pitchford, Ronald Williams, John Stankovic, and Homa Alemzadeh. 2019. A behavior tree cognitive assistant system for emergency medical services. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’19). IEEE.
[127]
Daniel Siewiorek, Asim Smailagic, and Anind Dey. 2012. Architecture and applications of virtual coaches. Proc. IEEE 100, 8 (2012), 2472--2488.
[128]
Daniel Sonntag. 2015. Kognit: Intelligent cognitive enhancement technology by cognitive models and mixed reality for dementia patients. In Proceedings of the AAAI Fall Symposium Series.
[129]
Daniel Sonntag, Sonja Zillner, Christian Schulz, Markus Weber, and Takumi Toyama. 2013. Towards medical cyber-physical systems: Multimodal augmented reality for doctors and knowledge discovery about patients. In Proceedings of the International Conference of Design, User Experience, and Usability. Springer, 401--410.
[130]
Mirjana Spasojevic, Stefan Marti, Davide Di Censo, and Jaime Elliot Nahman. 2018. Cognitive load driving assistant. US Patent App. 15/541,458.
[131]
Eliza Strickland. 2019. IBM Watson, heal thyself: How IBM overpromised and underdelivered on AI health care. IEEE Spect. 56, 4 (2019), 24--31.
[132]
Yingli Tian. 2014. RGB-D sensor-based computer vision assistive technology for visually impaired persons. In Computer Vision and Machine Learning with RGB-D Sensors. Springer, 173--194.
[133]
Iwan Ulrich and Johann Borenstein. 2001. The GuideCane-applying mobile robot technologies to assist the visually impaired. IEEE Trans. Syst. Man Cyber. Part A: Syst. Hum. 31, 2 (2001), 131--136.
[134]
Bram Van de Laar, Anton Nijholt, and Job Zwiers. 2010. Monitoring user’s brain activity for a virtual coach. In Proceedings of the International Conference on Entertainment Computing. Springer, 511--513.
[135]
Hélène Vorobieva, Mariette Soury, Patrick Hède, Christophe Leroux, and Philippe Morignot. 2010. Object recognition and ontology for manipulation with an assistant robot. In Proceedings of the International Conference on Smart Homes and Health Telematics. Springer, 178--185.
[136]
David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales. J. Person. Social Psychol. 54, 6 (1988), 1063.
[137]
IBM Watson. 2019. IBM Watson for Oncology. Retrieved from https://tinyurl.com/y5etnmrd.
[138]
Oliver Weede, Andreas Bihlmaier, Jessica Hutzl, Beat P. Müller-Stich, and Heinz Wörn. 2013. Towards cognitive medical robotics in minimal invasive surgery. In Proceedings of the Conference on Advances in Robotics. ACM, 1--8.
[139]
Patricia A. H. Williams and Andrew J. Woodward. 2015. Cybersecurity vulnerabilities in medical devices: A complex environment and multifaceted problem. Med. Dev. 8 (2015), 305.
[140]
Laure Wynants, Ben Van Calster, Marc M. J. Bonten, Gary S. Collins, Thomas P. A. Debray, Maarten De Vos, Maria C. Haller, Georg Heinze, Karel G. M. Moons, Richard D. Riley, et al. 2020. Prediction models for diagnosis and prognosis of covid-19 infection: Systematic review and critical appraisal. BMJ 369 (2020).
[141]
Mohammad Samin Yasar and Homa Alemzadeh. 2020. Real-time context-aware detection of unsafe events in robot-assisted surgery. In 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'20). IEEE Computer Society, 385–397.
[142]
Fereshta Yazdani, Gayane Kazhoyan, Asil Kaan Bozcuoğlu, Andrei Haidu, Ferenc Bálint-Benczédi, Daniel Beßler, Mihai Pomarlan, and Michael Beetz. 2018. Cognition-enabled framework for mixed human-robot rescue teams. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’18). IEEE, 1421--1428.

Cited By

View all
  • (2024)Robotic Augmentation in HealthcareEnhancing the Modern Workforce Through Transhumanism10.4018/979-8-3693-8855-6.ch002(27-50)Online publication date: 18-Oct-2024
  • (2024)Exploring the Impact of Artificial Intelligence on Global Health and Enhancing Healthcare in Developing NationsJournal of Primary Care & Community Health10.1177/2150131924124584715Online publication date: 12-Apr-2024
  • (2024)Emotional Adjustment and Interaction in Virtual Health Assistant: Combining Seq2Seq-GAN TechnologyProceedings of the 2024 International Conference on Machine Intelligence and Digital Applications10.1145/3662739.3672179(785-789)Online publication date: 30-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys
ACM Computing Surveys  Volume 53, Issue 6
Invited Tutorial and Regular Papers
November 2021
803 pages
ISSN:0360-0300
EISSN:1557-7341
DOI:10.1145/3441629
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 February 2021
Accepted: 01 August 2020
Revised: 01 August 2020
Received: 01 October 2019
Published in CSUR Volume 53, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Cognitive assistant
  2. agent based systems for healthcare
  3. healthcare application
  4. intelligent agent
  5. intelligent assistant
  6. personal assistant
  7. smart health
  8. virtual agent
  9. virtual assistant

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)287
  • Downloads (Last 6 weeks)37
Reflects downloads up to 09 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Robotic Augmentation in HealthcareEnhancing the Modern Workforce Through Transhumanism10.4018/979-8-3693-8855-6.ch002(27-50)Online publication date: 18-Oct-2024
  • (2024)Exploring the Impact of Artificial Intelligence on Global Health and Enhancing Healthcare in Developing NationsJournal of Primary Care & Community Health10.1177/2150131924124584715Online publication date: 12-Apr-2024
  • (2024)Emotional Adjustment and Interaction in Virtual Health Assistant: Combining Seq2Seq-GAN TechnologyProceedings of the 2024 International Conference on Machine Intelligence and Digital Applications10.1145/3662739.3672179(785-789)Online publication date: 30-May-2024
  • (2024)LLM-based Solutions for Healthcare Chatbots: a Comparative Analysis2024 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops59983.2024.10503257(346-351)Online publication date: 11-Mar-2024
  • (2024)Wi-Fi and Radar Fusion for Head Movement Sensing Through Walls Leveraging Deep LearningIEEE Sensors Journal10.1109/JSEN.2023.333751524:9(14952-14961)Online publication date: 1-May-2024
  • (2024)Real-Time Multimodal Cognitive Assistant for Emergency Medical Services2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00012(85-96)Online publication date: 13-May-2024
  • (2024)Agent-based approaches for biological modeling in oncologyArtificial Intelligence in Medicine10.1016/j.artmed.2024.102884152:COnline publication date: 1-Jun-2024
  • (2024)Role of cognitive computing in enhancing innovative healthcare solutionsAdvances in Biomarker Sciences and Technology10.1016/j.abst.2024.08.0026(152-165)Online publication date: 2024
  • (2024)Performance evaluations of large language models for customer serviceInternational Journal of Machine Learning and Cybernetics10.1007/s13042-024-02432-9Online publication date: 11-Nov-2024
  • (2024)Large language models for medicine: a surveyInternational Journal of Machine Learning and Cybernetics10.1007/s13042-024-02318-wOnline publication date: 19-Aug-2024
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media