Online Patient Education in Obstructive Sleep Apnea: ChatGPT versus Google Search
Abstract
:1. Introduction
2. Materials and Methods
2.1. Quality and Reliability Assessment
2.2. Content Evaluation
2.3. Readability Assessment
2.4. Statistical Analysis
3. Results
3.1. Quality and Reliability Assessment
3.2. Content Evaluation
3.3. Readability Assessment
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Benjafield, A.V.; Ayas, N.T.; Eastwood, P.R.; Heinzer, R.; Mary, S.M.I.; Morrell, M.J.; Nunez, C.M.; Patel, S.R.; Penzel, T.; Pépin, J.L.; et al. Estimation of the global prevalence and burden of obstructive sleep apnoea: A literature-based analysis. Lancet Respir. Med. 2019, 7, 687–698. [Google Scholar] [CrossRef] [PubMed]
- Lyons, M.M.; Bhatt, N.Y.; Pack, A.I.; Magalang, U.J. Global burden of sleep-disordered breathing and its implications. Respirology 2020, 25, 690–702. [Google Scholar] [CrossRef]
- Sia, C.H.; Hong, Y.; Tan, L.W.L.; van Dam, R.M.; Lee, C.H.; Tan, A. Awareness and knowledge of obstructive sleep apnea among the general population. Sleep Med. 2017, 36, 10–17. [Google Scholar] [CrossRef]
- Greenberg-Worisek, A.J.; Kurani, S.; Rutten, L.J.F.; Blake, K.D.; Moser, R.P.; Hesse, B.W. Correction: Tracking Healthy People 2020 Internet, Broadband, and Mobile Device Access Goals: An Update Using Data From the Health Information National Trends Survey. J. Med. Internet Res. 2022, 24, e39712. [Google Scholar] [CrossRef] [PubMed]
- Rutten, L.J.F.; Blake, K.D.; Greenberg-Worisek, A.J.; Allen, S.V.; Moser, R.P.; Hesse, B.W. Online Health Information Seeking Among US Adults: Measuring Progress Toward a Healthy People 2020 Objective. Public Health Rep. 2019, 134, 617–625. [Google Scholar] [CrossRef] [PubMed]
- Eurostat. One in Two EU Citizens Look for Health Information Online. 2021. Available online: https://ec.europa.eu/eurostat/en/web/products-eurostat-news/-/edn-20210406-1 (accessed on 20 July 2024).
- Bartolucci, M.L.; Parenti, S.I.; Bortolotti, F.; Gorini, T.; Alessandri-Bonetti, G. Awareness and Sources of Knowledge about Obstructive Sleep Apnea: A Cross Sectional Survey Study. Healthcare 2023, 11, 3052. [Google Scholar] [CrossRef]
- Lee, K.; Hoti, K.; Hughes, J.D.; Emmerton, L. Dr Google and the consumer: A qualitative study exploring the navigational needs and online health information-seeking behaviors of consumers with chronic health conditions. J. Med. Internet Res. 2014, 16, e262. [Google Scholar] [CrossRef]
- Lee, J.; Ban, W.H.; Park, H.K.; Na, E.; Kim, S.K.; Kang, H.H.; Lee, S.H. Accuracy and Reliability of Internet Resources Providing Information on Obstructive Sleep Apnea. J. Clin. Sleep Med. 2018, 14, 1717–1723. [Google Scholar] [CrossRef]
- Jo, J.H.; Kim, J.R.; Kim, M.J.; Chung, J.W.; Park, J.W. Quality and readability of online information on dental treatment for snoring and obstructive sleep apnea. Int. J. Med. Inform. 2020, 133, 104000. [Google Scholar] [CrossRef]
- Incerti Parenti, S.; Gamberini, S.; Fiordelli, A.; Bortolotti, F.; Laffranchi, L.; Alessandri-Bonetti, G. Online information on mandibular advancement device for the treatment of obstructive sleep apnea: A content, quality and readability analysis. J. Oral Rehabil. 2023, 50, 210–216. [Google Scholar] [CrossRef]
- Incerti Parenti, S.; Bartolucci, M.L.; Biondi, E.; Fiordelli, A.; Paganelli, C.; Alessandri-Bonetti, G. Online Audio-Visual Information on the Treatment of OSA with Mandibular Advancement Devices: Analysis of Quality, Reliability and Contents. Appl. Sci. 2023, 13, 5727. [Google Scholar] [CrossRef]
- Stokel-Walker, C.; Van Noorden, R. What ChatGPT and generative AI mean for science. Nature 2023, 614, 214–216. [Google Scholar] [CrossRef] [PubMed]
- Schulman, J.; Zoph, B.; Kim, C. ChatGPT: Optimizing Language Models. 2022. Available online: https://openai.com/blog/chatgpt (accessed on 6 January 2024).
- Duarte, F.; Number of ChatGPT Users. Exploding Topics. 2024. Available online: https://explodingtopics.com/blog/chatgpt-users (accessed on 20 July 2024).
- Sallam, M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare 2023, 11, 887. [Google Scholar] [CrossRef] [PubMed]
- Campbell, D.J.; Estephan, L.E.; Mastrolonardo, E.V.; Amin, D.R.; Huntley, C.T.; Boon, M.S. Evaluating ChatGPT responses on obstructive sleep apnea for patient education. J. Clin. Sleep Med. 2023, 19, 1989–1995. [Google Scholar] [CrossRef] [PubMed]
- Cheong, R.C.T.; Unadkat, S.; Mcneillis, V.; Williamson, A.; Joseph, J.; Randhawa, P.; Andrews, P.; Paleri, V. Artificial intelligence chatbots as sources of patient education material for obstructive sleep apnoea: ChatGPT versus Google Bard. Eur. Arch. Otorhinolaryngol. 2023, 281, 985–993. [Google Scholar] [CrossRef]
- Kleebayoon, A.; Wiwanitkit, V. ChatGPT, obstructive sleep apnea, and patient education. J. Clin. Sleep Med. 2023, 19, 2133. [Google Scholar] [CrossRef]
- Bernard, A.; Langille, M.; Hughes, S.; Rose, C.; Leddin, D.; Veldhuyzen van Zanten, S. A systematic review of patient inflammatory bowel disease information resources on the World Wide Web. Am. J. Gastroenterol. 2007, 102, 2070–2077. [Google Scholar] [CrossRef]
- Agency for Healthcare Research and Quality. The Patient Education Materials Assessment Tool (PEMAT) and User’s Guide. 2020. Available online: https://www.ahrq.gov/health-literacy/patient-education/pemat.html (accessed on 20 July 2024).
- Shoemaker, S.J.; Wolf, M.S.; Brach, C. Development of the Patient Education Materials Assessment Tool (PEMAT): A new measure of understandability and actionability for print and audiovisual patient information. Patient Educ. Couns. 2014, 96, 395–403. [Google Scholar] [CrossRef]
- Charnock, D.; Shepperd, S.; Needham, G.; Gann, R. DISCERN: An instrument for judging the quality of written consumer health information on treatment choices. J. Epidemiol. Community Health 1999, 53, 105–111. [Google Scholar] [CrossRef]
- Sallam, M.; Barakat, M.; Sallam, M. Pilot Testing of a Tool to Standardize the Assessment of the Quality of Health Information Generated by Artificial Intelligence-Based Models. Cureus 2023, 15, e49373. [Google Scholar] [CrossRef]
- Flesch, R. A new readability yardstick. J. Appl. Psychol. 1948, 32, 221–233. [Google Scholar] [CrossRef] [PubMed]
- Kincaid, J.P.; Fishburne, R.P.; Rogers, R.L.; Chissom, B.S. Derivation of New Readability Formulas (Automated Readability Index, Fog Count, and Flesch Reading Ease Formula) for Navy Enlisted Personnel. Research Branch Report 8-75. 1975. Available online: https://stars.library.ucf.edu/istlibrary/56/ (accessed on 2 September 2024).
- Therapeutic Patient Education: An Introductory Guide; WHO Regional Office for Europe: Copenhagen, Denmark, 2023; Licence: CC BY-NC-SA 3.0 IGO.
- Ratzan, S.; Parker, R.M. Introduction. In National Library of Medicine, Current Bibliographies in Medicine: Health Literacy; Selden, C.R., Zorn, M., Ratzen, S.C., Parker, R.M., Eds.; National Institutes of Health, US Department of Health and Human Services: Bethesda, MD, USA, 2000. [Google Scholar]
- Liu, L.; Qian, X.; Chen, Z.; He, T. Health literacy and its effect on chronic disease prevention: Evidence from China’s data. BMC Public Health 2020, 20, 690. [Google Scholar] [CrossRef] [PubMed]
- Bellinger, J.R.; De La Chapa, J.S.; Kwak, M.W.; Ramos, G.A.; Morrison, D.; Kesser, B.W. BPPV Information on Google Versus AI (ChatGPT). Otolaryngol. Head Neck Surg. 2023, 170, 1504–1511. [Google Scholar] [CrossRef] [PubMed]
- Baker, D.W.; Parker, R.M.; Williams, M.V.; Clark, W.S.; Nurss, J. The relationship of patient reading ability to self-reported health and use of health services. Am. J. Public Health 1997, 87, 1027–1030. [Google Scholar] [CrossRef] [PubMed]
- van der Heide, I.; Poureslami, I.; Mitic, W.; Shum, J.; Rootman, I.; FitzGerald, J.M. Health literacy in chronic disease management: A matter of interaction. J. Clin. Epidemiol. 2018, 102, 134–138. [Google Scholar] [CrossRef]
- Cho, Y.I.; Lee, S.Y.; Arozullah, A.M.; Crittenden, K.S. Effects of health literacy on health status and health service utilization amongst the elderly. Soc. Sci. Med. 2008, 66, 1809–1816. [Google Scholar] [CrossRef]
- Rasu, R.S.; Bawa, W.A.; Suminski, R.; Snella, K.; Warady, B. Health Literacy Impact on National Healthcare Utilization and Expenditure. Int. J. Health Policy Manag. 2015, 4, 747–755. [Google Scholar] [CrossRef]
n. | Questions |
---|---|
1 | What are 3 symptoms of obstructive sleep apnea? |
2 | What is obstructive sleep apnea syndrome? |
3 | What’s the difference between sleep apnea and obstructive sleep apnea syndrome? |
4 | Is obstructive sleep apnea a serious illness? |
5 | Can obstructive sleep apnea be cured? |
6 | What is the main cause of sleep apnea? |
7 | What is the life expectancy of someone with sleep apnea? |
8 | Does sleep apnea go away? |
9 | What is the best position to sleep in with sleep apnea? |
10 | How can I prevent sleep apnea naturally? |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Incerti Parenti, S.; Bartolucci, M.L.; Biondi, E.; Maglioni, A.; Corazza, G.; Gracco, A.; Alessandri-Bonetti, G. Online Patient Education in Obstructive Sleep Apnea: ChatGPT versus Google Search. Healthcare 2024, 12, 1781. https://doi.org/10.3390/healthcare12171781
Incerti Parenti S, Bartolucci ML, Biondi E, Maglioni A, Corazza G, Gracco A, Alessandri-Bonetti G. Online Patient Education in Obstructive Sleep Apnea: ChatGPT versus Google Search. Healthcare. 2024; 12(17):1781. https://doi.org/10.3390/healthcare12171781
Chicago/Turabian StyleIncerti Parenti, Serena, Maria Lavinia Bartolucci, Elena Biondi, Alessandro Maglioni, Giulia Corazza, Antonio Gracco, and Giulio Alessandri-Bonetti. 2024. "Online Patient Education in Obstructive Sleep Apnea: ChatGPT versus Google Search" Healthcare 12, no. 17: 1781. https://doi.org/10.3390/healthcare12171781