A Systematic Review and Meta-Analysis of Artificial Intelligence Tools in Medicine and Healthcare: Applications, Considerations, Limitations, Motivation and Challenges
Abstract
:1. Introduction
1.1. Aiding Cosmetic Orthognathic Surgery Consultations
1.2. Enhancing Medical Education
1.3. Support in Disease Diagnosis
1.4. Cellular Imaging, Revolutionizing Radiology, and Sonar Imaging
1.5. Pharmaceutical Research and Treatment
1.6. Navigating Limitations and Ethical Considerations
- To investigate the various applications of ChatGPT in healthcare, such as pandemic management, surgical consultations, dental practices, medical education, disease diagnosis, cellular imaging, sonar imaging, radiology, and pharmaceutical research.
- To investigate the potential benefits and risks of integrating ChatGPT in healthcare, assessing its impact on patient care, medical processes, and ethical considerations.
- To investigate the ethical issues and the need to balance AI’s role in healthcare settings with human judgement.
- To offer perspectives and recommendations for the responsible adoption and use of ChatGPT in medicine in general, and cellular imaging in particular, while addressing limitations and ethical concerns.
2. Materials and Methods
2.1. Inclusion Criteria
- The article should be original or reviewed, written in English, and published in English journals, conferences, case studies, editorials, opinion articles, and letters to the editor.
- The study specifies that it contains the specified keywords.
- Any relevant articles are published or in press between November 2022 and August 2023.
- The main point is on Chat GPT with specific words in the field of healthcare and health.
- The study includes the study’s objectives, design, applications, benefits, risks, concerns, limitations, study field/area, conclusions, and recommended actions.
2.2. Data Gathering Procedure
2.3. Research Questions
- RQ1: How does ChatGPT contribute to pandemic management and what specific advantages does it offer in disseminating critical information during health crises?
- RQ2: How is ChatGPT utilised in the field of dental practices and how does it enhance the overall patient experience in this context?
- RQ3: What challenges and ethical considerations are associated with the integration of ChatGPT into medical practices and healthcare settings?
- RQ4: What are the key components associated with work related to ChatGPT in medicine and healthcare and their contributions in ChatGPT applications in the field?
3. Results
3.1. RQ1: How Does ChatGPT Contribute to Pandemic Management and What Specific Advantages Does It Offer in Disseminating Critical Information during Health Crises?
3.2. RQ2: How Is ChatGPT Utilised in the Field of Dental Practices, and How Does It Enhance the Overall Patient Experience in This Context?
3.3. RQ3: What Challenges and Ethical Considerations Are Associated with the Integration of ChatGPT into Medical Practices and Healthcare Settings?
3.4. RQ4: What Are the Key Components Associated with Work Related to ChatGPT in Medicine and Healthcare and Their Contributions in ChatGPT Applications in the Field?
4. Challenges
4.1. Language Understanding and Medical Terms
4.2. Accuracy and Reliability
4.3. Privacy and Security
4.4. Accountability and Responsibility
4.5. Human Oversight and Intervention
4.6. Medical Training and Regulation
4.7. Patient Empowerment
5. Limitations and the Motivation
6. Conclusions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Agathokleous, E.; Saitanis, C.J.; Fang, C.; Yu, Z. Use of ChatGPT: What Does It Mean for Biology and Environmental Science? Sci. Total Environ. 2023, 888, 164154. [Google Scholar] [CrossRef]
- McGowan, A.; Gui, Y.; Dobbs, M.; Shuster, S.; Cotter, M.; Selloni, A.; Goodman, M.; Srivastava, A.; Cecchi, G.A.; Corcoran, C.M. ChatGPT and Bard Exhibit Spontaneous Citation Fabrication during Psychiatry Literature Search. Psychiatry Res. 2023, 326, 115334. [Google Scholar] [CrossRef]
- Choudhary, O.P. Priyanka ChatGPT in Travel Medicine: A Friend or Foe? Travel Med. Infect. Dis. 2023, 54, 102615. [Google Scholar] [CrossRef] [PubMed]
- Kocoń, J.; Cichecki, I.; Kaszyca, O.; Kochanek, M.; Szydło, D.; Baran, J.; Bielaniewicz, J.; Gruza, M.; Janz, A.; Kanclerz, K.; et al. ChatGPT: Jack of All Trades, Master of None. Inf. Fusion 2023, 99, 101861. [Google Scholar] [CrossRef]
- Mueen Sahib, T.; Younis, H.A.; Mohammed, A.O.; Ali, A.H.; Salisu, S.; Noore, A.A.; Hayder, I.M.; Shahid, M. ChatGPT in Waste Management: Is it a Profitable. Mesopotamian J. Big Data 2023, 2023, 107–109. [Google Scholar] [CrossRef]
- Sallam, M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare 2023, 11, 887. [Google Scholar] [CrossRef] [PubMed]
- Jeblick, K.; Schachtner, B.; Dexl, J.; Mittermeier, A.; Stüber, A.T.; Topalis, J.; Weber, T.; Wesp, P.; Sabel, B.; Ricke, J.; et al. ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports. Eur. Radiol. 2022; ahead of print. [Google Scholar] [CrossRef]
- Fatani, B. ChatGPT for Future Medical and Dental Research. Cureus 2023, 15, e37285. [Google Scholar] [CrossRef] [PubMed]
- Temsah, O.; Khan, S.A.; Chaiah, Y.; Senjab, A.; Alhasan, K.; Jamal, A.; Aljamaan, F.; Malki, K.H.; Halwani, R.; Al-Tawfiq, J.A.; et al. Overview of Early ChatGPT’s Presence in Medical Literature: Insights from a Hybrid Literature Review by ChatGPT and Human Experts. Cureus 2023, 15, e37281. [Google Scholar] [CrossRef]
- Xie, Y.; Seth, I.; Hunter-smith, D.J.; Rozen, W.M.; Ross, R.; Lee, M. Aesthetic Surgery Advice and Counseling from Artificial Intelligence: A Rhinoplasty Consultation with ChatGPT. Aesthetic Plast. Surg. 2023, 47, 1985–1993. [Google Scholar] [CrossRef]
- Surovkov, J.; Strunga, M.; Lifkov, M.; Thurzo, A. The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Appl. Sci. 2023, 13, 5212. [Google Scholar] [CrossRef]
- Mijwil, M.; Aljanabi, M.; Ali, A.H. ChatGPT: Exploring the Role of Cybersecurity in the Protection of Medical Information. Mesopotamian J. Cyber Secur. 2023, 2023, 18–21. [Google Scholar] [CrossRef]
- Hosseini, M.; Gao, C.A.; Liebovitz, D.; Carvalho, A.; Ahmad, F.S.; Luo, Y.; MacDonald, N.; Holmes, A.K. An Exploratory Survey about Using ChatGPT in Education, Healthcare, and Research. PLoS ONE 2023, 18, e0292216. [Google Scholar] [CrossRef]
- Mohammed, A.O.; Salisu, S.A.; Younis, H.; Salman, A.M.; Sahib, T.M.; Akhtom, D.; Hayder, I.M. ChatGPT Revisited: Using ChatGPT-4 for Finding References and Editing Language in Medical Scientific Articles. 2023. Available online: https://ssrn.com/abstract=4621581 (accessed on 18 November 2023). [CrossRef]
- Khairatun, H.U.; Miftahul, A.M. ChatGPT and Medical Education: A Double-Edged Sword. J. Pedagog. Educ. Sci. 2023, 2, 71–89. [Google Scholar] [CrossRef]
- Abouammoh, N.; Alhasan, K.A.; Raina, R.; Children, A.; Aljamaan, F. Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitative Study Among Medical College Faculty and Students in Saudi Arabia Original Research: Exploring Perceptions and Experiences of ChatGPT in Medical Education: A Qualitativ. Cold Spring Harb. Lab. 2023; preprint. [Google Scholar] [CrossRef]
- Gilson, A.; Safranek, C.W.; Huang, T.; Socrates, V.; Chi, L.; Taylor, R.A.; Chartash, D. How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment. JMIR Med. Educ. 2023, 9, e45312. [Google Scholar] [CrossRef]
- Busch, F.; Adams, L.C.; Bressem, K.K. Biomedical Ethical Aspects Towards the Implementation of Artificial Intelligence in Medical Education in Medical Education. Med. Sci. Educ. 2023, 33, 1007–1012. [Google Scholar] [CrossRef] [PubMed]
- Friederichs, H.; Friederichs, W.J.; März, M.; Friederichs, H.; Friederichs, W.J.; Chatgpt, M.M.; Friederichs, H.; Friederichs, W.J. ChatGPT in Medical School: How Successful Is AI in Progress Testing? ChatGPT in Medical School: How Successful Is AI in Progress Testing? Med. Educ. Online 2023, 28, 2220920. [Google Scholar] [CrossRef] [PubMed]
- Grabb, D. ChatGPT in Medical Education: A Paradigm Shift or a Dangerous Tool? Acad. Psychiatry 2023, 47, 439–440. [Google Scholar] [CrossRef]
- Sedaghat, S. Early Applications of ChatGPT in Medical Practice, Education and Research. Clin. Med. 2023, 23, 278–279. [Google Scholar] [CrossRef]
- Giannos, P. Evaluating the Limits of AI in Medical Specialisation: ChatGPT’s Performance on the UK Neurology Specialty Certificate Examination. BMJ Neurol. Open 2023, 5, e000451. [Google Scholar] [CrossRef]
- Guo, A.A.; Li, J. Harnessing the Power of ChatGPT in Medical Education. Med. Teach. 2023, 45, 1063. [Google Scholar] [CrossRef]
- Huh, S. Can We Trust AI Chatbots’ Answers about Disease Diagnosis and Patient Care? J. Korean Med. Assoc. 2023, 66, 218–222. [Google Scholar] [CrossRef]
- Currie, G.; Singh, C.; Nelson, T.; Nabasenja, C.; Al-Hayek, Y.; Spuur, K. ChatGPT in Medical Imaging Higher Education. Radiography 2023, 29, 792–799. [Google Scholar] [CrossRef]
- Dahmen, J.; Kayaalp, M.E.; Ollivier, M.; Pareek, A.; Hirschmann, M.T.; Karlsson, J.; Winkler, P.W. Artificial Intelligence Bot ChatGPT in Medical Research: The Potential Game Changer as a Double-Edged Sword. Knee Surg. Sports Traumatol. Arthrosc. 2023, 31, 1187–1189. [Google Scholar] [CrossRef]
- Mohammed, O.; Thaeer, M.S.; Israa, M.H.; Sani, S.; Misbah, S. ChatGPT Evaluation: Can It Replace Grammarly and Quillbot Tools? Br. J. Appl. Linguistics 2023, 3, 34–46. [Google Scholar] [CrossRef]
- Yang, J.; Li, H.B.; Wei, D. The Impact of ChatGPT and LLMs on Medical Imaging Stakeholders: Perspectives and Use Cases. arXiv 2023, arXiv:2306.06767. [Google Scholar] [CrossRef]
- Zhu, Z.; Ying, Y.; Zhu, J.; Wu, H. ChatGPT’s Potential Role in Non-English-Speaking Outpatient Clinic Settings. Digit. Health 2023, 9, 1–3. [Google Scholar] [CrossRef]
- Verhoeven, F.; Wendling, D.; Prati, C. ChatGPT: When Artificial Intelligence Replaces the Rheumatologist in Medical Writing. Ann. Rheum. Dis. 2023, 82, 1015–1017. [Google Scholar] [CrossRef]
- Corsello, A.; Santangelo, A. May Artificial Intelligence Influence Future Pediatric Research?—The Case of ChatGPT. Children 2023, 10, 757. [Google Scholar] [CrossRef] [PubMed]
- Pozzessere, C. Optimizing Communication of Radiation Exposure in Medical Imaging, the Radiologist Challenge. Tomography 2023, 9, 717–720. [Google Scholar] [CrossRef]
- Ning, G.; Liang, H.; Jiang, Z.; Zhang, H.; Liao, H. The Potential of “Segment Anything” (SAM) for Universal Intelligent Ultrasound Image Guidance. Biosci. Trends 2023, 17, 230–233. [Google Scholar] [CrossRef]
- Strunga, M.; Thurzo, A.; Surovkov, J.; Lifkov, M.; Tom, J. AI-Assisted CBCT Data Management in Modern Dental Practice: Benefits, Limitations and Innovations. Electronics 2023, 12, 1710. [Google Scholar]
- Pratim, P.; Poulami, R. AI Tackles Pandemics: ChatGPT’s Game–Changing Impact on Infectious Disease Control. Ann. Biomed. Eng. 2023, 51, 2097–2099. [Google Scholar] [CrossRef]
- Temsah, M.; Aljamaan, F.; Malki, K.H.; Alhasan, K. ChatGPT and the Future of Digital Health: A Study on Healthcare Workers’ Perceptions and Expectations. Healthcare 2023, 11, 1812. [Google Scholar] [CrossRef] [PubMed]
- Lukac, S.; Dayan, D.; Fink, V.; Leinert, E.; Hartkopf, A.; Veselinovic, K.; Janni, W.; Rack, B.; Pfister, K.; Heitmeir, B.; et al. Evaluating ChatGPT as an Adjunct for the Multidisciplinary Tumor Board Decision–Making in Primary Breast Cancer Cases. Arch. Gynecol. Obstet. 2023, 308, 1831–1844. [Google Scholar] [CrossRef] [PubMed]
- Kavian, J.A.; Wilkey, H.L.; Parth, A.; Boyd, C.J. Harvesting the Power of Arti Fi Cial Intelligence for Surgery: Uses, Implications, and Ethical Considerations. Am. Surg. 2023, 2–4. [Google Scholar] [CrossRef]
- Dave, T.; Athaluri, S.A.; Singh, S. ChatGPT in Medicine: An Overview of Its Applications, Advantages, Limitations, Future Prospects, and Ethical Considerations. Front. Artif. Intell. 2023, 6, 1169595. [Google Scholar] [CrossRef]
- Ruksakulpiwat, S.; Kumar, A.; Ajibade, A. Using ChatGPT in Medical Research: Current Status and Future Directions. J. Multidiscip. Healthc. 2023, 16, 1513–1520. [Google Scholar] [CrossRef] [PubMed]
- Tustumi, F.; Andreollo, N.A.; Aguilar-Nascimento, J.E.; No, E.; Em, S.; Prazo, L. Future of the Language Models in Healthcare: The Role of Chatgpt. ABCD. Arq. Bras. Cir. Dig. 2023, 34, e1727. [Google Scholar] [CrossRef] [PubMed]
- Kaarre, J.; Feldt, R.; Keeling, L.E.; Dadoo, S.; Zsidai, B.; Hughes, J.D.; Samuelsson, K.; Musahl, V. Exploring the Potential of ChatGPT as a Supplementary Tool for Providing Orthopaedic Information. Knee Surg. Sports Traumatol. Arthrosc. 2023, 31, 5190–5198. [Google Scholar] [CrossRef] [PubMed]
- Ollivier, M.; Pareek, A.; Dahmen, J.; Kayaalp, M.E.; Winkler, P.W.; Hirschmann, M.T.; Karlsson, J. A Deeper Dive into ChatGPT: History, Use and Future Perspectives for Orthopaedic Research. Knee Surg. Sports Traumatol. Arthrosc. 2023, 31, 1190–1192. [Google Scholar] [CrossRef]
- Sallam, M.; Salim, N.A.; Barakat, M.; Al-Tammemi, A.B. ChatGPT Applications in Medical, Dental, Pharmacy, and Public Health Education: A Descriptive Study Highlighting the Advantages and Limitations. Narra J 2023, 3, e103. [Google Scholar] [CrossRef]
- Liberati, A.; Altman, D.G.; Tetzlaff, J.; Mulrow, C.; Gøtzsche, P.C.; Ioannidis, J.P.A.; Clarke, M.; Devereaux, P.J.; Kleijnen, J.; Moher, D. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Med. 2009, 6, e1000100. [Google Scholar] [CrossRef]
- Page, M.J.; McKenzie, J.E.; Bossuyt, P.M.; Boutron, I.; Hoffmann, T.C.; Mulrow, C.D.; Shamseer, L.; Tetzlaff, J.M.; Akl, E.A.; Brennan, S.E.; et al. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. BMJ 2021, 372, 71. [Google Scholar] [CrossRef] [PubMed]
- Younis, H.A.; Ruhaiyem, N.I.R.; Badr, A.A.; Abdul-Hassan, A.K.; Alfadli, I.M.; Binjumah, W.M.; Altuwaijri, E.A.; Nasser, M. Multimodal Age and Gender Estimation for Adaptive Human-Robot Interaction: A Systematic Literature Review. Processes 2023, 11, 1488. [Google Scholar] [CrossRef]
- Salisu, S.; Ruhaiyem, N.I.R.; Eisa, T.A.E.; Nasser, M.; Saeed, F.; Younis, H.A. Motion Capture Technologies for Ergonomics: A Systematic Literature Review. Diagnostics 2023, 13, 2593. [Google Scholar] [CrossRef]
- Younis, H.A.; Ruhaiyem, N.I.R.; Ghaban, W.; Gazem, N.A.; Nasser, M. A Systematic Literature Review on the Applications of Robots and Natural Language Processing in Education. Electronics 2023, 12, 2864. [Google Scholar] [CrossRef]
- Götz, S. Supporting Systematic Literature Reviews in Computer Science: The Systematic Literature Review Toolkit. In Proceedings of the 21th ACM/IEEE International Conference on Model Driven Engineering Languages and Systems, MODELS 2018, Copenhagen, Denmark, 14–19 October 2018; pp. 22–26. [Google Scholar] [CrossRef]
- Muftić, F.; Kadunić, M.; Mušinbegović, A.; Almisreb, A.A. Exploring Medical Breakthroughs: A Systematic Review of ChatGPT Applications in Healthcare. Southeast Eur. J. Soft Comput. 2023, 12, 13–41. [Google Scholar]
- Liao, W.; Liu, Z.; Dai, H.; Xu, S.; Wu, Z.; Zhang, Y.; Huang, X.; Zhu, D.; Cai, H.; Liu, T.; et al. Differentiate ChatGPT-Generated and Human-Written Medical Texts. arXiv 2023, arXiv:2304.11567. [Google Scholar]
- Asch, D.A. An Interview with ChatGPT About Health Care. NEJM Catal. 2023, 1–8. [Google Scholar]
- Li, J.; Dada, A.; Kleesiek, J.; Egger, J. ChatGPT in Healthcare: A Taxonomy and Systematic Review. medRxiv 2023. [Google Scholar] [CrossRef]
- Vaishya, R.; Misra, A.; Vaish, A. ChatGPT: Is This Version Good for Healthcare and Research? Diabetes Metab. Syndr. Clin. Res. Rev. 2023, 17, 102744. [Google Scholar] [CrossRef]
- Homolak, J. Opportunities and Risks of ChatGPT in Medicine, Science, and Academic Publishing: A Modern Promethean Dilemma. Croat. Med. J. 2023, 64, 1–3. [Google Scholar] [CrossRef]
- Chow, J.C.L.; Sanders, L.; Li, K. Impact of ChatGPT on Medical Chatbots as a Disruptive Technology. Front. Artif. Intell. 2023, 6, 1166014. [Google Scholar] [CrossRef]
- Aydın, Ö.; Karaarslan, E. OpenAI ChatGPT Generated Literature Review: Digital Twin in Healthcare. SSRN Electron. J. 2022, 2, 22–31. [Google Scholar] [CrossRef]
- Javaid, M.; Haleem, A.; Singh, R.P. ChatGPT for Healthcare Services: An Emerging Stage for an Innovative Perspective. BenchCouncil Trans. Benchmarks Stand. Eval. 2023, 3, 100105. [Google Scholar] [CrossRef]
- Liebrenz, M.; Schleifer, R.; Buadze, A.; Bhugra, D.; Smith, A. Generating Scholarly Content with ChatGPT: Ethical Challenges for Medical Publishing. Lancet Digit. Health 2023, 5, e105–e106. [Google Scholar] [CrossRef]
- Eysenbach, G. The Role of ChatGPT, Generative Language Models, and Artificial Intelligence in Medical Education: A Conversation with ChatGPT and a Call for Papers. JMIR Med. Educ. 2023, 9, e46885. [Google Scholar] [CrossRef] [PubMed]
- Alberts, I.L.; Mercolli, L.; Pyka, T.; Prenosil, G.; Shi, K.; Rominger, A.; Afshar-Oromieh, A. Large Language Models (LLM) and ChatGPT: What Will the Impact on Nuclear Medicine Be? Eur. J. Nucl. Med. Mol. Imag. 2023, 50, 1549–1552. [Google Scholar] [CrossRef]
- Cascella, M.; Montomoli, J.; Bellini, V.; Bignami, E. Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios. J. Med. Syst. 2023, 47, 33. [Google Scholar] [CrossRef]
- Sohail, S.S.; Farhat, F.; Himeur, Y.; Nadeem, M.; Madsen, D.Ø.; Singh, Y.; Atalla, S.; Mansoor, W. The Future of GPT: A Taxonomy of Existing ChatGPT Research, Current Challenges, and Possible Future Directions. SSRN Electron. J. 2023. [Google Scholar] [CrossRef]
- Wen, J.; Wang, W. The Future of ChatGPT in Academic Research and Publishing: A Commentary for Clinical and Translational Medicine. Clin. Transl. Med. 2023, 13, 2–4. [Google Scholar] [CrossRef]
- Mohammad, B.; Supti, T.; Alzubaidi, M.; Shah, H.; Alam, T.; Shah, Z.; Househ, M. The Pros and Cons of Using ChatGPT in Medical Education: A Scoping Review. Stud. Health Technol. Inform. 2023, 305, 644–647. [Google Scholar] [CrossRef]
- Cox, A.; Seth, I.; Xie, Y.; Hunter-Smith, D.J.; Rozen, W.M. Utilizing ChatGPT-4 for Providing Medical Information on Blepharoplasties to Patients. Aesthetic Surg. J. 2023, 43, NP658–NP662. [Google Scholar] [CrossRef]
- Digiorgio, A.M.; Ehrenfeld, J.M. Artificial Intelligence in Medicine & ChatGPT: De-Tether the Physician. J. Med. Syst. 2023, 47, 32. [Google Scholar] [PubMed]
- Ellaway, R.H. Artificial Scholarship: LLMs in Health Professions Education Research. Adv. Health Sci. Educ. 2023, 28, 659–664. [Google Scholar] [CrossRef] [PubMed]
- Samaan, J.S.; Hui, Y.; Nithya, Y.; Lauren, R.; Stuart, H.; Wee, A.; Ng, H.; Srinivasan, N.; Park, J.; Burch, M.; et al. Assessing the Accuracy of Responses by the Language Model ChatGPT to Questions Regarding Bariatric Surgery. Obes. Surg. 2023, 33, 1790–1796. [Google Scholar] [CrossRef] [PubMed]
- Gilson, A.; Safranek, C.W.; Huang, T.; Socrates, V.; Chi, L.; Street, C. Authors’ Reply to: Variability in Large Language Models’ Responses to Medical Licensing and Certification Examinations. JMIR Med. Educ. 2023, 9, e50336. [Google Scholar] [CrossRef] [PubMed]
- Santandreu-Calonge, D.; Medina-Aguerrebere, P.; Hultberg, P.; Shah, M.-A. Can ChatGPT Improve Communication in Hospitals? Anu. Thinkepi 2023, 32, 1–16. [Google Scholar] [CrossRef]
- Singh, S.; Djalilian, A.; Ali, M.J. ChatGPT and Ophthalmology: Exploring Its Potential with Discharge Summaries and Operative Notes. Semin. Ophthalmol. 2023, 38, 503–507. [Google Scholar] [CrossRef] [PubMed]
- Oh, N.; Choi, G.; Lee, W.Y. ChatGPT Goes to the Operating Room: Evaluating GPT-4 Performance and Its Potential in Surgical Education and Training in the Era of Large Language Models. Ann. Surg. Treat. Res. 2023, 104, 269–273. [Google Scholar] [CrossRef]
- Communication, S.; Khan, R.A.; Jawaid, M.; Khan, A.R.; Sajjad, M. ChatGPT–Reshaping Medical Education and Clinical Management. Pak. J. Med. Sci. 2023, 39, 605–607. [Google Scholar]
- Liu, X.; Wu, C.; Lai, R.; Lin, H.; Xu, Y.; Lin, Y.; Zhang, W. ChatGPT: When the Artificial Intelligence Meets Standardized Patients in Clinical Training. J. Transl. Med. 2023, 21, 447. [Google Scholar] [CrossRef] [PubMed]
- Gao, C.A.; Howard, F.M.; Pearson, A.T.; Dyer, E.C. Comparing Scientific Abstracts Generated by ChatGPT to Real Abstracts with Detectors and Blinded Human Reviewers. NPJ Digit. Med. 2023, 6, 75. [Google Scholar] [CrossRef] [PubMed]
- Rahimzadeh, V.; Kostick-quenet, K.; Barby, J.B.; Mcguire, A.L.; Rahimzadeh, V.; Kostick-quenet, K.; Barby, J.B.; Rahimzadeh, V.; Kostick-Quenet, K.; Barby, J.B.; et al. Ethics Education for Healthcare Professionals in the Era of ChatGPT and Other Large Language Models: Do We Still Need It? Ethics Education for Healthcare Professionals in the Era of ChatGPT And. Am. J. Bioeth. 2023, 23, 17–27. [Google Scholar] [CrossRef] [PubMed]
- Lahat, A.; Shachar, E.; Avidan, B.; Glicksberg, B.; Klang, E. Evaluating the Utility of a Large Language Model in Answering Common Patients’ Gastrointestinal Health-Related Questions: Are We There Yet? Diagnostics 2023, 13, 1950. [Google Scholar] [CrossRef] [PubMed]
- Wang, H.; Jenny, Y.; Yuan, D. Future of ChatGPT in Pharmacovigilance. Drug Saf. 2023, 46, 711–713. [Google Scholar] [CrossRef] [PubMed]
- Rodigin, A. Is Medicine Ready for ChatGPT–Why Not Just Ask ChatGPT? Eur. J. Transl. Clin. Med. 2023, 6, 5–8. [Google Scholar] [CrossRef]
- Wang, H.; Wu, W.; Dou, Z.; He, L.; Yang, L. Performance and Exploration of ChatGPT in Medical Examination, Records and Education in Chinese: Pave the Way for Medical AI. Int. J. Med. Inform. 2023, 177, 105173. [Google Scholar] [CrossRef]
- Cheng, K.; Li, Z.; He, Y.; Guo, Q.; Lu, Y.; Gu, S.; Wu, H. Potential Use of Artificial Intelligence in Infectious Disease: Take ChatGPT as an Example. Ann. Biomed. Eng. 2023, 51, 1130–1135. [Google Scholar] [CrossRef]
- Nov, O.; Singh, N.; Mann, D. Putting ChatGPT’s Medical Advice to the (Turing) Test: Survey Study. JMIR Med. Educ. 2023, 9, e46939. [Google Scholar] [CrossRef]
- Janamala, V.; Sai, I.; Suresh, R.; Daram, B. Realization of Green 5G Cellular Network Role in Medical Applications: Use of ChatGPT–AI. Ann. Biomed. Eng. 2023, 51, 2337–2339. [Google Scholar] [CrossRef]
- Janamla, V.; Babu, S.; Patil, D.; Nagaraja, R.C.H. Response of ChatGPT for Humanoid Robots Role in Improving Healthcare and Patient Outcomes. Ann. Biomed. Eng. 2023, 51, 2359–2361. [Google Scholar] [CrossRef]
- Polonsky, M.J.; Rotman, J.D. Should Artificial Intelligent Agents Be Your Co-Author? Arguments in Favour, Informed by ChatGPT. Australas. Mark. J. 2023, 31, 91–96. [Google Scholar] [CrossRef]
- Sedaghat, S. Success Through Simplicity: What Other Artificial Intelligence Applications in Medicine Should Learn from History and ChatGPT. Ann. Biomed. Eng. 2023, 51, 2657–2658. [Google Scholar] [CrossRef] [PubMed]
- Bin Arif, T.; Munaf, U.; Ul-Haque, I. The Future of Medical Education and Research: Is ChatGPT a Blessing or Blight in Disguise? Med. Educ. Online 2023, 28, 2181052. [Google Scholar] [CrossRef]
- Wornow, M.; Xu, Y.; Thapa, R.; Patel, B.; Steinberg, E.; Fleming, S. The Shaky Foundations of Large Language Models and Foundation Models for Electronic Health Records. NPJ Digit. Med. 2023, 6, 135. [Google Scholar] [CrossRef]
- Hügle, T. The Wide Range of Opportunities for Large Language Models Such as ChatGPT in Rheumatology. RMD Open 2023, 9, e003105. [Google Scholar] [CrossRef] [PubMed]
- Liu, J.; Wang, C.; Liu, S. Utility of ChatGPT in Clinical Practice. J. Med. Internet Res. 2023, 25, e48568. [Google Scholar] [CrossRef]
- Cohen, I.G.; Cohen, I.G. What Should ChatGPT Mean for Bioethics? What Should ChatGPT Mean for Bioethics? Am. J. Bioeth. 2023, 23, 8–16. [Google Scholar] [CrossRef]
No. | References | Aims, Design | Application(s), Benefit(s) | Risk(s), Concern(s), Limitation(s) | Study Field/Area and Categories (G) | Conclusion(s), Suggested Action |
---|---|---|---|---|---|---|
1 | [51] | Evaluate ChatGPT’s medical applications via systematic review of articles. | Streamline tasks, improve care, decision making, communication in medicine. |
| Medicine, G4. | ChatGPT’s medical potential is promising but faces challenges. Ethical, safety considerations vital for transforming healthcare with AI. |
2 | [13] | Study examines ChatGPT’s integration in education, research, and healthcare perspectives. | ChatGPT’s applications: text generation, literature analysis, image learning in education, healthcare, and research. |
| Education, healthcare, research, G1. | Responsible AI use demands transparency, equity, reliability, and non-harm principles. |
3 | [44] | Examine ChatGPT’s utility in healthcare education, weigh pros and cons. | Enhances personalised learning, clinical reasoning, and skills development. |
| Medical, dental, pharmacy, and public health, G1. | ChatGPT’s integration in healthcare education offers potential advantages. Further research required to address ethical, bias, and accuracy concerns. |
4 | [5] | Assess ChatGPT’s medical query accuracy and completeness for physicians. | ChatGPT as medical information source with substantial accuracy and potential. |
| Medical, G4, G5. | ChatGPT shows potential as medical resource but requires validation and improvement. |
5 | [15] | Evaluate ChatGPT’s performance in medical education, content generation, and deception. | Medical education, skill practice, patient interaction simulation, content generation. |
| Medical, G1, G4, G5. | ChatGPT’s potential in education is transformative yet raises ethical concerns. |
6 | [6] | Evaluate ChatGPT’s utility in healthcare education, research, and practice. Systematic Review. | Improved writing, efficient research, personalised learning, streamlined practice. |
| Healthcare Education, Research, Practice, G5, G7 | Widespread LLM use is inevitable; ethical guidelines crucial. ChatGPT’s potential in healthcare must be carefully weighed against risks. Careful implementation with human expertise essential to avoid misuse and harm. |
7 | [6] | Assess ChatGPT’s utility and limitations in healthcare education, research, practice. Systematic Review. | Efficient research, personalised learning, streamlined practice, enhanced writing. |
| Healthcare Education, Research, Practice, G 5, G8. | Imminent LLM adoption, guided by guidelines, balances potential and risks. |
8 | [16] | Explore ChatGPT’s use in medical education perceptions and experiences. | ChatGPT can aid information collection, saving time and effort. |
| Medical Education, G3, G4, G7. | Study offers insights: ChatGPT’s pros acknowledged, concerns raised, need further research for successful integration in medical education. |
9 | [7] | Investigate ChatGPT’s potential in simplifying medical reports for radiology, Radiology Reports (Case Study). | ChatGPT simplifies radiology reports; improves patient-centred care. |
| Medical/Radiology Reports, G6. | Positive potential of LLMs for radiology report simplification; need for technical improvements and further research. |
10 | [52] | Analyse differences between human-written medical texts and ChatGPT-generated texts, develop detection methods. | Enhance trustworthy medical text generation, improve detection accuracy. |
| Medical Texts, G5. | ChatGPT-generated medical texts differ from human-written ones, detection methods effective. Trustworthy application of large language models in medicine promoted. |
11 | [9] | Summarise ChatGPT’s role in medical education and healthcare literature, Hybrid Literature Review. | Insight into ChatGPT’s impact on medical education, research, writing. |
| Presence G5, G6. | Review highlights ChatGPT’s medical role, urges criteria for co-authorship. |
12 | [8] | Review the use of ChatGPT in medical and dental research. | ChatGPT assists in academic paper search, summarisation, translation, and scientific writing. |
| Medical/Dental Research, G7. | ChatGPT aids research but ethical concerns and limitations require examination. |
13 | [53] | Investigate ChatGPT’s healthcare applications via an interview. | Rapid, informative response generation; written content quality. |
| Health Care, G1 G5, G6. | Not available. |
14 | [54] | Analyse ChatGPT’s use in healthcare, emphasising its status and potential. Taxonomy/Systematic Review. | Provides insights into ChatGPT’s medical applications, informs healthcare professionals. |
| Healthcare G4, G5, G7, G8. | This study evaluates ChatGPT’s medical applications, emphasising insights and limitations. Clinical deployment remains unfeasible due to current performance. |
15 | [39] | Analyse ChatGPT’s AI applications, benefits, limitations, ethics in healthcare. | Medical research, diagnosis aid, education, patient assistance, updates. |
| Medicine, G4. | ChatGPT has healthcare applications, but ethical concerns and limitations need addressing. |
16 | [55] | Evaluate ChatGPT’s medical utility and accuracy in healthcare discourse. | Rapid response for medical queries, user-friendly interaction. |
| Healthcare/research, G2, G5, G6. | ChatGPT offers limited utility in healthcare, requiring fact-checking and awareness. |
17 | [56] | Discuss opportunities and risks of ChatGPT’s implementation in various fields. | Easy communication, potential for improving content quality. |
| Medicine, science, academic publishing, G1, G4, G5, G6 | Embrace AI, but thoughtfully, considering benefits and risks. |
18 | [57] | Evaluate ChatGPT’s potential as a medical chatbot, addressing concerns. | Enhancing healthcare access with technology, while raising ethical concerns. |
| Medical/ chatbots, G1, G5, G6, G8. | Balancing ChatGPT’s healthcare potential and concerns requires careful consideration, safeguards, and ongoing improvement. |
19 | [17] | Evaluate ChatGPT’s performance in medical question answering. | Assessing ChatGPT’s accuracy in medical exam questions. |
| Medical/ Licensing Exams, G1, G7. | ChatGPT shows promise as a medical education tool for answering questions with reasoning and context. |
20 | [40] | Evaluate ChatGPT’s role in medical research. | Enhances drug development, literature review, report improvement, personalised medicine, and more. |
| Medical/ Research, G4, G5. | ChatGPT offers transformative potential but requires addressing accuracy, integrity, and ethical considerations for clinical application. |
21 | [58] | Investigate the use of ChatGPT in expediting literature review articles creation, focusing on Digital Twin applications in healthcare. Literature Review. | Utilising ChatGPT for literature review accelerates knowledge compilation, easing academic efforts and focusing on research. |
| Healthcare/ Digital Twin, G1, G3, G4. | ChatGPT generated Digital Twin in healthcare articles. Low plagiarism in author-written text, high similarity in abstract paraphrases. AI accelerates knowledge expression, academic validity monitored through citations. |
22 | [59] | Explore ChatGPT’s healthcare applications, discuss limitations, and benefits. | Medical data analysis, chatbots, virtual assistants, language processing. |
| Healthcare, G6, G8. | ChatGPT has versatile healthcare applications but faces ethical, privacy, and accuracy concerns. |
23 | [60] | Examine AI impact on medical publishing ethics and guidelines. | AI-generated content, democratisation of knowledge dissemination, multi-language support. |
| Medical/ publishing, G3, G5, G6. | AI like ChatGPT can democratise knowledge, but ethical, accuracy, and access challenges need comprehensive consideration and guidelines. |
24 | [25] | Evaluate AI impact on academic writing integrity and learning enhancement. | Academic writing, learning enhancement, objective evaluation of AI-generated content. |
| Medical/ imaging, G6. | Conclusion: ChatGPT shows potential for learning enhancement but risks academic integrity and lacks depth for advanced subjects. |
25 | [61] | Explore ChatGPT’s capabilities for medical education and practice. | ChatGPT aids medical education, generates patient simulations, quizzes, research summaries, and promotes AI learning. |
| Medical education, G1, G4, G5, G8. | ChatGPT shows potential for medical education, research, but faces limitations and challenges. JMIR Medical Education is launching a theme issue on AI. |
26 | [26] | To explore the potential applications of ChatGPT in assisting researchers with tasks such as literature review, data analysis, hypothesis creation, and text generation. | Literature review, data analysis, hypothesis creation, text generation. |
| Medical research, G6, G8. | Scientific caution is needed in using ChatGPT due to plagiarism risks, misleading outcomes, lack of context, and AI limitations. |
27 | [62] | To examine the potential impact of large language models (LLM), specifically “ChatGPT”, on the nuclear medicine community and its reliability in generating nuclear medicine and molecular imaging-related content. | Text generation, collaborative tool |
| Medicine/ nuclear, G6. | ChatGPT’s multiple-choice answering accuracy was 34%, surpassing random guessing. Improving training and learning capabilities is crucial. |
28 | [63] | To explore applications and limitations of the language model ChatGPT in healthcare. | Investigating ChatGPT’s potential in clinical practice, scientific production, reasoning, and education. |
| Healthcare, Clinical, Research Scenarios, G5, G7 | ChatGPT’s utilisation in healthcare requires cautiousness, considering its capabilities and ethical concerns. |
29 | [64] | To comprehensively review ChatGPT’s performance, applications, challenges, and future prospects. | Explore ChatGPT’s potential across various domains, anticipate future advancements, and guide research and development. |
| Mult, medical, G6. | Review identifies ChatGPT’s potential, applications, limitations, and suggests future improvements. |
30 | [65] | This study aims to examine the potential and limitations of ChatGPT in medical research and education, focusing on its applications and ethical considerations. | ChatGPT can support researchers in literature review, data analysis, hypothesis generation, and medical education. Its AI capabilities enable efficient information extraction and text generation, enhancing research and learning processes. |
| Clinical, translational medicine, G3, G6. | ChatGPT’s applications in scientific research must be approached cautiously, considering evolving limitations and human input, with focus on research ethics and integrity. |
31 | [28] | To explore the potential of Large Language Models (LLMs) like OpenAI’s ChatGPT in medical imaging, investigating their impact on radiology and healthcare. | LLMs enhance radiologists’ interpretation skills, facilitate patient–doctor communication, and optimise clinical workflows, potentially improving medical diagnosis and treatment planning. |
| Medical/ imaging, G6. | Large Language Models (LLMs), in medical imaging promise revolutionary impact with research and ethics. |
32 | [66] | Investigate ChatGPT’s role in medical education, exploring its applications, benefits, limitations, and challenges; Scoping Review. | ChatGPT aids automated scoring, personalised learning, case generation, research, content creation, and translation in medical education. |
| Medical/ Education, G1, G5. | ChatGPT enhances medical education with personalised learning, yet its limitations, biases, and challenges warrant cautious implementation and evaluation. |
33 | [67] | This study examines if ChatGPT-4 can provide accurate and safe medical information to patients considering blepharoplasty. | ChatGPT-4 aids patient education, offers evidence-based information, and improves communication between medical professionals and patients. |
| Medical/ Blepharoplasties, G1, G5, G7. | ChatGPT-4 shows potential in patient education for cosmetic surgery, offering accurate and clear information, but its limitations require consideration. |
34 | [12] | To explore the capabilities and applications of ChatGPT, a large language model developed by OpenAI. | Chatbots, language translation, text completion, question answering. |
| The Use of Cybersecurity to Protect Medical Information, G1, G4, G5. | Not available. |
35 | [10] | Explore AI language model ChatGPT’s viability as a clinical assistant. Evaluate ChatGPT’s ability to provide informative and accurate responses during initial consultations about cosmetic orthognathic surgery. | ChatGPT can assist patients with medical queries. |
| A Cosmetic orthognathic surgery consultation, G3, G4. | ChatGPT demonstrates potential in offering valuable medical information to patients, particularly when access to professionals is restricted. However, its limitations and scope should be further investigated for safe and effective use in healthcare. |
36 | [34] | To examine the impact of artificial intelligence (AI) on dental practice, particularly in CBCT data management, and explore the potential benefits and limitations. | AI-driven Cone-beam-computed tomography (CBCT) data management can revolutionise dental practice workflow by improving efficiency and accuracy. Segmentation automation aids treatment planning and patient communication, enhancing overall care. |
| Standard Medical Diagnostic/ dental, G3. | AI integration in dental practice, particularly CBCT data management, shows promise in enhancing efficiency, accuracy, and patient communication while facing bias and reliability challenges. |
37 | [35] | To explore the potential applications of ChatGPT, in managing and controlling infectious diseases, focusing on information dissemination, diagnosis, treatment, and research. | ChatGPT can enhance infectious disease management by providing accurate information, aiding diagnosis, suggesting treatment options, and supporting research efforts, ultimately improving patient care and public health. |
| Tackles Pandemics/Infectious Disease, G4. | ChatGPT exhibits transformative potential in infectious disease management, though data reliance, medical accuracy, ethical concerns, and misuse risks require careful consideration. |
38 | [68] | To explore the integration of AI and algorithms to enhance physician workflow, maintain patient–physician rapport, and streamline administrative tasks. | AI can seamlessly assist doctors in clinical note generation, order selection, coding, history gathering, inbox filtering, and billing processes, improving efficiency and accuracy. |
| Medicine/ De-Tether the Physician, G2. | Not available. |
39 | [69] | To explore the implications of large language models (LLMs), particularly ChatGPT, for the field of academic paper authorship and authority, and to address the ethical concerns and challenges they introduce in health professions education (HPE). | Authorship and authority assessment, scholarly communication enhancement, technological advancement reflection. |
| Artificial scholarship: LLMs in health professions education research, G5, G7, G8. | Not available. |
40 | [70] | To assess ChatGPT’s accuracy and reproducibility in responding to patient queries about bariatric surgery. | ChatGPT serves as an information source for patient inquiries about bariatric surgery, aiding patient education and enhancing their understanding of the procedure. |
| Bariatric Surgery, G5, G4. | ChatGPT offers accurate responses for bariatric surgery inquiries. It is a valuable adjunct to patient education alongside healthcare professionals, fostering better outcomes and quality of life through technology integration. |
41 | [71] | Investigate ChatGPT’s behaviour, geolocation impact, and grammatical tuning, and address performance concerns. | Inform ChatGPT’s reliable use in education and medical assessments. |
| Medical Licensing/Certification Examinations. | Not available. |
42 | [18] | Explore ethical considerations in integrating AI applications into medical education, identifying concerns and proposing recommendations. | Integration in medical education for interactive learning. Benefits include personalised instruction and improved understanding. |
| Medical/Education Biomedical Ethical Aspects. G3. | Integration of AI in medical education offers enhanced learning but demands a robust ethical framework, iteratively updated for evolving advancements and user input. |
43 | [72] | To investigate whether the use of ChatGPT technology can enhance communication in healthcare settings, leading to improved patient care and outcomes. | To explores the potential application of ChatGPT technology to address communication challenges in hospitals. By generating clear and understandable medical information, ChatGPT can bridge the communication gap between healthcare providers and patients. This could result in improved patient understanding, reduced miscommunication, and enhanced patient care quality. |
| Communication in hospitals, G4, G7. | ChatGPT aids hospitals in enhancing patient care and communication efficiency. |
44 | [24] | Evaluate ChatGPT’s reliability in diagnosing diseases and treating patients. | Preliminary medical assessments; quick information for users seeking advice. |
| Diagnosis and patient care, G3, G4, G7. | ChatGPT’s case responses need improvement; users require expertise for interpretation. |
45 | [73] | To assess ChatGPT’s abilities in generating ophthalmic discharge summaries and operative notes. | ChatGPT can potentially aid in creating accurate and rapid ophthalmic discharge summaries. |
| Ophthalmology, G3. | ChatGPT’s performance in ophthalmic notes is promising, rapid, and impactful with focused training and human verification. |
46 | [36] | To assess healthcare workers’ knowledge, attitudes, and intended practices towards ChatGPT in Saudi Arabia. | ChatGPT can be used to support medical decision making, patient support, literature appraisal, research assistance, and enhance healthcare systems. |
| Digital Health, G4, G5. | This study highlights ChatGPT’s potential benefits in healthcare but concerns about accuracy and reliability persist. Trustworthy implementation requires addressing these issues. |
47 | [74] | To evaluate ChatGPT’s performance in comprehending complex surgical clinical data and its implications for surgical education. | Assessing ChatGPT (GPT-3.5 and GPT-4) in understanding surgical data for improved education and training. |
| Operating room, G1, G3. | ChatGPT, especially GPT-4, excels in comprehending surgical data. Achieving 76.4% accuracy on the board exam, its potential must be combined with human expertise. |
48 | [19] | To assess ChatGPT’s factual medical knowledge by comparing its performance with medical students in a progress test. | ChatGPT’s AI offers easy medical knowledge access. It aids medical education and testing. |
| Medical school, G3, G4, G7, G8. | ChatGPT accurately answered most MCQs in Progress Test Medicine, surpassing students’ performance in years 1–3, comparable to latter-stage students. |
49 | [20] | To explore the utility and accuracy of using ChatGPT-3, an AI language model, in understanding and discussing complex psychiatric diagnoses such as catatonia. | It investigates the potential of ChatGPT-3 as a tool for medical professionals to assist in understanding and discussing complex psychiatric diagnoses. It demonstrates the feasibility of using AI in medical research and education. |
| Medical Education, G1, G7. | Not available. |
50 | [75] | To compare ChatGPT’s performance in answering medical questions with medical students’ performance in a progress test. | ChatGPT can aid medical education by providing factual knowledge. It offers quick access to information and can complement teaching materials. |
| Medical education, clinical management, G1. | ChatGPT is a valuable aid in medical education, research, and clinical management but not a human replacement. Despite limitations, AI’s rapid progress can enhance medical practices if embraced thoughtfully. |
51 | [29] | To explore the potential application of ChatGPT as a medical assistant in Mandarin-Chinese-speaking outpatient clinics, aiming to enhance patient satisfaction and communication. | ChatGPT enhances clinic communication, aids patient satisfaction, excels in exams, and improves interactions in non-English medical settings. |
| Outpatient clinic settings, G4. | Not available. |
52 | [30] | To explore the role of AI in scientific article writing, particularly editorials, and its potential impact on rheumatologists. | AI, like ChatGPT, can aid rheumatologists in writing, improving efficiency. AI’s growing role in medicine, including image analysis. |
| Rheumatologist + medical writing, G6. | AI offers scientific progress but caution is needed to avoid shallow work and hindered education. Beware AI dominance. |
53 | [76] | To evaluate the accuracy and effectiveness of using ChatGPT for simulating standardised patients (SP) in medical training. | ChatGPT is utilised to simulate patient interactions, saving time, resources, and eliminating complex preparation steps. Offers intelligent, colloquial, and accurate responses, potentially enhancing medical training efficiency. |
| Clinical training, G4 | Not available. |
54 | [77] | To evaluate the accuracy and effectiveness of using ChatGPT for simulating standardised patients (SP) in medical training. | ChatGPT is utilised to simulate patient interactions, saving time, resources, and eliminating complex preparation steps. Offers intelligent, colloquial, and accurate responses, potentially enhancing medical training efficiency. |
| Education, healthcare, research, G1. | Not available. |
55 | [21] | To evaluate the performance, potential applications, benefits, and limitations of ChatGPT in medical practice, education, and research. | ChatGPT demonstrates proficiency in medical exams and academic writing, potentially aiding medical education, research, and patient–provider communication. |
| Medical practice + education + research, G1, G7. | ChatGPT holds potential for medical practice, education, and research but requires refinements before widespread use. Human judgment remains crucial despite its sophistication. |
56 | [78] | It is examining the necessity of traditional ethics education in healthcare training, given the capabilities of ChatGPT and other large language models (LLMs). | ChatGPT and LLMs can assist in fostering ethics competencies among future clinicians, aligning with bioethics education goals. |
| Healthcare+ Ethics, G6, G7, G8. | Considering strengths and limitations, ChatGPT can be an adjunctive tool for ethics education in healthcare training, accounting for evolving technology. |
57 | [37] | To determine if ChatGPT can support multidisciplinary tumour board in breast cancer therapy planning. | ChatGPT’s application in aiding breast cancer therapy decisions; benefits include efficiency and broader information access. |
| Cancer cases, G3. | Artificial intelligence aids personalised therapy; ChatGPT’s potential in clinical medicine is promising, but it lacks specific recommendations for primary breast cancer patients. |
58 | [22] | The aim of this study was to assess the performance of ChatGPT models in higher specialty training for neurology and neuroscience, particularly in the context of the UK medical education system. | It demonstrates the potential application of ChatGPT models in medical education, specifically in the field of neurology and neuroscience. It highlights their ability to perform at or above passing thresholds in specialised medical examinations, offering a tool for enhancing medical training and practice. |
| Medical + Neurology, G7, G8. | ChatGPT-4’s progress showcases AI’s promise in medical education, but close collaboration is vital for sustained relevance and reliability in healthcare. |
59 | [79] | Evaluate ChatGPT’s performance in answering patients’ gastrointestinal health questions. | ChatGPT assists patients with health inquiries, potentially enhancing information accessibility in healthcare. |
| Gastrointestinal Health, G3, G5. | ChatGPT’s potential in health info provision exists, but development and source quality improvement are necessary. |
60 | [80] | Investigate ChatGPT’s potential applications, especially in pharmacovigilance. | ChatGPT transforms human–machine interactions, offering innovative solutions, such as enhancing pharmacovigilance processes. |
| Pharmacovigilance, G3, G4, G5. | Not available. |
61 | [38] | Evaluate the impact of AI, particularly ChatGPT, in the field of surgery, considering both its benefits and potential harms. | AI, including ChatGPT, can enhance surgical outcomes, diagnostics, and patient experiences. It offers efficiency and precision in surgical treatments. |
| Intelligence, Surgery, G3, G6. | The growing influence of AI in surgery demands ethical contemplation. |
No. | References | Field of Study | Study Aim | Pros | Cons, Challenge(s) |
---|---|---|---|---|---|
1 | [38] | Surgery, Implications, Ethical Considerations. | Assess AI’s Impact on Surgery. |
|
|
2 | [23] | Medical, education. | Integrate ChatGPT into Medical Education. |
|
|
3 | [6] | Healthcare Education, Research, Practice. | To assess the utility of ChatGPT in healthcare education, research, and practice, highlighting its potential advantages and limitations. |
|
|
4 | [81] | medicine, ChatGPT. | Questioning AI, Role in Medicine. |
|
|
5 | [41] | Healthcare. | Explore ChatGPT’s Role in Medicine. |
|
|
6 | [31] | Medicine. | Explore AI’s Impact on Paediatric Research. |
|
|
7 | [32] | Medical Imaging, Radiologist. | Aims to explore the challenges faced in communicating radiation risks and benefits of radiological examinations, especially in cases involving vulnerable groups like pregnant women and children. |
|
|
8 | [82] | medical examination, records, Chinese education. | To assess ChatGPT’s performance in understanding Chinese medical knowledge, its potential as an electronic health infrastructure, and its ability to improve medical tasks and interactions, while acknowledging challenges related to hallucinations and ethical considerations. |
|
|
9 | [83] | Infectious Disease. | This study aims to evaluate the potential utilisation of ChatGPT in clinical practice and scientific research of infectious diseases, along with discussing relevant social and ethical implications. |
|
|
10 | [84] | Medical, Test (Turing). | To evaluate the feasibility of using AI-based chatbots like ChatGPT for patient–provider communication, focusing on distinguishing responses, patient trust, and implications for healthcare interactions. |
|
|
11 | [85] | Medical applications. | Promoting Sustainable Practices in Medical 5G Communication. |
|
|
12 | [86] | Patient Outcomes, Healthcare. | To investigate the potential applications of humanoid robots in the medical industry, considering their role during the COVID-19 pandemic and future possibilities, while emphasising the irreplaceable importance of human healthcare professionals and the complementary nature of robotics. |
|
|
13 | [87] | Medical. | Evaluating AI as Collaborative Research Partners. |
|
|
14 | [88] | Medicine, History. | To explore the importance of simplifying operations and creating user-friendly interfaces in AI-based medical applications, drawing insights from the success of ChatGPT and its impact on user adoption and clinical practice. |
|
|
15 | [89] | medical, education. | The aim of this specific aspect of the study is to critically analyse the manuscript and offer valuable feedback to improve its content, quality, and overall presentation. |
|
|
16 | [11] | Dental assistant, Nurse. | To explores AI’s impact on dental assistants and nurses in orthodontic practices, examining evolving treatment workflows. |
|
|
17 | [33] | ultrasound image guidance. | To assess the potential of using the Segment Anything Model (SAM) for intelligent ultrasound image guidance. It explores the application of SAM in accurately segmenting ultrasound images and discusses its potential contribution to a framework for autonomous and universal ultrasound image guidance. |
|
|
18 | [90] | Health records. | Evaluate electronic medical records. (EMRs) foundation. models. |
|
|
19 | [91] | Rheumatology. | Explore ChatGPT’s potential in rheumatology. |
|
|
20 | [40] | Medical Research. | Evaluate ChatGPT’s impact on medical research. |
|
|
21 | [92] | Clinical Practice. | Explore ChatGPT’s applications and implications in clinical practice. |
|
|
22 | [93] | Bioethics. | Explore bioethical implications of ChatGPT. |
|
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Younis, H.A.; Eisa, T.A.E.; Nasser, M.; Sahib, T.M.; Noor, A.A.; Alyasiri, O.M.; Salisu, S.; Hayder, I.M.; Younis, H.A. A Systematic Review and Meta-Analysis of Artificial Intelligence Tools in Medicine and Healthcare: Applications, Considerations, Limitations, Motivation and Challenges. Diagnostics 2024, 14, 109. https://doi.org/10.3390/diagnostics14010109
Younis HA, Eisa TAE, Nasser M, Sahib TM, Noor AA, Alyasiri OM, Salisu S, Hayder IM, Younis HA. A Systematic Review and Meta-Analysis of Artificial Intelligence Tools in Medicine and Healthcare: Applications, Considerations, Limitations, Motivation and Challenges. Diagnostics. 2024; 14(1):109. https://doi.org/10.3390/diagnostics14010109
Chicago/Turabian StyleYounis, Hussain A., Taiseer Abdalla Elfadil Eisa, Maged Nasser, Thaeer Mueen Sahib, Ameen A. Noor, Osamah Mohammed Alyasiri, Sani Salisu, Israa M. Hayder, and Hameed AbdulKareem Younis. 2024. "A Systematic Review and Meta-Analysis of Artificial Intelligence Tools in Medicine and Healthcare: Applications, Considerations, Limitations, Motivation and Challenges" Diagnostics 14, no. 1: 109. https://doi.org/10.3390/diagnostics14010109
APA StyleYounis, H. A., Eisa, T. A. E., Nasser, M., Sahib, T. M., Noor, A. A., Alyasiri, O. M., Salisu, S., Hayder, I. M., & Younis, H. A. (2024). A Systematic Review and Meta-Analysis of Artificial Intelligence Tools in Medicine and Healthcare: Applications, Considerations, Limitations, Motivation and Challenges. Diagnostics, 14(1), 109. https://doi.org/10.3390/diagnostics14010109