Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3706890.3706892acmotherconferencesArticle/Chapter ViewAbstractPublication PagesisaimsConference Proceedingsconference-collections
research-article

ElderQA-GPT: A Large Language Model for Online Q&A on Geriatric Diseases Based on BGE Semantic Vector Knowledge Base and LangChain Architecture

Published: 13 January 2025 Publication History

Abstract

Scientific guidance of disease Q&A for the elderly is of distinct significance for improving the health level of the elderly, which is the immediate need of the current aging society. The traditional question answering system for geriatric diseases based on knowledge graph relies heavily on manual annotation and has some problems such as difficulty in knowledge fusion. The rapid development of large models provides a new opportunity for geriatric disease Q&A system, but it also has problems such as interpretability, applicability and multi-round Q&A illusion. In this paper, we propose a large language model ElderQA-GPT for online Q&A of geriatric diseases based on BGE semantic vector knowledge base and LangChain architecture. First, in order to improve the interpretability of Q&A dialogues, this paper adopts the SELF-QA framework and combines the current professional websites of geriatric diseases (including Dr. Ding Xiang, Seeking Medical Care, and the Chinese government website) to construct a vector database of geriatric diseases based on the BGE semantic vector model; secondly, in order to improve the accuracy and applicability of the system, the lightweight open source ChatGLM3 model is privately deployed based on the LangChain architecture, which enhances the retrieval capability of the localized inference knowledge base; lastly, in order to better accumulate and comprehend the information in the complex contexts and multiple rounds of dialogues, and to maintain the semantic consistency, a LoRA fine-tuning technique is used to enhance the ElderQA-GPT multi-round dialogue capability. Two sets of quantitative experiments were conducted to explore two dimensions: the interpretability of model responses and the resolution of the illusion problem in multi-round Q&A sessions. Additionally, an ablation study was carried out by omitting the knowledge base to comparatively evaluate the impact on the system's performance. The validation results demonstrate that ElderQA-GPT exhibits improved answer interpretability and applicability, effectively maintaining semantic consistency across multi-round dialogues without introducing false information. The findings of this study significantly advance the field of online Q&A for geriatric diseases by addressing critical challenges such as interpretability, accuracy, and multi-round dialogue. Our proposed model ElderQA-GPT not only improves public knowledge and understanding of geriatric diseases but also optimizes medical resource allocation and enhances health management for the elderly population. By providing interpretable and accurate responses across multi-round dialogues, ElderQA-GPT ensures that users receive reliable medical information tailored to their needs. These advancements have profound implications for healthcare delivery and society, paving the way for more efficient and effective healthcare services for elderly individuals.

References

[1]
Wang B, Lin S, Huang Z, et al. Home Self-medication Question-Answering System for the Elderly Based on Seq2Seq Model and Knowledge Graph Technology[C]//International Conference on Health Information Science. Singapore: Springer Nature Singapore, 2023, 343-353.
[2]
Lee, Ching-Hung et al. Artificial Intelligence-Enabled Digital Transformation in Elderly Healthcare Field: Scoping Review. Advanced engineering informatics 2023, 55, 101874.
[3]
Martin, Beth A. et al. Identifying Over-the-Counter Information to Prioritize for the Purpose of Reducing Adverse Drug Reactions in Older Adults: A National Survey of Pharmacists. Journal of the American Pharmacists Association 2022, 62.1, 167-175.e1.
[4]
WANG, Fan, and Li WANG. Communication Model in Chinese Online Medical Consultations: Insights and Implications. Patient education and counseling 2024, 118, 108031.
[5]
Boreshban, Yasaman et al. Improving Question Answering Performance Using Knowledge Distillation and Active Learning. Engineering applications of artificial intelligence 2023, 123, 106137.
[6]
Ding, Qinxu et al. Unraveling the Landscape of Large Language Models: A Systematic Review and Future Perspectives. Journal of Electronic Business & Digital Economics 2024, 3.1, 319.
[7]
Blübaum, Lukas, and Stefan Heindorf. Causal Question Answering with Reinforcement Learning. arXiv.org 2023, arXiv.org, 2023-11.
[8]
Wang Tianbin et al. Design and Implementation of Knowledge Graph question answering System with Integrated machine Reading Comprehension. Journal of Information Engineering University 2021, 22.6, 709-715.
[9]
Huang, Lei et al. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions. arXiv.org 2023, arXiv.org, 2023-11.
[10]
Dwivedi, Yogesh K. et al. Opinion Paper: “So What If ChatGPT Wrote It?” Multidisciplinary Perspectives on Opportunities, Challenges and Implications of Generative Conversational AI for Research, Practice and Policy. International journal of information management 2023, 71, 102642.
[11]
Xiao, Shitao et al. C-Pack: Packaged Resources To Advance General Chinese Embedding. arXiv.org 2023, arXiv.org, 2023-12.
[12]
Douze, Matthijs, et al. The Faiss Library, 2024.
[13]
Hu, Edward J et al. LoRA: Low-Rank Adaptation of Large Language Models. arXiv.org 2021, arXiv.org, 2021-06.
[14]
MSV J. Building a QA app with LangChain and Google PaLM 2[J]. InfoWorld.com, 2023.
[15]
Zhang, Xuanyu, and Qing Yang. Self-QA: Unsupervised Knowledge Guided Language Model Alignment. arXiv.org, 2023, arXiv.org, 2023-05.

Index Terms

  1. ElderQA-GPT: A Large Language Model for Online Q&A on Geriatric Diseases Based on BGE Semantic Vector Knowledge Base and LangChain Architecture

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ISAIMS '24: Proceedings of the 2024 5th International Symposium on Artificial Intelligence for Medicine Science
    August 2024
    967 pages
    ISBN:9798400717826
    DOI:10.1145/3706890
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 January 2025

    Check for updates

    Author Tags

    1. BGE
    2. ElderQA-GPT
    3. LangChain
    4. SELF-QA

    Qualifiers

    • Research-article

    Conference

    ISAIMS 2024

    Acceptance Rates

    Overall Acceptance Rate 53 of 112 submissions, 47%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 9
      Total Downloads
    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media