Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3607720.3607787acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnissConference Proceedingsconference-collections
research-article

Unleashing the Power of NLP and Transformers: A Game-Changer in Medical Research and Clinical Practice and a revolution of Medical Text Analysis.: Case Study: Cancer report classification by priority

Published: 13 November 2023 Publication History
  • Get Citation Alerts
  • Abstract

    The integration of (NLP) and transformers, such as BERT, in the medical field has revolutionized text processing and analysis, offering remarkable opportunities for advancements in research and clinical practice. This article presents a comprehensive exploration of the application of NLP and transformers in the medical domain, specifically focusing on their utilization in cancer-related radiological reports' classification by priority.
    The study employs BERT, a bidirectional transformer-based language model, to convert radiological reports into embedding vectors, capturing contextual relationships between words. An attention technique is employed to aggregate word-embedding vectors, emphasizing important words within the report. next, an analysis using the gated rectified unit (GRU) is performed on a collection of radiological reports pertaining to an individual patient. This analysis aims to derive a patient embedding vector, which encapsulates the essential information from the multiple reports and represents the overall condition of the patient. Finally, a classifier is implemented to classify the reports based on their priority levels, enabling doctors to treat patients in an ordered and timely manner. Experimental results on a dataset consisting of 1,000 cancer-related radiological reports demonstrate the efficacy of the proposed approach. The dataset includes reports with varying degrees of severity, allowing for the classification of reports into priority categories. Evaluation metrics such as precision, recall, and F1 score showcase the model's accuracy and robustness, achieving high performance across different priority levels.

    References

    [1]
    K. R. Chowdhary. 2020. Natural Language Processing. In Fundamentals of Artificial Intelligence, K. R. Chowdhary (Ed.). Springer India, New Delhi, 603-649.
    [2]
    I. H. Sarker. 2021. Machine Learning: Algorithms, Real-World Applications and Research Directions. SN COMPUT. SCI. 2, 3, 160 (March 2021).
    [3]
    T. Lin, Y. Wang, X. Liu, and X. Qiu. 2022. A survey of transformers. AI Open 3, 111-132 (January 2022).
    [4]
    J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv:1810.04805 (May 2019).
    [5]
    A. K. Jabali, A. Waris, D. I. Khan, S. Ahmed, and R. J. Hourani. 2022. Electronic health records: Three decades of bibliometric research productivity analysis and some insights. Informatics in Medicine Unlocked 29, 100872 (January 2022).
    [6]
    I. H. Sarker. 2021. Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions. SN COMPUT. SCI. 2, 6, 420 (August 2021).
    [7]
    M.-H. Guo 2022. Attention mechanisms in computer vision: A survey. Computational Visual Media 8, 3, 331-368 (September 2022).
    [8]
    Y. Wang 2018. Clinical information extraction applications: A literature review. Journal of Biomedical Informatics 77, 34-49 (January 2018).
    [9]
    N. Perera, M. Dehmer, and F. Emmert-Streib. 2020. Named Entity Recognition and Relation Detection for Biomedical Information Extraction. Front Cell Dev Biol 8, 673 (August 2020).
    [10]
    S. Raza and B. Schwartz. 2023. Entity and relation extraction from clinical case reports of COVID-19: a natural language processing approach. BMC Med Inform Decis Mak 23, 20 (January 2023).
    [11]
    Y. Yang, Z. Wu, Y. Yang, S. Lian, F. Guo, and Z. Wang. 2022. A Survey of Information Extraction Based on Deep Learning. Applied Sciences 12, 19 (January 2022).
    [12]
    F. Zhu 2013. Biomedical text mining and its applications in cancer research. Journal of Biomedical Informatics 46, 2, 200-211 (April 2013).
    [13]
    M. Marrone, S. Lemke, and L. M. Kolbe. 2022. Entity linking systems for literature reviews. Scientometrics 127, 7, 3857-3878 (July 2022).
    [14]
    J. Lee 2019. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics (Oxford, England) 36 (September 2019).
    [15]
    R. Tinn 2023. Fine-tuning large neural language models for biomedical natural language processing. Patterns 4, 4, 100729 (April 2023).
    [16]
    F. Hak, T. Guimarães, and M. Santos. 2022. Towards effective clinical decision support systems: A systematic review. PLoS One 17, 8, e0272846 (August 2022).
    [17]
    K. Haerian, D. Varn, S. Vaidya, L. Ena, H. Chase, and C. Friedman. 2012. Detection of Pharmacovigilance-Related adverse Events Using Electronic Health Records and automated Methods. Clin Pharmacol Ther 92, 2, 228-234 (August 2012).
    [18]
    Y. Zhang, S. Cui, and H. Gao. 2020. Adverse drug reaction detection on social media with deep linguistic features. Journal of Biomedical Informatics 106, 103437 (June 2020).
    [19]
    H. Wang, H. Wu, Z. He, L. Huang, and K. W. Church. 2022. Progress in Machine Translation. Engineering 18, 143-153 (November 2022).
    [20]
    D. Krystallidou, W. Langewitz, and M. van den Muijsenbergh. 2021. Multilingual healthcare communication: Stumbling blocks, solutions, recommendations. Patient Education and Counseling 104, 3, 512-516 (March 2021).
    [21]
    D. Varshney, A. Zafar, N. K. Behera, and A. Ekbal. 2023. Knowledge grounded medical dialogue generation using augmented graphs. Sci Rep 13, 1 (February 2023).
    [22]
    E. Mutabazi, J. Ni, G. Tang, and W. Cao. 2021. A Review on Medical Textual Question Answering Systems Based on Deep Learning Approaches. Applied Sciences 11, 12 (January 2021).
    [23]
    T. Shaik 2023. Remote patient monitoring using artificial intelligence: Current state, applications, and challenges. WIREs Data Mining and Knowledge Discovery 13, 2, e1485 (2023).
    [24]
    E. Pons, L. M. M. Braun, M. G. M. Hunink, and J. A. Kors. 2016. Natural Language Processing in Radiology: A Systematic Review. Radiology 279, 2, 329-343 (May 2016).
    [25]
    M. Wang, M. Wang, F. Yu, Y. Yang, J. Walker, and J. Mostafa. 2021. A systematic review of automatic text summarization for biomedical literature and EHRs. J Am Med Inform Assoc 28, 10, 2287-2297 (August 2021).

    Index Terms

    1. Unleashing the Power of NLP and Transformers: A Game-Changer in Medical Research and Clinical Practice and a revolution of Medical Text Analysis.: Case Study: Cancer report classification by priority

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      NISS '23: Proceedings of the 6th International Conference on Networking, Intelligent Systems & Security
      May 2023
      451 pages
      ISBN:9798400700194
      DOI:10.1145/3607720
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 November 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Classifier
      2. Natural Language Processing
      3. bidirectional transformer-based language model
      4. medical field
      5. transformers

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      NISS 2023

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 33
        Total Downloads
      • Downloads (Last 12 months)33
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 27 Jul 2024

      Other Metrics

      Citations

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media