Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

MTSS-AAE: : Multi-task semi-supervised adversarial autoencoding for COVID-19 detection based on chest X-ray images

Published: 15 April 2023 Publication History

Abstract

Efficient diagnosis of COVID-19 plays an important role in preventing the spread of the disease. There are three major modalities to diagnose COVID-19 which include polymerase chain reaction tests, computed tomography scans, and chest X-rays (CXRs). Among these, diagnosis using CXRs is the most economical approach; however, it requires extensive human expertise to diagnose COVID-19 in CXRs, which may deprive it of cost-effectiveness. The computer-aided diagnosis with deep learning has the potential to perform accurate detection of COVID-19 in CXRs without human intervention while preserving its cost-effectiveness. Many efforts have been made to develop a highly accurate and robust solution. However, due to the limited amount of labeled data, existing solutions are evaluated on a small set of test dataset. In this work, we proposed a solution to this problem by using a multi-task semi-supervised learning (MTSSL) framework that utilized auxiliary tasks for which adequate data is publicly available. Specifically, we utilized Pneumonia, Lung Opacity, and Pleural Effusion as additional tasks using the ChesXpert dataset. We illustrated that the primary task of COVID-19 detection, for which only limited labeled data is available, can be improved by using this additional data. We further employed an adversarial autoencoder (AAE), which has a strong capability to learn powerful and discriminative features, within our MTSSL framework to maximize the benefit of multi-task learning. In addition, the supervised classification networks in combination with the unsupervised AAE empower semi-supervised learning, which includes a discriminative part in the unsupervised AAE training pipeline. The generalization of our framework is improved due to this semi-supervised learning and thus it leads to enhancement in COVID-19 detection performance. The proposed model is rigorously evaluated on the largest publicly available COVID-19 dataset and experimental results show that the proposed model attained state-of-the-art performance.

Highlights

The automated detection of COVID-19 using chest X-rays.
A novel MTL-based adversarial semi-supervised framework to address the smaller size of data.
We focus to utilize the unlabeled data to improve the performance as well as the generalization of the system.
Model was developed using publicly available datasets i.e., CheXpert and COVIDx.
The proposed method outperforms the standard state-of-the-art approaches.

References

[1]
Abbas A., Abdelsamea M.M., Gaber M.M., Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network, Applied Intelligence 51 (2) (2021) 854–864.
[2]
Ahmed A., Pneumonia sample X-rays, Git Hub, 2019, 2020.
[3]
Baxter J., A model of inductive bias learning, Journal of Artificial Intelligence Research 12 (2000) 149–198.
[4]
Ben-David S., Schuller R., Exploiting task relatedness for multiple task learning, in: Learning theory and kernel machines, Springer, 2003, pp. 567–580.
[5]
Bouchareb Y., Khaniabadi P.M., Al Kindi F., Al Dhuhli H., Shiri I., Zaidi H., et al., Artificial intelligence-driven assessment of radiological images for COVID-19, Computers in Biology and Medicine (2021).
[6]
Breve F.A., COVID-19 detection on chest X-Ray images: A comparison of CNN architectures and ensembles, Expert Systems with Applications (2022).
[7]
Caruana R., Multitask learning, Machine Learning 28 (1) (1997) 41–75.
[8]
Chakraborty M., Dhavale S.V., Ingole J., Corona-Nidaan: lightweight deep convolutional neural network for chest X-Ray based COVID-19 infection detection, Applied Intelligence 51 (5) (2021) 3026–3043.
[9]
Cohen J.P., Morrison P., Dao L., COVID-19 image data collection, 2020, arXiv:2003.11597.
[10]
Cohen J.P., Morrison P., Dao L., Roth K., Duong T.Q., Ghassemi M., Covid-19 image data collection: Prospective predictions are the future, 2020, arXiv preprint arXiv:2006.11988.
[11]
Colavita F., Vairo F., Meschi S., Valli M.B., Lalle E., Castilletti C., et al., Covid-19 rapid antigen test as screening strategy at points of entry: Experience in Lazio region, central Italy, August–October 2020, Biomolecules 11 (3) (2021) 425.
[12]
Corman V., Bleicker T., Brünink S., Drosten C., Zambon M., Diagnostic detection of 2019-nCoV by real-time RT-PCR, vol. 17, World Health Organization, 2020.
[13]
Dialameh M., Hamzeh A., Rahmani H., Radmard A.R., Dialameh S., Proposing a novel deep network for detecting COVID-19 based on chest images, Scientific Reports 12 (1) (2022) 1–12.
[14]
Dong D., Tang Z., Wang S., Hui H., Gong L., Lu Y., et al., The role of imaging in the detection and management of COVID-19: a review, IEEE Reviews in Biomedical Engineering (2020).
[15]
Hellou M.M., Górska A., Mazzaferri F., Cremonini E., Gentilotti E., De Nardo P., et al., Nucleic-acid-amplification tests from respiratory samples for the diagnosis of coronavirus infections: systematic review and meta-analysis, Clinical Microbiology and Infection (2020).
[16]
Irvin, J., Rajpurkar, P., Ko, M., Yu, Y., Ciurea-Ilcus, S., Chute, C., et al. (2019). Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. In Proceedings of the AAAI conference on artificial intelligence, vol. 33 (pp. 590–597).
[17]
Ismael A.M., Şengür A., Deep learning approaches for COVID-19 detection based on chest X-ray images, Expert Systems with Applications 164 (2021).
[18]
Jacobi A., Chung M., Bernheim A., Eber C., Portable chest X-ray in coronavirus disease-19 (COVID-19): A pictorial review, Clinical Imaging (2020).
[19]
Jaeger S., Candemir S., Antani S., Wáng Y.-X.J., Lu P.-X., Thoma G., Two public chest X-ray datasets for computer-aided screening of pulmonary diseases, Quantitative Imaging in Medicine and Surgery 4 (6) (2014) 475.
[20]
Jia G., Lam H.-K., Xu Y., Classification of COVID-19 chest X-Ray and CT images using a type of dynamic CNN modification method, Computers in Biology and Medicine 134 (2021).
[21]
Joarder R., Crundwell N., Chest X-ray in clinical practice, Springer Science & Business Media, 2009.
[22]
Karim M., Döhmen T., Rebholz-Schuhmann D., Decker S., Cochez M., Beyan O., et al., Deepcovidexplainer: Explainable covid-19 predictions based on chest X-ray images, 2020, arXiv preprint arXiv:2004.04582.
[23]
Kermany D., Zhang K., Goldbaum M., et al., Labeled optical coherence tomography (oct) and chest X-ray images for classification, Mendeley Data 2 (2) (2018).
[24]
Khan A.I., Shah J.L., Bhat M.M., CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest X-ray images, Computer Methods and Programs in Biomedicine 196 (2020).
[25]
Khobahi S., Agarwal C., Soltanalian M., CoroNet: A deep network architecture for semi-supervised task-based identification of covid-19 from chest X-ray images, 2020, MedRxiv.
[26]
Latif S., Usman M., Manzoor S., Iqbal W., Qadir J., Tyson G., et al., Leveraging data science to combat covid-19: A comprehensive review, IEEE Transactions on Artificial Intelligence (2020).
[27]
Li Q., Guan X., Wu P., Wang X., Zhou L., Tong Y., et al., Early transmission dynamics in Wuhan, China, of novel coronavirus–infected pneumonia, New England Journal of Medicine (2020).
[28]
Li X., Li C., Zhu D., Covid-mobilexpert: On-device covid-19 screening using snapshots of chest X-ray, 2020, arXiv preprint arXiv:2004.03042.
[29]
Liao Z., Lan P., Fan X., Kelly B., Innes A., Liao Z., SIRVD-DL: A COVID-19 deep learning prediction model based on time-dependent SIRVD, Computers in Biology and Medicine 138 (2021).
[30]
Lin Z., He Z., Xie S., Wang X., Tan J., Lu J., et al., AANet: adaptive attention network for COVID-19 detection from chest X-ray images, IEEE Transactions on Neural Networks and Learning Systems 32 (11) (2021) 4781–4792.
[31]
Luz E., Silva P.L., Silva R., Moreira G., Towards an efficient deep learning model for covid-19 patterns detection in X-ray images, 2020, arXiv preprint arXiv:2004.05717.
[32]
Mahmud T., Rahman M.A., Fattah S.A., CovXNet: A multi-dilation convolutional neural network for automatic COVID-19 and other pneumonia detection from chest X-ray images with transferable multi-receptive feature optimization, Computers in Biology and Medicine 122 (2020).
[33]
Makhzani A., Shlens J., Jaitly N., Goodfellow I., Frey B., Adversarial autoencoders, 2015, arXiv preprint arXiv:1511.05644.
[34]
Minaee S., Kafieh R., Sonka M., Yazdani S., Soufi G.J., Deep-covid: Predicting covid-19 from chest X-ray images using deep transfer learning, Medical Image Analysis 65 (2020).
[35]
Nishio M., Noguchi S., Matsuo H., Murakami T., Automatic classification between COVID-19 pneumonia, non-COVID-19 pneumonia, and the healthy on chest X-ray image: combination of data augmentation methods, Scientific Reports 10 (1) (2020) 1–6.
[36]
Oh Y., Park S., Ye J.C., Deep learning covid-19 features on cxr using limited training data sets, IEEE Transactions on Medical Imaging 39 (8) (2020) 2688–2700.
[37]
Organization W.H., et al., Coronavirus disease 2019 (COVID-19): situation report, 82, World Health Organization, 2020.
[38]
Ozturk T., Talo M., Yildirim E.A., Baloglu U.B., Yildirim O., Acharya U.R., Automated detection of COVID-19 cases using deep neural networks with X-ray images, Computers in Biology and Medicine 121 (2020).
[39]
Rahman T., Chowdhury M., Khandakar A., Covid-19 radiography database, Kaggle, San Francisco, CA, USA, 2020.
[40]
Sadre R., Sundaram B., Majumdar S., Ushizima D., Validating deep learning inference during chest X-ray classification for COVID-19 screening, Scientific Reports 11 (1) (2021) 1–10.
[41]
Self W.H., Courtney D.M., McNaughton C.D., Wunderink R.G., Kline J.A., High discordance of chest X-ray and computed tomography for detection of pulmonary opacities in ED patients: implications for diagnosing pneumonia, The American Journal of Emergency Medicine 31 (2) (2013) 401–405.
[42]
Shi F., Wang J., Shi J., Wu Z., Wang Q., Tang Z., et al., Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for covid-19, IEEE Reviews in Biomedical Engineering (2020).
[43]
Shiraishi J., Katsuragawa S., Ikezoe J., Matsumoto T., Kobayashi T., Komatsu K.-i., et al., Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists’ detection of pulmonary nodules, American Journal of Roentgenology 174 (1) (2000) 71–74.
[44]
Shoeibi A., Khodatars M., Alizadehsani R., Ghassemi N., Jafari M., Moridian P., et al., Automated detection and forecasting of covid-19 using deep learning techniques: A review, 2020, arXiv preprint arXiv:2007.10785.
[45]
Sirazitdinov I., Kholiavchenko M., Mustafaev T., Yixuan Y., Kuleev R., Ibragimov B., Deep neural network ensemble for pneumonia localization from a large-scale chest X-ray database, Computers & Electrical Engineering 78 (2019) 388–399.
[46]
Tang S., Wang C., Nie J., Kumar N., Zhang Y., Xiong Z., et al., EDL-COVID: Ensemble deep learning for COVID-19 cases detection from chest X-ray images, IEEE Transactions on Industrial Informatics (2021).
[47]
Tayarani-N M.-H., Applications of artificial intelligence in battling against Covid-19: a literature review, Chaos, Solitons & Fractals (2020).
[48]
Toğaçar M., Ergen B., Cömert Z., COVID-19 detection using deep learning models to exploit social mimic optimization and structured chest X-ray images using fuzzy color and stacking approaches, Computers in Biology and Medicine 121 (2020).
[49]
Toraman S., Alakus T.B., Turkoglu I., Convolutional capsnet: A novel artificial neural network approach to detect COVID-19 disease from X-ray images using capsule networks, Chaos, Solitons & Fractals 140 (2020).
[50]
Ullah Z., Farooq M.U., Lee S.-H., An D., A hybrid image enhancement based brain MRI images classification technique, Medical Hypotheses 143 (2020).
[51]
Waheed A., Goyal M., Gupta D., Khanna A., Al-Turjman F., Pinheiro P.R., Covidgan: data augmentation using auxiliary classifier gan for improved covid-19 detection, IEEE Access 8 (2020) 91916–91923.
[52]
Wang L., Lin Z.Q., Wong A., Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest X-ray images, Scientific Reports 10 (1) (2020) 1–12.
[53]
West C.P., Montori V.M., Sampathkumar P., COVID-19 testing: the threat of false-negative results, in: Mayo clinic proceedings, vol. 95, Elsevier, 2020, pp. 1127–1129.
[54]
Wu J.T., Leung K., Leung G.M., Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study, The Lancet 395 (10225) (2020) 689–697.
[55]
Zargari Khuzani A., Heidari M., Shariati S.A., COVID-classifier: An automated machine learning model to assist in the diagnosis of COVID-19 infection in chest X-ray images, Scientific Reports 11 (1) (2021) 1–6.
[56]
Zhang S., Fu H., Yan Y., Zhang Y., Wu Q., Yang M., et al., Attention guided network for retinal image segmentation, in: International conference on medical image computing and computer-assisted intervention, Springer, 2019, pp. 797–805.
[57]
Zhang K., Liu X., Shen J., Li Z., Sang Y., Wu X., et al., Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography, Cell 181 (6) (2020) 1423–1433.
[58]
Zhang Y., Niu S., Qiu Z., Wei Y., Zhao P., Yao J., et al., Covid-da: Deep domain adaptation from typical pneumonia to covid-19, 2020, arXiv preprint arXiv:2005.01577.
[59]
Zhang J., Xie Y., Pang G., Liao Z., Verjans J., Li W., et al., Viral pneumonia screening on chest X-rays using confidence-aware anomaly detection, IEEE Transactions on Medical Imaging 40 (3) (2020) 879–890.
[60]
Zhong A., Li X., Wu D., Ren H., Kim K., Kim Y., et al., Deep metric learning-based image retrieval system for chest radiograph and its clinical applications in COVID-19, Medical Image Analysis 70 (2021).
[61]
Zhou F., Yu T., Du R., Fan G., Liu Y., Liu Z., et al., Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study, The Lancet 395 (10229) (2020) 1054–1062.
[62]
Zhu N., Zhang D., Wang W., Li X., Yang B., Song J., et al., A novel coronavirus from patients with pneumonia in China, 2019, New England Journal of Medicine (2020).
[63]
Zu Z.Y., Jiang M.D., Xu P.P., Chen W., Ni Q.Q., Lu G.M., et al., Coronavirus disease 2019 (COVID-19): a perspective from China, Radiology 296 (2) (2020) E15–E25.

Cited By

View all
  • (2024)Deep feature analysis in a transfer learning approach for the automatic COVID-19 screening using chest X-ray imagesProcedia Computer Science10.1016/j.procs.2023.10.007225:C(228-237)Online publication date: 4-Mar-2024
  • (2024)Development of abnormal facial temperature detection technology using thermal imaging to prevent the spread of infectious diseasesJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2023.10175435:9Online publication date: 1-Feb-2024
  • (2024)Hot rolled prognostic approach based on hybrid Bayesian progressive layered extraction multi-task learningExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123763249:PCOnline publication date: 17-Jul-2024
  • Show More Cited By

Index Terms

  1. MTSS-AAE: Multi-task semi-supervised adversarial autoencoding for COVID-19 detection based on chest X-ray images
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Expert Systems with Applications: An International Journal
      Expert Systems with Applications: An International Journal  Volume 216, Issue C
      Apr 2023
      1126 pages

      Publisher

      Pergamon Press, Inc.

      United States

      Publication History

      Published: 15 April 2023

      Author Tags

      1. COVID-19
      2. Multi-task learning
      3. Semi-supervised adversarial learning
      4. Representation learning
      5. Deep learning

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 25 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Deep feature analysis in a transfer learning approach for the automatic COVID-19 screening using chest X-ray imagesProcedia Computer Science10.1016/j.procs.2023.10.007225:C(228-237)Online publication date: 4-Mar-2024
      • (2024)Development of abnormal facial temperature detection technology using thermal imaging to prevent the spread of infectious diseasesJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2023.10175435:9Online publication date: 1-Feb-2024
      • (2024)Hot rolled prognostic approach based on hybrid Bayesian progressive layered extraction multi-task learningExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123763249:PCOnline publication date: 17-Jul-2024
      • (2024)Enhancing EfficientNetv2 with global and efficient channel attention mechanisms for accurate MRI-Based brain tumor classificationCluster Computing10.1007/s10586-024-04532-127:8(11187-11212)Online publication date: 1-Nov-2024
      • (2024)An integrated convolutional neural network with attention guidance for improved performance of medical image classificationNeural Computing and Applications10.1007/s00521-023-09164-x36:4(2067-2099)Online publication date: 1-Feb-2024
      • (2024)Transfer Learning Fusion and Stacked Auto-encoders for Viral Lung Disease ClassificationNew Generation Computing10.1007/s00354-024-00247-442:4(651-684)Online publication date: 1-Nov-2024

      View Options

      View options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media