Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1007/978-3-031-16437-8_23guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

ORF-Net: Deep Omni-Supervised Rib Fracture Detection from Chest CT Scans

Published: 18 September 2022 Publication History

Abstract

Most of the existing object detection works are based on the bounding box annotation: each object has a precise annotated box. However, for rib fractures, the bounding box annotation is very labor-intensive and time-consuming because radiologists need to investigate and annotate the rib fractures on a slice-by-slice basis. Although a few studies have proposed weakly-supervised methods or semi-supervised methods, they could not handle different forms of supervision simultaneously. In this paper, we proposed a novel omni-supervised object detection network, which can exploit multiple different forms of annotated data to further improve the detection performance. Specifically, the proposed network contains an omni-supervised detection head, in which each form of annotation data corresponds to a unique classification branch. Furthermore, we proposed a dynamic label assignment strategy for different annotated forms of data to facilitate better learning for each branch. Moreover, we also design a confidence-aware classification loss to emphasize the samples with high confidence and further improve the model’s performance. Extensive experiments conducted on the testing dataset show our proposed method outperforms other state-of-the-art approaches consistently, demonstrating the efficacy of deep omni-supervised learning on improving rib fracture detection performance.

References

[1]
Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceedings of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100 (1998)
[2]
Cho S, Sung Y, and Kim M Missed rib fractures on evaluation of initial chest CT for trauma patients: pattern analysis and diagnostic value of coronal multiplanar reconstruction images with multidetector row CT Br. J. Radiol. 2012 85 1018 e845-e850
[3]
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
[4]
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
[5]
Jeong, J., Lee, S., Kim, J., Kwak, N.: Consistency-based semi-supervised learning for object detection. Adv. Neural Inf. Process. Syst. 32 (2019)
[6]
Laine, S., Aila, T.: Temporal ensembling for semi-supervised learning. arXiv preprint arXiv:1610.02242 (2016)
[7]
Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2117–2125 (2017)
[8]
Lin, T.Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)
[9]
Liu, Y.C., et al.: Unbiased teacher for semi-supervised object detection. arXiv preprint arXiv:2102.09480 (2021)
[10]
Luo, L., et al.: Rethinking annotation granularity for overcoming deep shortcut learning: a retrospective study on chest radiographs. arXiv preprint arXiv:2104.10553 (2021)
[11]
Luo L, Chen H, Zhou Y, Lin H, Heng P-A, et al. de Bruijne M et al. OXnet: deep omni-supervised thoracic disease detection from chest X-rays Medical Image Computing and Computer Assisted Intervention – MICCAI 2021 2021 Cham Springer 537-548
[12]
Paszke, A., et al.: PyTorch: an imperative style, high-performance deep learning library. Adv. Neural Inf. Process. Syst. 32 (2019)
[13]
Radosavovic, I., Dollár, P., Girshick, R., Gkioxari, G., He, K.: Data distillation: towards omni-supervised learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4119–4128 (2018)
[14]
Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst. 28 (2015)
[15]
Ren Z, Yu Z, Yang X, Liu M-Y, Schwing AG, and Kautz J Vedaldi A, Bischof H, Brox T, and Frahm J-M UFO2: a unified framework towards omni-supervised object detection Computer Vision – ECCV 2020 2020 Cham Springer 288-313
[16]
Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., Savarese, S.: Generalized intersection over union: a metric and a loss for bounding box regression. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 658–666 (2019)
[17]
Ringl H et al. The ribs unfolded-a CT visualization algorithm for fast detection of rib fractures: effect on sensitivity and specificity in trauma patients Eur. Radiol. 2015 25 7 1865-1874
[18]
Sirmali M et al. A comprehensive analysis of traumatic rib fractures: morbidity, mortality and management Eur. J. Cardiothorac. Surg. 2003 24 1 133-138
[19]
Sohn, K., Zhang, Z., Li, C.L., Zhang, H., Lee, C.Y., Pfister, T.: A simple semi-supervised learning framework for object detection. arXiv preprint arXiv:2005.04757 (2020)
[20]
Talbot BS, Gange CP Jr, Chaturvedi A, Klionsky N, Hobbs SK, and Chaturvedi A Traumatic rib injury: patterns, imaging pitfalls, complications, and treatment Radiographics 2017 37 2 628-651
[21]
Tian, Z., Shen, C., Chen, H., He, T.: Fcos: A simple and strong anchor-free object detector. IEEE Trans. Pattern Anal. Mach. Intell. (2020)
[22]
Wang, D., Zhang, Y., Zhang, K., Wang, L.: FocalMix: semi-supervised learning for 3D medical image detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3951–3960 (2020)
[23]
Wang Y et al. Feragen A, Sommer S, Schnabel J, Nielsen M, et al. Knowledge distillation with adaptive asymmetric label sharpening for semi-supervised fracture detection in chest X-rays Information Processing in Medical Imaging 2021 Cham Springer 599-610
[24]
Weikert T et al. Assessment of a deep learning algorithm for the detection of rib fractures on whole-body trauma computed tomography Korean J. Radiol. 2020 21 7 891
[25]
Wu, M., et al.: Development and evaluation of a deep learning algorithm for rib segmentation and fracture detection from multicenter chest CT images. Radiol.: Artif. Intell. 3(5), e200248 (2021)
[26]
Xia, Y., et al.: Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation. Med. Image Anal. 65, 101766 (2020)
[27]
Zhang, S., Chi, C., Yao, Y., Lei, Z., Li, S.Z.: Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)
[28]
Zhou, H.Y., et al.: SSMD: semi-supervised medical image detection with adaptive consistency and heterogeneous perturbation. Med. Image Anal. 72, 102117 (2021)
[29]
Zhou QQ et al. Automatic detection and classification of rib fractures on thoracic CT using convolutional neural network: accuracy and feasibility Korean J. Radiol. 2020 21 7 869
[30]
Zhu, B., et al.: AutoAssign: differentiable label assignment for dense object detection. arXiv preprint arXiv:2007.03496 (2020)

Cited By

View all
  • (2023)Weakly Semi-supervised Detection in Lung Ultrasound VideosInformation Processing in Medical Imaging10.1007/978-3-031-34048-2_16(195-207)Online publication date: 12-Jun-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings
Medical Image Computing and Computer Assisted Intervention – MICCAI 2022: 25th International Conference, Singapore, September 18–22, 2022, Proceedings, Part III
Sep 2022
831 pages
ISBN:978-3-031-16436-1
DOI:10.1007/978-3-031-16437-8
  • Editors:
  • Linwei Wang,
  • Qi Dou,
  • P. Thomas Fletcher,
  • Stefanie Speidel,
  • Shuo Li

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 18 September 2022

Author Tags

  1. Omni-supervised learning
  2. Rib fracture
  3. Object detection

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 04 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Weakly Semi-supervised Detection in Lung Ultrasound VideosInformation Processing in Medical Imaging10.1007/978-3-031-34048-2_16(195-207)Online publication date: 12-Jun-2023

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media