Prediction of Occult Invasive Disease in Ductal Carcinoma in Situ Using Deep Learning Features

Bibo Shi, Lars J. Grimm, Maciej A. Mazurowski, Jay A. Baker, Jeffrey R. Marks, Lorraine M. King, Carlo Maley, E. Shelley Hwang, Joseph Y. Lo

Research output: Contribution to journalArticle

21 Scopus citations

Abstract

Purpose: The aim of this study was to determine whether deep features extracted from digital mammograms using a pretrained deep convolutional neural network are prognostic of occult invasive disease for patients with ductal carcinoma in situ (DCIS) on core needle biopsy. Methods: In this retrospective study, digital mammographic magnification views were collected for 99 subjects with DCIS at biopsy, 25 of which were subsequently upstaged to invasive cancer. A deep convolutional neural network model that was pretrained on nonmedical images (eg, animals, plants, instruments) was used as the feature extractor. Through a statistical pooling strategy, deep features were extracted at different levels of convolutional layers from the lesion areas, without sacrificing the original resolution or distorting the underlying topology. A multivariate classifier was then trained to predict which tumors contain occult invasive disease. This was compared with the performance of traditional "handcrafted" computer vision (CV) features previously developed specifically to assess mammographic calcifications. The generalization performance was assessed using Monte Carlo cross-validation and receiver operating characteristic curve analysis. Results: Deep features were able to distinguish DCIS with occult invasion from pure DCIS, with an area under the receiver operating characteristic curve of 0.70 (95% confidence interval, 0.68-0.73). This performance was comparable with the handcrafted CV features (area under the curve = 0.68; 95% confidence interval, 0.66-0.71) that were designed with prior domain knowledge. Conclusions: Despite being pretrained on only nonmedical images, the deep features extracted from digital mammograms demonstrated comparable performance with handcrafted CV features for the challenging task of predicting DCIS upstaging.

Original languageEnglish (US)
JournalJournal of the American College of Radiology
DOIs
StateAccepted/In press - Jan 1 2018

Keywords

  • Computer vision
  • Convolution neural network
  • Deep learning
  • Digital mammography
  • Ductal carcinoma in situ

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Prediction of Occult Invasive Disease in Ductal Carcinoma in Situ Using Deep Learning Features'. Together they form a unique fingerprint.

  • Cite this

    Shi, B., Grimm, L. J., Mazurowski, M. A., Baker, J. A., Marks, J. R., King, L. M., Maley, C., Hwang, E. S., & Lo, J. Y. (Accepted/In press). Prediction of Occult Invasive Disease in Ductal Carcinoma in Situ Using Deep Learning Features. Journal of the American College of Radiology. https://doi.org/10.1016/j.jacr.2017.11.036