Improving classification with forced labeling of other related classes: Application to prediction of upstaged ductal carcinoma in situ using mammographic features

Rui Hou, Bibo Shi, Lars J. Grimm, MacIej A. Mazurowski, Jeffrey R. Marks, Lorraine M. King, Carlo Maley, E. Shelley Hwang, Joseph Y. Lo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Predicting whether ductal carcinoma in situ (DCIS) identified at core biopsy contains occult invasive disease is an import task since these "upstaged" cases will affect further treatment planning. Therefore, a prediction model that better classifies pure DCIS and upstaged DCIS can help avoid overtreatment and overdiagnosis. In this work, we propose to improve this classification performance with the aid of two other related classes: Atypical Ductal Hyperplasia (ADH) and Invasive Ductal Carcinoma (IDC). Our data set contains mammograms for 230 cases. Specifically, 66 of them are ADH cases; 99 of them are biopsy-proven DCIS cases, of whom 25 were found to contain invasive disease at the time of definitive surgery. The remaining 65 cases were diagnosed with IDC at core biopsy. Our hypothesis is that knowledge can be transferred from training with the easier and more readily available cases of benign but suspicious ADH versus IDC that is already apparent at initial biopsy. Thus, embedding both ADH and IDC cases to the classifier will improve the performance of distinguishing upstaged DCIS from pure DCIS. We extracted 113 mammographic features based on a radiologist's annotation of clusters.Our method then added both ADH and IDC cases during training, where ADH were "force labeled" or treated by the classifier as pure DCIS (negative) cases, and IDC were labeled as upstaged DCIS (positive) cases. A logistic regression classifier was built based on the designed training dataset to perform a prediction of whether biopsy-proven DCIS cases contain invasive cancer. The performance was assessed by repeated 5-fold CrossValidation and Receiver Operating Characteristic(ROC) curve analysis. While prediction performance with only training on DCIS dataset had an average AUC of 0.607(%95CI, 0.479-0.721). By adding both ADH and IDC cases for training, we improved the performance to 0.691(95%CI, 0.581-0.801).

Original languageEnglish (US)
Title of host publicationMedical Imaging 2018
Subtitle of host publicationComputer-Aided Diagnosis
PublisherSPIE
Volume10575
ISBN (Electronic)9781510616394
DOIs
StatePublished - Jan 1 2018
EventMedical Imaging 2018: Computer-Aided Diagnosis - Houston, United States
Duration: Feb 12 2018Feb 15 2018

Other

OtherMedical Imaging 2018: Computer-Aided Diagnosis
CountryUnited States
CityHouston
Period2/12/182/15/18

Fingerprint

Carcinoma, Intraductal, Noninfiltrating
Biopsy
Labeling
marking
cancer
Ductal Carcinoma
predictions
Classifiers
education
Surgery
Logistics
classifiers
Planning
annotations
performance prediction
logistics

Keywords

  • ADH
  • Breast cancer
  • digital mammogram
  • ductal carcinoma in situ
  • IDC

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging

Cite this

Hou, R., Shi, B., Grimm, L. J., Mazurowski, M. A., Marks, J. R., King, L. M., ... Lo, J. Y. (2018). Improving classification with forced labeling of other related classes: Application to prediction of upstaged ductal carcinoma in situ using mammographic features. In Medical Imaging 2018: Computer-Aided Diagnosis (Vol. 10575). [105750R] SPIE. https://doi.org/10.1117/12.2293809

Improving classification with forced labeling of other related classes : Application to prediction of upstaged ductal carcinoma in situ using mammographic features. / Hou, Rui; Shi, Bibo; Grimm, Lars J.; Mazurowski, MacIej A.; Marks, Jeffrey R.; King, Lorraine M.; Maley, Carlo; Shelley Hwang, E.; Lo, Joseph Y.

Medical Imaging 2018: Computer-Aided Diagnosis. Vol. 10575 SPIE, 2018. 105750R.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hou, R, Shi, B, Grimm, LJ, Mazurowski, MA, Marks, JR, King, LM, Maley, C, Shelley Hwang, E & Lo, JY 2018, Improving classification with forced labeling of other related classes: Application to prediction of upstaged ductal carcinoma in situ using mammographic features. in Medical Imaging 2018: Computer-Aided Diagnosis. vol. 10575, 105750R, SPIE, Medical Imaging 2018: Computer-Aided Diagnosis, Houston, United States, 2/12/18. https://doi.org/10.1117/12.2293809
Hou R, Shi B, Grimm LJ, Mazurowski MA, Marks JR, King LM et al. Improving classification with forced labeling of other related classes: Application to prediction of upstaged ductal carcinoma in situ using mammographic features. In Medical Imaging 2018: Computer-Aided Diagnosis. Vol. 10575. SPIE. 2018. 105750R https://doi.org/10.1117/12.2293809
Hou, Rui ; Shi, Bibo ; Grimm, Lars J. ; Mazurowski, MacIej A. ; Marks, Jeffrey R. ; King, Lorraine M. ; Maley, Carlo ; Shelley Hwang, E. ; Lo, Joseph Y. / Improving classification with forced labeling of other related classes : Application to prediction of upstaged ductal carcinoma in situ using mammographic features. Medical Imaging 2018: Computer-Aided Diagnosis. Vol. 10575 SPIE, 2018.
@inproceedings{e81071a633f2409ca8035b577f9a39e8,
title = "Improving classification with forced labeling of other related classes: Application to prediction of upstaged ductal carcinoma in situ using mammographic features",
abstract = "Predicting whether ductal carcinoma in situ (DCIS) identified at core biopsy contains occult invasive disease is an import task since these {"}upstaged{"} cases will affect further treatment planning. Therefore, a prediction model that better classifies pure DCIS and upstaged DCIS can help avoid overtreatment and overdiagnosis. In this work, we propose to improve this classification performance with the aid of two other related classes: Atypical Ductal Hyperplasia (ADH) and Invasive Ductal Carcinoma (IDC). Our data set contains mammograms for 230 cases. Specifically, 66 of them are ADH cases; 99 of them are biopsy-proven DCIS cases, of whom 25 were found to contain invasive disease at the time of definitive surgery. The remaining 65 cases were diagnosed with IDC at core biopsy. Our hypothesis is that knowledge can be transferred from training with the easier and more readily available cases of benign but suspicious ADH versus IDC that is already apparent at initial biopsy. Thus, embedding both ADH and IDC cases to the classifier will improve the performance of distinguishing upstaged DCIS from pure DCIS. We extracted 113 mammographic features based on a radiologist's annotation of clusters.Our method then added both ADH and IDC cases during training, where ADH were {"}force labeled{"} or treated by the classifier as pure DCIS (negative) cases, and IDC were labeled as upstaged DCIS (positive) cases. A logistic regression classifier was built based on the designed training dataset to perform a prediction of whether biopsy-proven DCIS cases contain invasive cancer. The performance was assessed by repeated 5-fold CrossValidation and Receiver Operating Characteristic(ROC) curve analysis. While prediction performance with only training on DCIS dataset had an average AUC of 0.607({\%}95CI, 0.479-0.721). By adding both ADH and IDC cases for training, we improved the performance to 0.691(95{\%}CI, 0.581-0.801).",
keywords = "ADH, Breast cancer, digital mammogram, ductal carcinoma in situ, IDC",
author = "Rui Hou and Bibo Shi and Grimm, {Lars J.} and Mazurowski, {MacIej A.} and Marks, {Jeffrey R.} and King, {Lorraine M.} and Carlo Maley and {Shelley Hwang}, E. and Lo, {Joseph Y.}",
year = "2018",
month = "1",
day = "1",
doi = "10.1117/12.2293809",
language = "English (US)",
volume = "10575",
booktitle = "Medical Imaging 2018",
publisher = "SPIE",

}

TY - GEN

T1 - Improving classification with forced labeling of other related classes

T2 - Application to prediction of upstaged ductal carcinoma in situ using mammographic features

AU - Hou, Rui

AU - Shi, Bibo

AU - Grimm, Lars J.

AU - Mazurowski, MacIej A.

AU - Marks, Jeffrey R.

AU - King, Lorraine M.

AU - Maley, Carlo

AU - Shelley Hwang, E.

AU - Lo, Joseph Y.

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Predicting whether ductal carcinoma in situ (DCIS) identified at core biopsy contains occult invasive disease is an import task since these "upstaged" cases will affect further treatment planning. Therefore, a prediction model that better classifies pure DCIS and upstaged DCIS can help avoid overtreatment and overdiagnosis. In this work, we propose to improve this classification performance with the aid of two other related classes: Atypical Ductal Hyperplasia (ADH) and Invasive Ductal Carcinoma (IDC). Our data set contains mammograms for 230 cases. Specifically, 66 of them are ADH cases; 99 of them are biopsy-proven DCIS cases, of whom 25 were found to contain invasive disease at the time of definitive surgery. The remaining 65 cases were diagnosed with IDC at core biopsy. Our hypothesis is that knowledge can be transferred from training with the easier and more readily available cases of benign but suspicious ADH versus IDC that is already apparent at initial biopsy. Thus, embedding both ADH and IDC cases to the classifier will improve the performance of distinguishing upstaged DCIS from pure DCIS. We extracted 113 mammographic features based on a radiologist's annotation of clusters.Our method then added both ADH and IDC cases during training, where ADH were "force labeled" or treated by the classifier as pure DCIS (negative) cases, and IDC were labeled as upstaged DCIS (positive) cases. A logistic regression classifier was built based on the designed training dataset to perform a prediction of whether biopsy-proven DCIS cases contain invasive cancer. The performance was assessed by repeated 5-fold CrossValidation and Receiver Operating Characteristic(ROC) curve analysis. While prediction performance with only training on DCIS dataset had an average AUC of 0.607(%95CI, 0.479-0.721). By adding both ADH and IDC cases for training, we improved the performance to 0.691(95%CI, 0.581-0.801).

AB - Predicting whether ductal carcinoma in situ (DCIS) identified at core biopsy contains occult invasive disease is an import task since these "upstaged" cases will affect further treatment planning. Therefore, a prediction model that better classifies pure DCIS and upstaged DCIS can help avoid overtreatment and overdiagnosis. In this work, we propose to improve this classification performance with the aid of two other related classes: Atypical Ductal Hyperplasia (ADH) and Invasive Ductal Carcinoma (IDC). Our data set contains mammograms for 230 cases. Specifically, 66 of them are ADH cases; 99 of them are biopsy-proven DCIS cases, of whom 25 were found to contain invasive disease at the time of definitive surgery. The remaining 65 cases were diagnosed with IDC at core biopsy. Our hypothesis is that knowledge can be transferred from training with the easier and more readily available cases of benign but suspicious ADH versus IDC that is already apparent at initial biopsy. Thus, embedding both ADH and IDC cases to the classifier will improve the performance of distinguishing upstaged DCIS from pure DCIS. We extracted 113 mammographic features based on a radiologist's annotation of clusters.Our method then added both ADH and IDC cases during training, where ADH were "force labeled" or treated by the classifier as pure DCIS (negative) cases, and IDC were labeled as upstaged DCIS (positive) cases. A logistic regression classifier was built based on the designed training dataset to perform a prediction of whether biopsy-proven DCIS cases contain invasive cancer. The performance was assessed by repeated 5-fold CrossValidation and Receiver Operating Characteristic(ROC) curve analysis. While prediction performance with only training on DCIS dataset had an average AUC of 0.607(%95CI, 0.479-0.721). By adding both ADH and IDC cases for training, we improved the performance to 0.691(95%CI, 0.581-0.801).

KW - ADH

KW - Breast cancer

KW - digital mammogram

KW - ductal carcinoma in situ

KW - IDC

UR - http://www.scopus.com/inward/record.url?scp=85046258100&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046258100&partnerID=8YFLogxK

U2 - 10.1117/12.2293809

DO - 10.1117/12.2293809

M3 - Conference contribution

AN - SCOPUS:85046258100

VL - 10575

BT - Medical Imaging 2018

PB - SPIE

ER -