A Crowdsourcing Approach to Developing and Assessing Prediction Algorithms for AML Prognosis

DREAM 9 AML-OPC Consortium

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Acute Myeloid Leukemia (AML) is a fatal hematological cancer. The genetic abnormalities underlying AML are extremely heterogeneous among patients, making prognosis and treatment selection very difficult. While clinical proteomics data has the potential to improve prognosis accuracy, thus far, the quantitative means to do so have yet to be developed. Here we report the results and insights gained from the DREAM 9 Acute Myeloid Prediction Outcome Prediction Challenge (AML-OPC), a crowdsourcing effort designed to promote the development of quantitative methods for AML prognosis prediction. We identify the most accurate and robust models in predicting patient response to therapy, remission duration, and overall survival. We further investigate patient response to therapy, a clinically actionable prediction, and find that patients that are classified as resistant to therapy are harder to predict than responsive patients across the 31 models submitted to the challenge. The top two performing models, which held a high sensitivity to these patients, substantially utilized the proteomics data to make predictions. Using these models, we also identify which signaling proteins were useful in predicting patient therapeutic response.

Original languageEnglish (US)
Article numbere1004890
JournalPLoS Computational Biology
Volume12
Issue number6
DOIs
StatePublished - Jun 1 2016

Fingerprint

Crowdsourcing
myeloid leukemia
Prognosis
Leukemia
Acute Myeloid Leukemia
Acute
prognosis
prediction
Prediction
Therapy
proteomics
Proteomics
therapeutics
abnormality
Model
Therapeutics
cancer
Cancer
remission
leukaemia

ASJC Scopus subject areas

  • Ecology, Evolution, Behavior and Systematics
  • Modeling and Simulation
  • Ecology
  • Molecular Biology
  • Genetics
  • Cellular and Molecular Neuroscience
  • Computational Theory and Mathematics

Cite this

A Crowdsourcing Approach to Developing and Assessing Prediction Algorithms for AML Prognosis. / DREAM 9 AML-OPC Consortium.

In: PLoS Computational Biology, Vol. 12, No. 6, e1004890, 01.06.2016.

Research output: Contribution to journalArticle

@article{4c19117ad8f343479037f0b6aa7d83cc,
title = "A Crowdsourcing Approach to Developing and Assessing Prediction Algorithms for AML Prognosis",
abstract = "Acute Myeloid Leukemia (AML) is a fatal hematological cancer. The genetic abnormalities underlying AML are extremely heterogeneous among patients, making prognosis and treatment selection very difficult. While clinical proteomics data has the potential to improve prognosis accuracy, thus far, the quantitative means to do so have yet to be developed. Here we report the results and insights gained from the DREAM 9 Acute Myeloid Prediction Outcome Prediction Challenge (AML-OPC), a crowdsourcing effort designed to promote the development of quantitative methods for AML prognosis prediction. We identify the most accurate and robust models in predicting patient response to therapy, remission duration, and overall survival. We further investigate patient response to therapy, a clinically actionable prediction, and find that patients that are classified as resistant to therapy are harder to predict than responsive patients across the 31 models submitted to the challenge. The top two performing models, which held a high sensitivity to these patients, substantially utilized the proteomics data to make predictions. Using these models, we also identify which signaling proteins were useful in predicting patient therapeutic response.",
author = "{DREAM 9 AML-OPC Consortium} and Noren, {David P.} and Long, {Byron L.} and Raquel Norel and Kahn Rrhissorrakrai and Kenneth Hess and Hu, {Chenyue Wendy} and Bisberg, {Alex J.} and Andre Schultz and Erik Engquist and Li Liu and Xihui Lin and Chen, {Gregory M.} and Honglei Xie and Hunter, {Geoffrey A M} and Boutros, {Paul C.} and Oleg Stepanov and Thea Norman and Friend, {Stephen H.} and Gustavo Stolovitzky and Steven Kornblau and Qutub, {Amina A.}",
year = "2016",
month = "6",
day = "1",
doi = "10.1371/journal.pcbi.1004890",
language = "English (US)",
volume = "12",
journal = "PLoS Computational Biology",
issn = "1553-734X",
publisher = "Public Library of Science",
number = "6",

}

TY - JOUR

T1 - A Crowdsourcing Approach to Developing and Assessing Prediction Algorithms for AML Prognosis

AU - DREAM 9 AML-OPC Consortium

AU - Noren, David P.

AU - Long, Byron L.

AU - Norel, Raquel

AU - Rrhissorrakrai, Kahn

AU - Hess, Kenneth

AU - Hu, Chenyue Wendy

AU - Bisberg, Alex J.

AU - Schultz, Andre

AU - Engquist, Erik

AU - Liu, Li

AU - Lin, Xihui

AU - Chen, Gregory M.

AU - Xie, Honglei

AU - Hunter, Geoffrey A M

AU - Boutros, Paul C.

AU - Stepanov, Oleg

AU - Norman, Thea

AU - Friend, Stephen H.

AU - Stolovitzky, Gustavo

AU - Kornblau, Steven

AU - Qutub, Amina A.

PY - 2016/6/1

Y1 - 2016/6/1

N2 - Acute Myeloid Leukemia (AML) is a fatal hematological cancer. The genetic abnormalities underlying AML are extremely heterogeneous among patients, making prognosis and treatment selection very difficult. While clinical proteomics data has the potential to improve prognosis accuracy, thus far, the quantitative means to do so have yet to be developed. Here we report the results and insights gained from the DREAM 9 Acute Myeloid Prediction Outcome Prediction Challenge (AML-OPC), a crowdsourcing effort designed to promote the development of quantitative methods for AML prognosis prediction. We identify the most accurate and robust models in predicting patient response to therapy, remission duration, and overall survival. We further investigate patient response to therapy, a clinically actionable prediction, and find that patients that are classified as resistant to therapy are harder to predict than responsive patients across the 31 models submitted to the challenge. The top two performing models, which held a high sensitivity to these patients, substantially utilized the proteomics data to make predictions. Using these models, we also identify which signaling proteins were useful in predicting patient therapeutic response.

AB - Acute Myeloid Leukemia (AML) is a fatal hematological cancer. The genetic abnormalities underlying AML are extremely heterogeneous among patients, making prognosis and treatment selection very difficult. While clinical proteomics data has the potential to improve prognosis accuracy, thus far, the quantitative means to do so have yet to be developed. Here we report the results and insights gained from the DREAM 9 Acute Myeloid Prediction Outcome Prediction Challenge (AML-OPC), a crowdsourcing effort designed to promote the development of quantitative methods for AML prognosis prediction. We identify the most accurate and robust models in predicting patient response to therapy, remission duration, and overall survival. We further investigate patient response to therapy, a clinically actionable prediction, and find that patients that are classified as resistant to therapy are harder to predict than responsive patients across the 31 models submitted to the challenge. The top two performing models, which held a high sensitivity to these patients, substantially utilized the proteomics data to make predictions. Using these models, we also identify which signaling proteins were useful in predicting patient therapeutic response.

UR - http://www.scopus.com/inward/record.url?scp=84978888838&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84978888838&partnerID=8YFLogxK

U2 - 10.1371/journal.pcbi.1004890

DO - 10.1371/journal.pcbi.1004890

M3 - Article

C2 - 27351836

AN - SCOPUS:84978888838

VL - 12

JO - PLoS Computational Biology

JF - PLoS Computational Biology

SN - 1553-734X

IS - 6

M1 - e1004890

ER -