A new verification method to ensure consistent ensemble forecasts through calibrated precipitation downscaling models

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

A new verification method is proposed to test the consistency of ensemble high-resolution precipitation fields forecasted by calibrated downscaling models. The method is based on a generalization of the verification rank histogram and tests the exceedance probability of a fixed precipitation threshold calculated from the observed or ensemble fields. A graphical tool that accounts for random assignments of the rank is proposed to provide guidance in histogram interpretation and to avoid a possible misunderstanding of model deficiencies. The verification method is applied on three numerical experiments carried out in controlled conditions using the space-time rainfall (STRAIN) downscaling model with the aims of investigating (i) the effect of sampling variability on parameter estimation from the observed fields and (ii) model performance when calibration relations between the parameter and a coarse meteorological observable are used to interpret events arising from one or more physical conditions. Results show that (i) ensemble members generated using the parameters estimated on the observed event are overdispersed; (ii) the adoption of a single calibration relation can lead to the generation of consistent ensemble members; and (iii) when a single calibration relation is not able to explain observed event variability, storm-specific calibration relations should be adopted to return consistent forecasts.

Original languageEnglish (US)
Pages (from-to)3374-3391
Number of pages18
JournalMonthly Weather Review
Volume136
Issue number9
DOIs
StatePublished - Sep 2008
Externally publishedYes

Fingerprint

downscaling
calibration
histogram
rainfall
method
forecast
sampling
experiment
parameter
test

ASJC Scopus subject areas

  • Atmospheric Science

Cite this

A new verification method to ensure consistent ensemble forecasts through calibrated precipitation downscaling models. / Mascaro, Giuseppe; Deidda, Roberto; Vivoni, Enrique.

In: Monthly Weather Review, Vol. 136, No. 9, 09.2008, p. 3374-3391.

Research output: Contribution to journalArticle

@article{798ec5fcce5f48d7b4e3b7da5c868bcb,
title = "A new verification method to ensure consistent ensemble forecasts through calibrated precipitation downscaling models",
abstract = "A new verification method is proposed to test the consistency of ensemble high-resolution precipitation fields forecasted by calibrated downscaling models. The method is based on a generalization of the verification rank histogram and tests the exceedance probability of a fixed precipitation threshold calculated from the observed or ensemble fields. A graphical tool that accounts for random assignments of the rank is proposed to provide guidance in histogram interpretation and to avoid a possible misunderstanding of model deficiencies. The verification method is applied on three numerical experiments carried out in controlled conditions using the space-time rainfall (STRAIN) downscaling model with the aims of investigating (i) the effect of sampling variability on parameter estimation from the observed fields and (ii) model performance when calibration relations between the parameter and a coarse meteorological observable are used to interpret events arising from one or more physical conditions. Results show that (i) ensemble members generated using the parameters estimated on the observed event are overdispersed; (ii) the adoption of a single calibration relation can lead to the generation of consistent ensemble members; and (iii) when a single calibration relation is not able to explain observed event variability, storm-specific calibration relations should be adopted to return consistent forecasts.",
author = "Giuseppe Mascaro and Roberto Deidda and Enrique Vivoni",
year = "2008",
month = "9",
doi = "10.1175/2008MWR2339.1",
language = "English (US)",
volume = "136",
pages = "3374--3391",
journal = "Monthly Weather Review",
issn = "0027-0644",
publisher = "American Meteorological Society",
number = "9",

}

TY - JOUR

T1 - A new verification method to ensure consistent ensemble forecasts through calibrated precipitation downscaling models

AU - Mascaro, Giuseppe

AU - Deidda, Roberto

AU - Vivoni, Enrique

PY - 2008/9

Y1 - 2008/9

N2 - A new verification method is proposed to test the consistency of ensemble high-resolution precipitation fields forecasted by calibrated downscaling models. The method is based on a generalization of the verification rank histogram and tests the exceedance probability of a fixed precipitation threshold calculated from the observed or ensemble fields. A graphical tool that accounts for random assignments of the rank is proposed to provide guidance in histogram interpretation and to avoid a possible misunderstanding of model deficiencies. The verification method is applied on three numerical experiments carried out in controlled conditions using the space-time rainfall (STRAIN) downscaling model with the aims of investigating (i) the effect of sampling variability on parameter estimation from the observed fields and (ii) model performance when calibration relations between the parameter and a coarse meteorological observable are used to interpret events arising from one or more physical conditions. Results show that (i) ensemble members generated using the parameters estimated on the observed event are overdispersed; (ii) the adoption of a single calibration relation can lead to the generation of consistent ensemble members; and (iii) when a single calibration relation is not able to explain observed event variability, storm-specific calibration relations should be adopted to return consistent forecasts.

AB - A new verification method is proposed to test the consistency of ensemble high-resolution precipitation fields forecasted by calibrated downscaling models. The method is based on a generalization of the verification rank histogram and tests the exceedance probability of a fixed precipitation threshold calculated from the observed or ensemble fields. A graphical tool that accounts for random assignments of the rank is proposed to provide guidance in histogram interpretation and to avoid a possible misunderstanding of model deficiencies. The verification method is applied on three numerical experiments carried out in controlled conditions using the space-time rainfall (STRAIN) downscaling model with the aims of investigating (i) the effect of sampling variability on parameter estimation from the observed fields and (ii) model performance when calibration relations between the parameter and a coarse meteorological observable are used to interpret events arising from one or more physical conditions. Results show that (i) ensemble members generated using the parameters estimated on the observed event are overdispersed; (ii) the adoption of a single calibration relation can lead to the generation of consistent ensemble members; and (iii) when a single calibration relation is not able to explain observed event variability, storm-specific calibration relations should be adopted to return consistent forecasts.

UR - http://www.scopus.com/inward/record.url?scp=53649106670&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=53649106670&partnerID=8YFLogxK

U2 - 10.1175/2008MWR2339.1

DO - 10.1175/2008MWR2339.1

M3 - Article

AN - SCOPUS:53649106670

VL - 136

SP - 3374

EP - 3391

JO - Monthly Weather Review

JF - Monthly Weather Review

SN - 0027-0644

IS - 9

ER -