A framework for characterising and evaluating the effectiveness of environmental modelling

Serena H. Hamilton, Baihua Fu, Joseph H.A. Guillaume, Jennifer Badham, Sondoss Elsawah, Patricia Gober, Randall J. Hunt, Takuya Iwanaga, Anthony J. Jakeman, Daniel P. Ames, Allan Curtis, Mary C. Hill, Suzanne A. Pierce, Fateme Zare

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.

Original languageEnglish (US)
Pages (from-to)83-98
Number of pages16
JournalEnvironmental Modelling and Software
Volume118
DOIs
StatePublished - Aug 1 2019

Fingerprint

environmental modeling
accessibility
modeling
evaluation

Keywords

  • Model assessment
  • Model evaluation
  • Model performance

ASJC Scopus subject areas

  • Software
  • Environmental Engineering
  • Ecological Modeling

Cite this

Hamilton, S. H., Fu, B., Guillaume, J. H. A., Badham, J., Elsawah, S., Gober, P., ... Zare, F. (2019). A framework for characterising and evaluating the effectiveness of environmental modelling. Environmental Modelling and Software, 118, 83-98. https://doi.org/10.1016/j.envsoft.2019.04.008

A framework for characterising and evaluating the effectiveness of environmental modelling. / Hamilton, Serena H.; Fu, Baihua; Guillaume, Joseph H.A.; Badham, Jennifer; Elsawah, Sondoss; Gober, Patricia; Hunt, Randall J.; Iwanaga, Takuya; Jakeman, Anthony J.; Ames, Daniel P.; Curtis, Allan; Hill, Mary C.; Pierce, Suzanne A.; Zare, Fateme.

In: Environmental Modelling and Software, Vol. 118, 01.08.2019, p. 83-98.

Research output: Contribution to journalArticle

Hamilton, SH, Fu, B, Guillaume, JHA, Badham, J, Elsawah, S, Gober, P, Hunt, RJ, Iwanaga, T, Jakeman, AJ, Ames, DP, Curtis, A, Hill, MC, Pierce, SA & Zare, F 2019, 'A framework for characterising and evaluating the effectiveness of environmental modelling', Environmental Modelling and Software, vol. 118, pp. 83-98. https://doi.org/10.1016/j.envsoft.2019.04.008
Hamilton, Serena H. ; Fu, Baihua ; Guillaume, Joseph H.A. ; Badham, Jennifer ; Elsawah, Sondoss ; Gober, Patricia ; Hunt, Randall J. ; Iwanaga, Takuya ; Jakeman, Anthony J. ; Ames, Daniel P. ; Curtis, Allan ; Hill, Mary C. ; Pierce, Suzanne A. ; Zare, Fateme. / A framework for characterising and evaluating the effectiveness of environmental modelling. In: Environmental Modelling and Software. 2019 ; Vol. 118. pp. 83-98.
@article{8767932d7fc244d6a657e4eb6f9a16ea,
title = "A framework for characterising and evaluating the effectiveness of environmental modelling",
abstract = "Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.",
keywords = "Model assessment, Model evaluation, Model performance",
author = "Hamilton, {Serena H.} and Baihua Fu and Guillaume, {Joseph H.A.} and Jennifer Badham and Sondoss Elsawah and Patricia Gober and Hunt, {Randall J.} and Takuya Iwanaga and Jakeman, {Anthony J.} and Ames, {Daniel P.} and Allan Curtis and Hill, {Mary C.} and Pierce, {Suzanne A.} and Fateme Zare",
year = "2019",
month = "8",
day = "1",
doi = "10.1016/j.envsoft.2019.04.008",
language = "English (US)",
volume = "118",
pages = "83--98",
journal = "Environmental Modelling and Software",
issn = "1364-8152",
publisher = "Elsevier BV",

}

TY - JOUR

T1 - A framework for characterising and evaluating the effectiveness of environmental modelling

AU - Hamilton, Serena H.

AU - Fu, Baihua

AU - Guillaume, Joseph H.A.

AU - Badham, Jennifer

AU - Elsawah, Sondoss

AU - Gober, Patricia

AU - Hunt, Randall J.

AU - Iwanaga, Takuya

AU - Jakeman, Anthony J.

AU - Ames, Daniel P.

AU - Curtis, Allan

AU - Hill, Mary C.

AU - Pierce, Suzanne A.

AU - Zare, Fateme

PY - 2019/8/1

Y1 - 2019/8/1

N2 - Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.

AB - Environmental modelling is transitioning from the traditional paradigm that focuses on the model and its quantitative performance to a more holistic paradigm that recognises successful model-based outcomes are closely tied to undertaking modelling as a social process, not just as a technical procedure. This paper redefines evaluation as a multi-dimensional and multi-perspective concept, and proposes a more complete framework for identifying and measuring the effectiveness of modelling that serves the new paradigm. Under this framework, evaluation considers a broader set of success criteria, and emphasises the importance of contextual factors in determining the relevance and outcome of the criteria. These evaluation criteria are grouped into eight categories: project efficiency, model accessibility, credibility, saliency, legitimacy, satisfaction, application, and impact. Evaluation should be part of an iterative and adaptive process that attempts to improve model-based outcomes and foster pathways to better futures.

KW - Model assessment

KW - Model evaluation

KW - Model performance

UR - http://www.scopus.com/inward/record.url?scp=85064906457&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064906457&partnerID=8YFLogxK

U2 - 10.1016/j.envsoft.2019.04.008

DO - 10.1016/j.envsoft.2019.04.008

M3 - Article

VL - 118

SP - 83

EP - 98

JO - Environmental Modelling and Software

JF - Environmental Modelling and Software

SN - 1364-8152

ER -