Collaborative infrastructure for test-driven scientific model validation

Cyrus Omar, Jonathan Aldrich, Richard Gerkin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

One of the pillars of the modern scientific method is model validation: comparing a scientific model's predictions against empirical observations. Today, a scientist demonstrates the validity of a model by making an argument in a paper and submitting it for peer review, a process comparable to code review in software engineering. While human review helps to ensure that contributions meet high-level goals, software engineers typically supplement it with unit testing to get a more complete picture of the status of a project. We argue that a similar test-driven methodology would be valuable to scientific communities as they seek to validate increasingly complex models against growing repositories of empirical data. Scientific communities differ from software communities in several key ways, however. In this paper, we introduce SciUnit, a framework for test-driven scientific model validation, and outline how, supported by new and existing collaborative infrastructure, it could integrate into the modern scientific process.

Original languageEnglish (US)
Title of host publication36th International Conference on Software Engineering, ICSE Companion 2014 - Proceedings
PublisherAssociation for Computing Machinery
Pages524-527
Number of pages4
ISBN (Print)9781450327688
DOIs
StatePublished - Jan 1 2014
Event36th International Conference on Software Engineering, ICSE 2014 - Hyderabad, India
Duration: May 31 2014Jun 7 2014

Publication series

Name36th International Conference on Software Engineering, ICSE Companion 2014 - Proceedings

Other

Other36th International Conference on Software Engineering, ICSE 2014
CountryIndia
CityHyderabad
Period5/31/146/7/14

Keywords

  • Cyberinfrastructure
  • Model validation
  • Unit testing

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Collaborative infrastructure for test-driven scientific model validation'. Together they form a unique fingerprint.

  • Cite this

    Omar, C., Aldrich, J., & Gerkin, R. (2014). Collaborative infrastructure for test-driven scientific model validation. In 36th International Conference on Software Engineering, ICSE Companion 2014 - Proceedings (pp. 524-527). (36th International Conference on Software Engineering, ICSE Companion 2014 - Proceedings). Association for Computing Machinery. https://doi.org/10.1145/2591062.2591129