Learning from the past: Approaches for reproducibility in computational neuroscience

Sharon Crook, Andrew P. Davison, Hans E. Plesser

Research output: Chapter in Book/Report/Conference proceedingChapter

24 Scopus citations

Abstract

Reproducible experiments are the cornerstone of science: Only observations that can be independently confirmed enter the body of scientific knowledge. Computational science should excel in reproducibility, as simulations on digital computers avoid many of the small variations that are beyond the control of the experimental biologist or physicist. However, in reality, computational science has its own challenges for reproducibility: Many computational scientists find it difficult to reproduce results published in the literature, and many authors have met problems replicating even the figures in their own papers. We present a distinction between different levels of replicability and reproducibility of findings in computational neuroscience. We also demonstrate that simulations of neural models can be highly sensitive to numerical details, and conclude that often it is futile to expect exact replicability of simulation results across simulator software packages. Thus, the computational neuroscience community needs to discuss how to define successful reproduction of simulation studies. Any investigation of failures to reproduce published results will benefit significantly from the ability to track the provenance of the original results. We present tools and best practices developed over the past 2 decades that facilitate provenance tracking and model sharing.

Original languageEnglish (US)
Title of host publication20 Years of Computational Neuroscience
PublisherSpringer New York
Pages73-102
Number of pages30
ISBN (Electronic)9781461414247
ISBN (Print)9781461414230
DOIs
StatePublished - Jan 1 2013

ASJC Scopus subject areas

  • Medicine(all)
  • Neuroscience(all)

Fingerprint Dive into the research topics of 'Learning from the past: Approaches for reproducibility in computational neuroscience'. Together they form a unique fingerprint.

  • Cite this

    Crook, S., Davison, A. P., & Plesser, H. E. (2013). Learning from the past: Approaches for reproducibility in computational neuroscience. In 20 Years of Computational Neuroscience (pp. 73-102). Springer New York. https://doi.org/10.1007/978-1-4614-1424-7_4