Replicability of the EC-Earth3 Earth system model under a change in computing environment
<p>Most Earth system models (ESMs) are running under different high-performance computing (HPC) environments. This has several advantages, from allowing different groups to work with the same tool in parallel to leveraging the burden of ensemble climate simulations, but it also offers alternat...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2020-03-01
|
| Series: | Geoscientific Model Development |
| Online Access: | https://www.geosci-model-dev.net/13/1165/2020/gmd-13-1165-2020.pdf |
| Summary: | <p>Most Earth system models (ESMs) are running under different high-performance computing (HPC) environments. This has several advantages, from
allowing different groups to work with the same tool in parallel to leveraging the burden of ensemble climate simulations, but it also offers
alternative solutions in the case of shutdown (expected or not) of any of the environments. However, for obvious scientific reasons, it is critical to
ensure that ESMs provide identical results under changes in computing environment. While strict bit-for-bit reproducibility is not always guaranteed
with ESMs, it is desirable that results obtained under one computing environment are at least statistically indistinguishable from those obtained
under another environment, which we term a “replicability” condition following the metrology nomenclature. Here, we develop a protocol to assess
the replicability of the EC-Earth ESM. Using two versions of EC-Earth, we present one case of non-replicability and one case of replicability. The
non-replicable case occurs with the older version of the model and likely finds its origin in the treatment of river runoff along Antarctic
coasts. By contrast, the more recent version of the model provides replicable results. The methodology presented here has been adopted as a standard
test by the EC-Earth consortium (27 institutions in Europe) to evaluate the replicability of any new model version across platforms, including for
CMIP6 experiments. To a larger extent, it can be used to assess whether other ESMs can safely be ported from one HPC environment to another for
studying climate-related questions. Our results and experience with this work suggest that the default assumption should be that ESMs are not
replicable under changes in the HPC environment, until proven otherwise.</p> |
|---|---|
| ISSN: | 1991-959X 1991-9603 |