Verification against perturbed analyses and observations

It has long been known that verification of a forecast against the sequence of analyses used to produce those forecasts can under-estimate the magnitude of forecast errors. Here we show that under certain conditions the verification of a short-range forecast against a perturbed analysis coming from...

Full description

Bibliographic Details
Main Authors: N. E. Bowler, M. J. P. Cullen, C. Piccolo
Format: Article
Language:English
Published: Copernicus Publications 2015-07-01
Series:Nonlinear Processes in Geophysics
Online Access:http://www.nonlin-processes-geophys.net/22/403/2015/npg-22-403-2015.pdf
id doaj-63b2d054b13f43c5ab89ec72e332c0c8
record_format Article
spelling doaj-63b2d054b13f43c5ab89ec72e332c0c82020-11-25T01:23:52ZengCopernicus PublicationsNonlinear Processes in Geophysics1023-58091607-79462015-07-0122440341110.5194/npg-22-403-2015Verification against perturbed analyses and observationsN. E. Bowler0M. J. P. Cullen1C. Piccolo2Met Office, Fitzroy Road, Exeter, EX1 3PB, UKMet Office, Fitzroy Road, Exeter, EX1 3PB, UKMet Office, Fitzroy Road, Exeter, EX1 3PB, UKIt has long been known that verification of a forecast against the sequence of analyses used to produce those forecasts can under-estimate the magnitude of forecast errors. Here we show that under certain conditions the verification of a short-range forecast against a perturbed analysis coming from an ensemble data assimilation scheme can give the same root-mean-square error as verification against the truth. This means that a perturbed analysis can be used as a reliable proxy for the truth. However, the conditions required for this result to hold are rather restrictive: the analysis must be optimal, the ensemble spread must be equal to the error in the mean, the ensemble size must be large and the forecast being verified must be the background forecast used in the data assimilation. Although these criteria are unlikely to be met exactly it becomes clear that for most cases verification against a perturbed analysis gives better results than verification against an unperturbed analysis. <br><br> We demonstrate the application of these results in a idealised model framework and a numerical weather prediction context. In deriving this result we recall that an optimal (Kalman) analysis is one for which the analysis increments are uncorrelated with the analysis errors.http://www.nonlin-processes-geophys.net/22/403/2015/npg-22-403-2015.pdf
collection DOAJ
language English
format Article
sources DOAJ
author N. E. Bowler
M. J. P. Cullen
C. Piccolo
spellingShingle N. E. Bowler
M. J. P. Cullen
C. Piccolo
Verification against perturbed analyses and observations
Nonlinear Processes in Geophysics
author_facet N. E. Bowler
M. J. P. Cullen
C. Piccolo
author_sort N. E. Bowler
title Verification against perturbed analyses and observations
title_short Verification against perturbed analyses and observations
title_full Verification against perturbed analyses and observations
title_fullStr Verification against perturbed analyses and observations
title_full_unstemmed Verification against perturbed analyses and observations
title_sort verification against perturbed analyses and observations
publisher Copernicus Publications
series Nonlinear Processes in Geophysics
issn 1023-5809
1607-7946
publishDate 2015-07-01
description It has long been known that verification of a forecast against the sequence of analyses used to produce those forecasts can under-estimate the magnitude of forecast errors. Here we show that under certain conditions the verification of a short-range forecast against a perturbed analysis coming from an ensemble data assimilation scheme can give the same root-mean-square error as verification against the truth. This means that a perturbed analysis can be used as a reliable proxy for the truth. However, the conditions required for this result to hold are rather restrictive: the analysis must be optimal, the ensemble spread must be equal to the error in the mean, the ensemble size must be large and the forecast being verified must be the background forecast used in the data assimilation. Although these criteria are unlikely to be met exactly it becomes clear that for most cases verification against a perturbed analysis gives better results than verification against an unperturbed analysis. <br><br> We demonstrate the application of these results in a idealised model framework and a numerical weather prediction context. In deriving this result we recall that an optimal (Kalman) analysis is one for which the analysis increments are uncorrelated with the analysis errors.
url http://www.nonlin-processes-geophys.net/22/403/2015/npg-22-403-2015.pdf
work_keys_str_mv AT nebowler verificationagainstperturbedanalysesandobservations
AT mjpcullen verificationagainstperturbedanalysesandobservations
AT cpiccolo verificationagainstperturbedanalysesandobservations
_version_ 1725120152155979776