On the use of a Huber norm for observation quality control in the ECMWF 4D-Var

Autor(en)
Christina Tavolato, Lars Isaksen
Abstrakt

This article describes a number of important aspects that need to be considered when designing and implementing an observation quality control scheme in an NWP data assimilation system. It is shown how careful evaluation of innovation statistics provides valuable knowledge about the observation errors and help in the selection of a suitable observation error model. The focus of the article is on the statistical specification of the typical fat tails of the innovation distributions. In observation error specifications, like the one used previously at ECMWF, it is common to assume outliers to represent gross errors that are independent of the atmospheric state. The investigations in this article show that this is not a good assumption for almost all observing systems used in today's data assimilation systems. It is found that a Huber norm distribution is a very suitable distribution to describe most innovation statistics, after discarding systematically erroneous observations. The Huber norm is a robust method, making it safer to include outlier observations in the analysis step. Therefore the background quality control can safely be relaxed. The Huber norm has been implemented in the ECMWF assimilation system for in situ observations. The design, implementation and results from this implementation are described in this article. The general impact of using the Huber norm distribution is positive, compared to the previously used variational quality control method which gave virtually no weight to outliers. Case-studies show how the method improves the use of observations, especially for intense cyclones and other extreme events. It is also discussed how the Huber norm distribution can be used to identify systematic problems with observing systems.

Organisation(en)
Institut für Meteorologie und Geophysik
Externe Organisation(en)
European Centre for Medium-Range Weather Forecasts (ECMWF)
Journal
Quarterly Journal of the Royal Meteorological Society
Band
141
Seiten
1514-1527
Anzahl der Seiten
14
ISSN
0035-9009
DOI
https://doi.org/10.1002/qj.2440
Publikationsdatum
07-2015
Peer-reviewed
Ja
ÖFOS 2012
105206 Meteorologie
Schlagwörter
ASJC Scopus Sachgebiete
Atmospheric Science
Link zum Portal
https://ucrisportal.univie.ac.at/de/publications/on-the-use-of-a-huber-norm-for-observation-quality-control-in-the-ecmwf-4dvar(1ecd2efd-e80f-4d78-a0c2-2ef0a9e3c098).html