Skip to main content
Have a personal or library account? Click to login
Estimating correlated observation error statistics using an ensemble transform Kalman filter Cover

Estimating correlated observation error statistics using an ensemble transform Kalman filter

Open Access
|Dec 2014

References

  1. Anderson J. L . An ensemble adjustment Kalman filter for data assimilation. Mon. Weather Rev. 2001; 129: 28842903.
  2. Bannister R. N . A review of forecast error covariance statistics in atmospheric variational data assimilation. I: characteristics and measurements of forecast error covariances. Q. J. Roy. Meteorol. Soc. 2008; 134: 19511970.
  3. Bickel P. J. , Levina E . Regularized estimation of large covariance matrices. Ann. Stat. 2008; 36: 199227.
  4. Bishop C. , Etherton B. , Majumdar S . Adaptive sampling with the ensemble transform Kalman filter. Part I: theoretical aspects. Mon. Weather Rev. 2001; 129: 420436.
  5. Bishop C. H. , Hodyss D . Ensemble covariances adaptively localized with ECO-RAP. Part 1: tests on simple error models. Tellus A. 2009; 61: 8496.
  6. Bormann N. , Bauer P . Estimates of spatial and interchannel observation-error characteristics for current sounder radiances for numerical weather prediction. I: methods and application to ATOVS data. Q. J. Roy. Meteorol. Soc. 2010; 136: 10361050.
  7. Bormann N. , Collard A. , Bauer P . Estimates of spatial and interchannel observation-error characteristics for current sounder radiances for numerical weather prediction. II: application to AIRS and IASI data. Q. J. Roy. Meteorol. Soc. 2010; 136: 10511063.
  8. Bormann N. , Saariene S. , Kelly G. , Thepaut J . The spatial structure of observation errors in atmospheric motion vectors from geostationary satellite data. Mon. Weather Rev. 2002; 131: 706718.
  9. Buehner M . Lahoz W. , Khattatov B. , Mènard R . Error statistics in data assimilation: estimation and modelling. Data Assimilation Making Sense of Observations .
  10. Buehner M. , Houtekamer P. , Charette C. , Mitchell H. , He B . Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: one-month experiments with real observations. Mon. Weather Rev. 2010; 138: 15671586.
  11. Clayton A. M. , Lorenc A. C. , Barker D. M . Operational implementation of a hybrid ensemble/4D-Var global data assimilation system at the Met Office. Q. J. Roy. Meteorol. Soc. 2013; 139(675): 14451461.
  12. Cox S. M. , Matthews P. C . Exponential time differencing for stiff systems. J. Comput. Phys. 2000; 176: 430455.
  13. Daley R . Atmospheric Data Analysis. 1991; Cambridge: Cambridge University Press.
  14. Desroziers G. , Berre L. , Chapnik B . Objective validation of data assimilation systems: diagnosing sub-optimality. Proceedings of ECMWF Workshop on Diagnostics of Data Assimilation System Performance. 2009; 1517. June 2009.
  15. Desroziers G. , Berre L. , Chapnik B. , Poli P . Diagnosis of observation, background and analysis-error statistics in observation space. Q. J. Roy. Meteorol. Soc. 2005; 131: 33853396.
  16. Dormand J. , Prince P . A family of embedded Runge-Kutta formulae. J. Comput. Appl. Math. 1980; 6: 1926.
  17. Eguíluz V. M. , Alstrøm P. , Hernández-García E. , Piro O . Average patterns of spatiotemporal chaos: a boundary effect. Phys. Rev. E. 1999; 59: 28222825.
  18. Evensen G . The ensemble Kalman filter: theoretical formulation and practical implementation. Ocean Dyn. 2003; 53: 343367.
  19. Fertig E. J. , Harlim J. , Hunt B. R . A comparative study of 4D-VAR and a 4D ensemble Kalman filter: perfect model simulations with Lorenz-96. Tellus A. 2007; 59: 96100.
  20. Golub G. H. , Van Loan C. F . Matrix Computations. 1996; Baltimore: The Johns Hopkins University Press. 3rd ed.
  21. Gustafsson J. , Protas B . Regularization of the backward-in-time Kuramoto-Sivashinsky equation. J. Comput. Appl. Math. 2010; 234: 398406.
  22. Hamill T. M . Interpretation of rank histograms for verifying ensemble forecasts. Mon. Weather Rev. 2000; 129: 550560.
  23. Hamill T. M. , Whitaker J. S. , Snyder C . Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Weather Rev. 2001; 129: 27762790.
  24. Healy S. B. , White A. A . Use of discrete Fourier transforms in the 1D-Var retrieval problem. Q. J. Roy. Meteorol. Soc. 2005; 131: 6372.
  25. Hilton F. , Atkinson N. C. , English S. J. , Eyre J. R . Assimilation of IASI at the Met Office and assessment of its impact through observing system experiments. Q. J. Roy. Meteorol. Soc. 2009; 135: 495505.
  26. Hollingsworth A. , Lönnberg P . The statistical structure of short-range forecast errors as determined from radiosonde data. Part I: the wind field. Tellus A. 1986; 38: 111136.
  27. Houtekamer P. L. , Mitchell H. L . Ensemble Kalman filtering. Q. J. Roy. Meteorol. Soc. 2005; 133: 32603289.
  28. Janjic T. , Cohn S. E . Treatment of observation error due to unresolved scales in atmospheric data assimilation. Mon. Weather Rev. 2006; 134: 29002915.
  29. Jardak M. , Navon I. M. , Zupanski M . Comparison of sequential data assimilation methods for the Kuramoto-Sivashinsky equation. Int. J. Numer. Meth. Fluid. 2010; 62: 374402.
  30. Kassam A. , Trefethen L . Fourth-order time-stepping for stiff PDEs. SIAM J. Sci. Computing. 2005; 25: 12141233.
  31. Kuramoto Y . Diffusion-induced chaos in reaction systems. Prog. Theor. Phys. 1978; 64: 346367.
  32. Li H. , Kalnay E. , Miyoshi T . Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter. Q. J. Roy. Meteorol. Soc. 2009; 128: 13671386.
  33. Livings D. M. , Dance S. L. , Nichols N. K . Unbiased ensemble square root filters. Phys. D. 2008; 237: 10211028.
  34. Lorenz E . Predictability: a problem partly solved. Predictability. Proceedings of the 1995. ECMWF Seminar. 1996; 118.
  35. Lorenz E. , Emanuel K . Optimal sites for supplementary weather observations: simulations with a small model. J. Atmos. Sci. 1998; 55: 399414.
  36. Mènard R. , Yang Y. , Rochon Y . Convergence and stability of estimated error variances derived from assimilation residuals in observation space. Proceedings of ECMWF Workshop on Diagnostics of Data Assimilation System Performance. 2009; 1517. June 2009.
  37. Miyoshi T. , Kalnay E. , Li H . Estimating and including observation-error correlations in data assimilation. Inverse Probl. Sci. Eng. 2013; 21: 387398.
  38. Miyoshi T. , Sato Y. , Kadowaki T . Ensemble Kalman filter and 4D-Var intercomparison with the Japanese operational global analysis and prediction system. Mon. Weather Rev. 2010; 138: 28462866.
  39. Ott E. , Hunt B. , Szunyogh I. , Zimin A. , Kostelich E. , co-authors . A local ensemble Kalman filter for atmospheric data assimilation. Tellus A. 2004; 56: 415428.
  40. Protas B . Adjoint-based optimization of PDE systems with alternative gradients. J. Comput. Phys. 2008; 227: 64906510.
  41. Sivashinsky G . Non-linear analysis of hydrodynamic instability in laminar flames. Acta Astronautica. 1977; 4: 11771206.
  42. Stewart L. M. PhD Thesis, University of Reading. Correlated Observation Errors in Data Assimilation. 2010. Online at: http://www.reading.ac.uk/maths-and-stats/research/theses/maths-phdtheses.aspx.
  43. Stewart L. M., Cameron J., Dance S. L., English S., Eyre J. R., co-authors. Technical report, University of Reading. Mathematics reports series. Observation Error Correlations in IASI Radiance Data. 2009. Online at: http://www.reading.ac.uk/web/FILES/maths/obs_error_IASI_radiance.pdf.
  44. Stewart L. M. , Dance S. L. , Nichols N. K . Correlated observation errors in data assimilation. Int. J. Numer. Meth. Fluid. 2008; 56: 15211527.
  45. Stewart L. M. , Dance S. L. , Nichols N. K . Data assimilation with correlated observation errors: experiments with a 1-D shallow water model. Tellus A. 2013; 65: 19546.
  46. Stewart L. M. , Dance S. L. , Nichols N. K. , Eyre J. R. , Cameron J . Estimating interchannel observation-error correlations for IASI radiance data in the Met Office system. Q. J. Roy. Meteorol. Soc. 2014; 140: 12361244.
  47. Thiebaux H . Anisotropic correlation functions for objective analysis. Mon. Weather Rev. 1976; 104: 9941002.
  48. Waller J. A. PhD Thesis, Department of Mathematics and Statistics, University of Reading. Using Observations at Different Spatial Scales in Data Assimilation for Environmental Prediction. 2013. Online at: http://www.reading.ac.uk/maths-and-stats/research/theses/maths-phdtheses.aspx.
  49. Waller J. A. , Dance S. L. , Lawless A. S. , Nichols N. K. , Eyre J. R . Representativity error for temperature and humidity using the Met Office high-resolution model. Q. J. Roy. Meteorol. Soc. 2014; 140: 11891197.
  50. Weston P . Technical report, Met Office, UK. Progress Towards the Implementation of Correlated Observation Errors in 4D-Var. 2011. Forecasting Research Technical Report 560.
  51. Weston P. P. , Bell W. , Eyre J. R . Accounting for correlated error in the assimilation of high resolution sounder data. Q. J. Roy. Meteorol. Soc. 2014. Early View.
  52. Whitaker J. S. , Hamill T. M. , Wei X. , Song Y. , Toth Z . Ensemble data assimilation with the NCEP global forecast system. Mon. Weather Rev. 2008; 136: 463482.
  53. Wilks D. S . Statistical Methods in the Atmospheric Sciences. 1995; San Diego: Academic Press.
Language: English
Page range: 23294 - 23294
Submitted on: Nov 7, 2013
Accepted on: Jul 15, 2014
Published on: Dec 1, 2014
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services

© 2014 Joanne A. Waller, Sarah L. Dance, Amos S. Lawless, Nancy K. Nichols, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.