Skip to main content
Have a personal or library account? Click to login
Variational data assimilation via sparse regularisation Cover

Variational data assimilation via sparse regularisation

Open Access
|Dec 2014

References

  1. Afshar A , Marino M. A . Model for simulating soil-water content considering evapotranspiration. J. Hydrol. 1978; 37: 309322.
  2. Anderson J. L . An ensemble adjustment Kalman Filter for data assimilation. Mon. Weather Rev. 2001; 129: 28842903.
  3. Bai Z , Demmel J , Dongarra J , Ruhe A , Van Der Vorst H . Templates for the Solution of Algebraic Eigenvalue Problems: A Practical Guide. 1987; 11 Philadelphia: SIAM.
  4. Barnard J , McCulloch R , Meng X . Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage. Stat. Sin. 2000; 10: 12811312.
  5. Bennett A. F , McIntosh P. C . Open ocean modeling as an inverse problem: tidal theory. J. Phys. Oceanogr. 1982; 12: 10041018.
  6. Bertsekas D . On the Goldstein-Levitin-Polyak gradient projection method. IEEE Trans. Automat. Contr. 1976; 21: 174184.
  7. Bertsekas D. P . Nonlinear Programming. 1999; Belmont, MA: Athena Scientific. 794. 2nd ed.
  8. Boyd S , Vandenberghe L . Convex Optimization. 2004; New York: Cambridge University Press. 716.
  9. Budd C , Freitag M , Nichols N . Regularization techniques for ill-posed inverse problems in data assimilation. Comput. Fluids. 2011; 46: 168173.
  10. Candes E , Tao T . Near-optimal signal recovery from random projections: universal encoding strategies?. IEEE Trans. Inform. Theor. 2006; 52: 54065425.
  11. Chan R. H.-F , Jin X.-Q . An Introduction to Iterative Toeplitz Solvers. 2007; Philadelphia: SIAM.
  12. Chapra S. C . Surface Water Quality Modeling. 2008; long grove, IL, USA: Waveland Press, Inc..
  13. Chen S , Donoho D , Saunders M . Atomic decomposition by basis pursuit. SIAM Rev. 2001; 43: 129159.
  14. Chen S. S , Donoho D , Saunders M . Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 1998; 20: 3361.
  15. Courtier P , Talagrand O . Variational assimilation of meteorological observations with the direct and adjoint shallow-water equations. Tellus A. 1990; 42: 531549.
  16. Courtier P , Thépaut J.-N , Hollingsworth A . A strategy for operational implementation of 4D-VAR, using an incremental approach. Q. J. Roy. Meteorol. Soc. 1994; 120: 13671387.
  17. Daley R . Atmospheric Data Analysis. 1993; New York, NY, USA: Cambridge University Press. 472.
  18. Durrett R . Essentials of Stochastic Processes. 1999; New York, NY, USA: Springer-Verlag, New York Inc..
  19. Ebtehaj A. M , Foufoula-Georgiou E . Statistics of precipitation reflectivity images and cascade of Gaussian-scale mixtures in the wavelet domain: a formalism for reproducing extremes and coherent multiscale structures. J. Geophys. Res. 2011; 116: D14110.
  20. Ebtehaj A. M , Foufoula-Georgiou E . On variational downscaling, fusion and assimilation of hydro-meteorological states: a unified framework via regularization. 2013; 49: 59445963.
  21. Ebtehaj A. M , Foufoula-Georgiou E , Lerman G . Sparse regularization for precipitation downscaling. J. Geophys. Res. 2012; 116: D22110.
  22. Elad M . Sparse and Redundant Representations: From Theory to Applications in Signal and Image Processing. 2010; New York, NY, USA: Springer-Verlag, New York Inc.. 376.
  23. Evensen G . Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 1994a; 99: 1014310162.
  24. Evensen G . Inverse methods and data assimilation in nonlinear ocean models. Physica D. 1994b; 77: 108129.
  25. Fetter C . Applied Hydrogeology. 1994; 4th ed, New Jersey: Prentice Hall.
  26. Figueiredo M , Nowak R , Wright S . Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE J. Sel. Topics Signal Process. 2007; 1: 586597.
  27. Freitag M. A , Nichols N. K , Budd C. J . L1-regularisation for ill-posed problems in variational data assimilation. PAMM. 2010; 10: 665668.
  28. Freitag M. A , Nichols N. K , Budd C. J . Resolution of sharp fronts in the presence of model error in variational data assimilation. Q. J. Roy. Meteorol. Soc. 2012; 139: 742757.
  29. Gaspari G , Cohn S. E . Construction of correlation functions in two and three dimensions. Q. J. Roy. Meteorol. Soc. 1999; 125: 723757.
  30. Ghil M . Meteorological data assimilation for oceanographers. Part I: description and theoretical framework. Dynam. Atmos. Oceans. 1989; 13: 171218.
  31. Ghil M , Cohn S , Tavantzis J , Bube K , Isaacson E , Bengtsson L , Ghil M , Källén E . Applications of estimation theory to numerical weather prediction. Dynamic Meteorology: Data Assimilation Methods, Applied Mathematical Sciences. 1981; New York: Springer. 139224. Vol. 36.
  32. Ghil M , Malanotte-Rizzoli P . Data Assimilation in Meteorology and Oceanography. 1991; B.V. Amsterdam, Netherlands: Elsevier Science. 141266.
  33. Golub G , Hansen P , O'Leary D . Tikhonov regularization and total least squares. SIAM J. Matrix Anal. Appl. 1999; 21: 185194.
  34. Hansen P . Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion. 1998; 4 Philadelphia: Society for Industrial Mathematics (SIAM).
  35. Hansen P . Discrete Inverse Problems: Insight and Algorithms Vol 7. 2010; Philadelphia, PA: Society for Industrial & Applied Mathematics (SIAM).
  36. Hansen P , O'Leary D . The use of the L-curve in the regularization of discrete ill-posed problems. SIAM J Sci Comput. 1993; 14: 14871503.
  37. Hansen P , Nagy J , O'Leary D . Deblurring Images: Matrices, Spectra, and Filtering Vol 3. 2006; Philadelphia, PA: Society for Industrial & Applied Mathematics (SIAM).
  38. Hawkins D. M . The problem of overfitting. J. Chem. Inf. Comput. Sci. 2004; 44: 112.
  39. Hu Z , Islam S . Prediction of ground surface temperature and soil moisture content by the force–restore method. Water Resour. Res. 1995; 31: 25312539.
  40. Ide K , Courtier P , Gill M , Lorenc A . Unified notation for data assimilation: operational, sequential, and variational. J. Met. Soc. Japan. 1997; 75: 181189.
  41. Jochum M , Murtugudde R . Temperature advection by tropical instability waves. J. Phys. Oceanogr. 2006; 36: 592605.
  42. Johnson C , Hoskins B. J , Nichols N. K . A singular vector perspective of 4D-Var: filtering and interpolation. Q. J. Roy. Meteorol. Soc. 2005a; 131: 119.
  43. Johnson C , Nichols N. K , Hoskins B. J . Very large inverse problems in atmosphere and ocean modelling. Int. J. Numer. Meth. Fluids. 2005b; 47: 759771.
  44. Kalnay E . Atmospheric Modeling, Data Assimilation, and Predictability. 2003; New York: Cambridge University Press. 341.
  45. Kim S.-J , Koh K , Lustig M , Boyd S , Gorinevsky D . An interior-point method for large-scale l1-regularized least squares. IEEE J. Sel. Topics Signal Process. 2007; 1: 606617.
  46. Kleist D. T , Parrish D. F , Derber J. C , Treadon R , Wu W. S , co-authors . Introduction of the GSI into the NCEP global data assimilation system. Weather. Forecast. 2009; 24: 16911705.
  47. Lanser D , Verwer J . Analysis of operator splitting for advection–diffusion–reaction problems from air pollution modelling. J. Comput. Appl. Math. 1999; 111: 201216.
  48. Law K. J. H , Stuart A. M . Evaluating data assimilation algorithms. Mon. Weather. Rev. 2012; 140(11): 37573782.
  49. Levy B. C . Principles of Signal Detection and Parameter Estimation. 2008; 1st ed, New York: Springer Publishing Company. 639.
  50. Lewicki M , Sejnowski T . Learning overcomplete representations. Neural Comput. 2000; 12: 337365.
  51. Liang X , Wood E. F , Lettenmaier D. P . Modeling ground heat flux in land surface parameterization schemes. J. Geophys. Res. 1999; 104: 95819600.
  52. Lin Y.-L , Deal R. L , Kulie M. S . Mechanisms of cell regeneration, development, and propagation within a two-dimensional multicell storm. J. Atmos. Sci. 1998; 55: 18671886.
  53. Lorenc A . Optimal nonlinear objective analysis. Q. J. Roy. Meteorol. Soc. 1988; 114: 205240.
  54. Lorenc A. C . Analysis methods for numerical weather prediction. Q. J. Roy. Meteorol. Soc. 1986; 112: 11771194.
  55. Lorenc A. C , Ballard S. P , Bell R. S , Ingleby N. B , Andrews P. L. F , co-authors . The Met. Office global three-dimensional variational data assimilation scheme. Q. J. Roy. Meteorol. Soc. 2000; 126: 29913012.
  56. Mallat S . A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans. Pattern Anal. Mach. Intell. 1989; 11: 674693.
  57. Mallat S . A Wavelet Tour of Signal Processing: The Sparse Way. 2009; 3rd ed, Elsevier. 805.
  58. Moradkhani H , Hsu K.-L , Gupta H , Sorooshian S . Uncertainty assessment of hydrologic model states and parameters: sequential data assimilation using the particle filter. Water Resour. Res. 2005; 41: W05012.
  59. Nadarajah S . A generalized normal distribution. J. Appl. Stat. 2005; 32: 685694.
  60. Neumaier A . Solving Ill-conditioned and singular linear systems: a tutorial on regularization. SIAM Rev. 1998; 40: 636666.
  61. Parrish D. F , Derber J. C . The National Meteorological Center's spectral statistical-interpolation analysis system. Mon. Weather Rev. 1992; 120: 17471763.
  62. Peters-Lidard C. D , Zion M. S , Wood E. F . A soil–vegetation–atmosphere transfer scheme for modeling spatially variable water and energy balance processes. J. Geophys. Res. 1997; 102: 43034324.
  63. Rabier F , Järvinen H , Klinker E , Mahfouf J.-F , Simmons A . The ECMWF operational implementation of four-dimensional variational assimilation. I: experimental results with simplified physics. Q. J. Roy. Meteorol. Soc. 2000; 126: 11431170.
  64. Rao K , Yip P . Discrete Cosine Transform: Algorithms, Advantages, Applications. 1990; Boston: Academic Press.
  65. Rasmussen C , Williams C . Gaussian Processes for Machine Learning Vol 1. 2006; Cambridge, MA: MIT press.
  66. Rawlins F , Ballard S. P , Bovis K. J , Clayton A. M , Li D , co-authors . The Met Office global four-dimensional variational data assimilation scheme. Q. J. Roy. Meteorol. Soc. 2007; 133: 347362.
  67. Sasaki Y . Some basic formalisms in numerical variational analysis. Mon. Weather Rev. 1970; 98: 875883.
  68. Serafini T , Zanghirati G , Zanni L . Gradient projection methods for quadratic programs and applications in training support vector machines. Optim. Methods Softw. 2005; 20: 353378.
  69. Smith K. S , Marshall J . Evidence for enhanced Eddy mixing at middepth in the Southern ocean. J. Phys. Oceanogr. 2009; 39: 5069.
  70. Stein M. L . Interpolation of Spatial Data. 1999; Springer-Verlag, New York.
  71. Tibshirani R . Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. Ser. B Stat. Methodol. 1996; 58: 267288.
  72. Tikhonov A , Arsenin V , John F . Solutions of Ill-Posed Problems. 1977; Washington, DC: Winston & Sons.
  73. Van Leeuwen P. J . Nonlinear data assimilation in geosciences: an extremely efficient particle filter. Q. J. Roy. Meteorol. Soc. 2010; 136: 19911999.
  74. Wahba G , Wendelberger J . Some new mathematical methods for variational objective analysis using splines and cross validation. Mon. Weather. Rev. 1980; 108: 11221143.
  75. Zhou Y , McLaughlin D , Entekhabi D . Assessing the performance of the ensemble Kalman filter for land surface data assimilation. Mon. Weather Rev. 2006; 134: 21282142.
  76. Zupanski M . Regional four-dimensional variational data assimilation in a quasi-operational forecasting environment. Mon. Weather Rev. 1993; 121: 23962408.
Language: English
Page range: 21789 - 21789
Submitted on: Jun 18, 2013
Accepted on: Jan 1, 2014
Published on: Dec 1, 2014
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services

© 2014 Ardeshir M. Ebtehaj, Milija Zupanski, Gilad Lerman, Efi Foufoula-Georgiou, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.