Demonstrating the value of larger ensembles in forecasting physical systems
By: Reason L. Machete and Leonard A. Smith
References
, , , , , co-authors. Evaluation of probabilistic quality and value of the ENSEMBLES multimodel seasonal forecasts: comparison with DEMETER. Mon. Weather Rev. 2011; 139: 581– 607. , . Synchronizing Moore and Spiegel. Chaos. 1997; 7( 4): 738– 752. , . The combination of forecasts. Oper. Res. Soc. 1969; 20( 4): 451– 468. . Verification of forecasts expressed in terms of probability. Mon. Weather Rev. 1950; 78( 1): 1– 3. . Resolution and discrimination – two sides of the same coin. Q. J. Roy. Meteorol. Soc. 2015; 141: 1277– 1282. , . Increasing the reliability of reliability diagrams. Weather Forecast. 2007; 22( 3): 651– 661. , . From ensemble forecasts to predictive distribution functions. Tellus A. 2008; 60( 4): 663– 678. . Design for Decision: An Introduction to Statistical Decision-Making. 1953; New York: Macmillan. , . Impact of ensemble size on ensemble prediction. Mon. Weather Rev. 1998; 126: 2503– 2518. . Time Series Forecasting. 2001; London: Chapman and Hall. , . , , . Predictive density evaluation. Handbook for Economic Forecasting. 2006; North-Holland: Elsevier. 197– 284. . Present position and potential developments: some personal views: statistical theory: the prequencial approach. J. Roy. Stat. Soc. A. 1984; 147( 2): 278– 292. , , . Evaluating density forecasts with application to financial risk management. Int. Econ. Rev. 1998; 39( 4): 863– 883. , , . The rationale behind the success of multi-model ensembles in seasonal forecasting. Part II: calibration and combination. Tellus A. 2005; 57: 234– 252. , . Ergodic theory of chaos and strange attractors. Rev. Mod. Phys. 1985; 57: 617– 653. . Fair scores for ensemble forecasts. Q. J. Roy. Meteorol. Soc. 2014; 140( 683): 1917– 1923. , , , , . Model complexity versus ensemble size: allocating resources for climate prediction. Philos. Trans. Roy. Soc. 2012; 370: 1087– 1099. , , . On the effect of ensemble size on the discrete and continuous ranked probability scores. Meteorol. Appl. 2008; 15: 19– 24. , , . Probabilistic forecasts, calibration and sharpness. J. Roy. Stat. Soc. B. 2007; 69( 2): 243– 268. . Rational decisions. J. Roy. Stat. Soc. B. 1952; 14( 1): 107– 114. , . Communicating the value of probabilistic forecasts with weather roulette. Meteorol. Appl. 2009; 16( 2): 143– 155. , . Probabilistic noise reduction. Tellus A. 2001; 55( 5): 585– 598. . Probability judgements for continuous quantities: linear combinations and calibration. Manage. Sci. 2004; 50( 5): 597– 604. , . Indistinguishable states I: perfect model scenario. Physica D. 2001; 151: 125– 141. , . Indistinguishable states II: the imperfect model scenario. Physica D. 2004; 196: 224– 242. . A new interpretation of information rate. Bell Syst. Tech. J. 1956; 35( 4): 916– 926. , , , , , co-authors. A composite state method for ensemble data assimilation with multiple limited-area models. Tellus A. 2015; 67: 26495. . Beneath the noise, chaos. Ann. Stat. 1999; 27: 461– 479. . Theoretical skill of Monte Carlo forecasts. Mon. Weather Rev. 1974; 102( 6): 409– 418. , . Ensemble forecasting. J. Comput. Phys. 2008; 227: 3515– 3539. . Analysis methods for numerical weather prediction. Q. J. Roy. Meteorol. Soc. 1986; 112: 1177– 1194. . Deterministic non-periodic flow. J. Atmos. Sci. 1963; 20: 130– 141. . Predictability of a flow which possesses many scales of motion. Tellus. 1969; 21: 289. , . Asymptotic inference for dynamical systems observed with error. J. Stat. Plan. Inference. 1995; 46: 277– 292. . Modelling a Moore-Spiegel Electronic Circuit: The Imperfect Model Scenario. 2008; University of Oxford. DPhil Thesis. . Early warning with calibrated and sharper probabilistic forecasts. J. Forecast. 2013a; 32( 5): 452– 468. . Model imperfection and predicting predictability. Int. J. Bifurcat. Chaos. 2013b; 23( 8): 1330027. , . Initial distribution spread: a density forecasting approach. Physica D. 2012; 241: 805– 815. , . Areas beneath the relative operating characteristics (ROC) and relative Operating levels (ROL) curves: statistical significance and interpretation. Q. J. Roy. Meteorol. Soc. 2002; 128: 2145– 2166. , . Better nonlinear models from noisy data: attractors with maximum likelihood. Phys. Rev. Lett. 1999; 83( 21): 4285– 4288. , . A thermally excited nonlinear oscillator. Astrophys. J. 1966; 143: 871– 887. , , , . A debiased ranked probability skill score to evaluate probabilistic ensemble forecasts with small sizes. J Clim. 2005; 18: 1513– 1522. , , , . Model error in weather forecasting. Nonlinear Process. Geophys. 2001; 8: 357– 371. , , , , , co-authors. Development of a European multimodel ensemble system for seasonal-to-interannual prediction (DEMETER). Bull. Am. Meteorol. Soc. 2004; 85: 853– 872. . Predicting uncertainty in forecasts of weather and climate. 2000; 71–116. Reports on progress in Physics. No. 63, IOP Publishing. , . Singular vectors, predictability and ensemble forecasting for weather and climate. J. Phys. Math. Theor. 2013; 46: 254018. . On the estimation of a probability density function and mode. Ann. Math. Stat. 1962; 33( 3): 1065– 1076. . Objective Knowledge: An evolutionary approach. 1972; Oxford: Clarendon Press. . Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Q. J. Roy. Meteorol. Soc. 2001; 127: 2473– 2489. . Density Estimation for Statistics and Data Analysis. 1986; 1st ed, London: Chapman and Hall. . Local optimal prediction: exploiting strangeness and variation of sensitivity of initial conditions. Philos. Trans. Roy. Soc. Lond. A. 1994; 348: 371– 381. . Accountability and error in ensemble prediction of baroclinic flows. Seminar on Predictability, 4–8 September 1995. ECMWF Seminar Proceedings. 1995; 1: Reading. 351– 368. . Maintenance of uncertainty. International School of Physics ‘Enrico Fermi, Course CXXXIII’. 1997; Italy, Societ'a Italiana di Fisica: Bologna. 177– 246. . What might we learn from climate forecasts?. Proc. Natl. Acad. Sci. USA. 2002; 99( Suppl): 447– 461. , , , . Probabilistic skill in ensemble seasonal forecasts. Q. J. Roy. Meteorol. Soc. 2014; 140: 729– 1128. , , . Uncertainty in dynamics and predictability in chaotic systems. Q. J. Roy. Meteorol. Soc. 1999; 125: 2855– 2886. . Practical Meteorology: An Algebra-based Survey of Atmospheric Science. 2015; Columbia: University of British. . Twilight of the perfect model model. Erkenntnis. 2001; 55: 393– 415. . The outlook: scattered showers. Bull. Am. Meteorol. Soc. 1988; 69( 4): 368– 372. , . Generalisation of the ignorance score: continuous ranked version and its decomposition. Mon. Weather Rev. 2012; 140( 6): 2005– 2017. , . Ensemble forecasting at NMC: the generation of perturbations. Bull. Am. Meteorol. Soc. 1993; 74: 2317– 2330. , , . The discrete Brier and ranked probability skill scores. Mon. Weather Rev. 2007; 135( 1): 118– 124.
DOI: https://doi.org/10.3402/tellusa.v68.28393 | Journal eISSN: 3035-9554
Language: English
Page range: 28393 - 28393
Submitted on: May 12, 2016
Accepted on: Nov 13, 2016
Published on: Dec 1, 2016
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services
Keywords:
© 2016 Reason L. Machete, Leonard A. Smith, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.