The rationale behind the success of multi-model ensembles in seasonal forecasting – II. Calibration and combination
References
-
Adler
, R. F., Huffman, G. J., Chang, A., Ferraro, R., Xie, P.-P.and co-authors. 2003. Climatology project (GPCP) monthly precipitation analysis (1979-present)., 1147– 1167. -
Anderson
, T.. The Statistical Analysis of Time Series . Wiley, New York. -
Archer
, E. R.. Identifying underserved end-user groups in the provision of climate information. Bull. Am. Meteorol. Soc. 84, 1525– 1532. -
Atger
, F.. Spatial and interannual variability of the reliability of ensemble-based probabilistic forecasts: Consequences for calibration. Mon. Wea. Rev. 131, 1509– 1523. -
Barnston
, A., Mason, S., Goddard, L., Dewitt, D.and Zebiak, S.. Multi-model ensembling in seasonal climate forecasting at IRI. Bull. Am. Meteorol. Soc. 84, 1783– 1796. -
Cantelaube
, P.and Terres, J.-M.. Seasonal weather forecasts for crop yield modelling in Europe. Tellus, 476– 487. -
Challinor
, A. J., Slingo, J. M., Wheeler, T. R.and Doblas-Reyes, F. J.. Probabilistic simulations of crop yield over western India using the DEMETER seasonal hindcast ensembles. Tellus, 498– 512. -
Clark
, R.and Deque, M.. Conditional probability of seasonal predictions of precipitation. Q. J. R. Meteorol. Soc. 129, 179– 193. -
Clemen
, R. T.. Combining forecasts: A review and annotated bibliography. Int. J. Forecasting, 559– 583. -
Coelho
, C. A., Pezzulli, S., Balmaseda, M., Doblas-Reyes, E J.and Stephenson, D. B.. Skill of coupled model seasonal fore-casts: A bayesian assessment of ECMWF ENSO forecasts. ECMWF Technical Memorandum No. 426. -
Coelho
, C. A., Pezzulli, S., Balmaseda, M., Doblas-Reyes, E J.and Stephenson, D. B.. Forecast calibration and combination: a simple bayesian approach for ENSO. J. Climate, 1504– 1516. -
Déqué
, M.. Removing the model systematic error in extended range. Ann. Geophys. 9, 242– 251. -
Derome
, J., Brunet, G., Plante, A., Gagnon, N., Boer, G. J.and co-authors. Seasonal predictions based on two dynamical models. Atmosphere-Ocean, 485– 501. -
Doblas-Reyes
, F. J., Deque, M.and Piedelievre, J.-P.. Multi-model spread and probabilistic seasonal forecasts in PROVOST. Q. J. R. Meteorol. Soc. 126, 2069– 2088. -
Doblas-Reyes
, F. J., Pavan, V.and Stephenson, D. B.. Multi-model seasonal hindcasts of the NAO. Climate Dyn. 21, 501– 514. -
Epstein
, E.. Stochastic dynamic prediction. Tellus, 739– 759. -
Evans
, R., Harrison, M. S. J., Graham, R. J.and Mylne, K. R.. Joint medium-range ensembles from the Met Office and ECMWF systems. Mon. Wea. Rev. 128, 3104– 3127. -
Feddersen
, H.. Impact of global sea surface temperature on summer and winter temperatures in Europe in a set of seasonal ensemble simulations. Q. J. R. Meteorol. Soc. 126, 2089– 2110. -
Feddersen
, H.. Predictability of seasonal precipitation in the Nordic region. Tellus, 385– 400. -
Feddersen
, H.and Andersen, U.. A method for statistical down-scaling of seasonal ensemble predictions. Tellus, 398– 408. -
Feddersen
, H., Navarra, A.and Ward, M.. Reduction of model systematic error by statistical correction for dynamical seasonal prediction. J. Climate, 1974– 1989. -
Fraedrich
, K.and Leslie, L. M.. Combining predictive schemes in short-term forecasting. Mon. Wea. Rev. 115, 1640– 1644. -
Fraedrich
, K.and Smith, N.. Combining predictive schemes in long-range forecasting. J. Climate, 291– 294. -
Fritsch
, J. M., Hilliker, J., Ross, J.and Vislocky, R. L.. Model consensus. Wea. Forecasting, 571– 582. -
Hagedorn
, R., Doblas-Reyes, E J.and Palmer, T. N.. The rationale behind the success of multi-model ensembles in seasonal forecasting - I. Basic concept. Tellus, 219– 233. -
Hamill
, T.and Colucci, S. J.. Verification of Eta-RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev. 126, 711– 724. -
Harrison
, M. S. J., Palmer, T. N., Richardson, D. S., Buizza, R.and Petroliagis, T.. Joint ensembles from the UKMO and ECMWF models. In: ECMWF Seminar Procedings: Predictability, Vol. 2, pp. 61– 120. ECMWF, Reading, UK. -
Hartmann
, H. C., Pagano, T. C., Sorooshian, S.and Bales, R.. Confidence builders: evaluating seasonal climate forecasts for user perspectives. Bull. Am. Meteorol. Soc. 83, 683– 698. -
Jochec
, K., Mjelde, J., Lee, A.and Conner, J.. Use of seasonal climate forecasts in rangeland-based livestock operations in west Texas. J. Appl. Meteorol. 40, 1629– 1639. -
Jolliffe
, I. T.and Stephenson, D. B.. Forecast Verification: A Practitioner’s Guide in Atmospheric Science . Wiley, New York. -
Kharin
, V. V.and Zwiers, E W.. Climate predictions with multi-model ensembles. J. Climate, 793– 799. -
Kharin
, V. V.and Zwiers, E W.. Improved seasonal probability forecasts. J. Climate, 1684– 1701. -
Kharin
, V. V.and Zwiers, F. W.. On the roc score of probability forecasts. J. Climate, 4145– 4150. -
Krishnamurti
, T. N., Kishtawal, C. M., LaRow, T. E., Bachiochi, D. R., Zhang, Z.and co-authors.. Improved weather and seasonal climate forecasts from multi-model superensemble. Science, 1548– 1550. -
Krishnamurti
, T. N., Kishtawal, C. M., Zhang, Z., LaRow, T. E., Bachiochi, D. R.and co-authors. 2000. Multi-model ensemble forecasts for weather and seasonal climate. J. Climate, 4196– 4216. -
Marletto
, V., Zinoni, E, Criscuolo, L., Fontana, G., Marchesi, S.and co-authors. 2005. Evaluation of downscaled DEMETER multi-model ensemble seasonal hindcasts in northen Italy by means of a model of wheat growth and soil water balance. Tellus 57A, this issue. -
Mason
, S. J.. On using climatology as a reference strategy in the Brier and ranked probability skill scores. Mon. Wea. Rev. 132, 1891– 1895. -
Mason
, S. J.and Graham, N. E.. Conditional probabilities, relative operating characteristics, and relative operating levels. Wea. Forecasting, 713– 725. -
Mason
, S. J., Goddard, L., Graham, N. E., Yulaeva, E., Sun, L.and co-authors. 1999. The IRI seasonal climate prediction system and the 1997/98 El Niiio event. Bull. Am. Meteorol. Soc. 80, 1853– 1873. -
Metzger
, S., Latif, M.and Fraedrich, K.. Combining ENSO fore-casts: a feasibility study. Mon. Wea. Rev. 132, 456– 472. -
Michaelsen
, J.. Cross-validation in statistical climate forecast models. J. Climate Appl. Meteor. 26, 1589– 1600. -
Molteni
, F., Buizza, R., Palmer, T. N.and Petroliagis, T.. The ECMWF ensemble prediction system: Methodology and validation. Q. J. R. Meteorol. Soc. 122, 73– 119. -
Morse
, A. P., Doblas-Reyes, E, Hoshen, M. B., Hagedorn, R., Thomson, M. C.and co-authors. 2005. A forecast quality assessment of an end-to-end probalistic multi-model seasonal forecast system using a malaria model. Tellus 57A, 454- 475. -
Murnane
, R. J., Crowe, M., Eustis, A., Howard, S., Koepsell, J.and co-authors. 2002. The weather risk management industry’s climate forecast and data needs: a workshop report. Bull. Am. Meteorol. Soc. 83, 83– 1198. -
Murphy
, A. H.. Climatology, persistence, and their linear combination as standards of reference in skill scores. Wea. Forecasting, 692– 698. -
Murphy
, A. H.and Winkler, R.. A general framework for forecast verification. Mon. Wea. Rev. 115, 1330– 1338. -
Palmer
, T. N.. A non-linear dynamical perspective on model error: a proposal for non-local stochastic-dynamic parametrization in weather and climate prediction models. Q. J. R. Meteorol. Soc. 127, 279– 304. -
Palmer
, T. N.. Predictability of weather and climate: from theory to practice-from days to decades. In: ECMWF Seminar Procedings: Predictability of Weather and Climate. ECMWF, Reading, UK. pp. 1- 14. -
Palmer
, T. N.and Shukla, J.. Editorial to DSP/PROVOST special issue. Q. J. R. Meteorol. Soc. 126, 1989– 1990. -
Palmer
, T. N., Brankovic, C.and Richardson, D. S.. A probability and decision-model analysis of PROVOST seasonal multi-model ensemble integrations. Q. J. R. Meteorol. Soc. 126, 2013– 2034. -
Palmer
, T. N., Alessandri, A., Andersen, U., Cantelaube, P., Davey, M.and co-authors. 2004. Development of a European multi-model ensemble system for seasonal to interannual prediction (DEMETER).. 85, 85– 872. -
Pavan
, V.and Doblas-Reyes, E J.. Multi-model seasonal hindcasts over the Euro-Atlantic: skill scores and dynamical features. Climate Dyn. 16, 611– 625. -
Pavan
, V, Marchesi, S., Morgillo, A., Cacciamani, C.and Doblas-Reyes, E J.. Downscaling of DEMETER winter seasonal hindcasts over northern Italy. Tellus, 424– 434. -
Peng
, P., Kumar, A., van den Dool, H.and Barnston, A. G.. An analysis of multi-model ensemble predictions for seasonal climate anomalies. J. Geophys. Res. 107, doi: 10.1029/2002JDO02712. -
Rajagopalan
, B., Lall, U.and Zebiak, S. E.. Categorical climate forecasts through regularization and optimal combination of multiple GCM ensembles. Mon. Wea. Rev. 130, 1792– 1811. -
Richardson
, D. S.. Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Q. J. R. Meteorol. Soc. 127, 2473– 2489. -
Sarda
, J., Plaut, G., Pires, C.and Vautard, R.. Statistical and dynamical long-range atmospheric forecasts: experimental comparison and hybridization. Tellus, 518– 537. -
Sarewitz
, D., PielkeJr , and Byerly, R. Jr . 2000. Prediction: Science, Decision Making and the Future of Nature . Island Press, Washington, DC. -
Shukla
, J., Anderson, J., Baumhefner, D., Brankovic, C., Chang, Y.and co-authors. 2000. Dynamical seasonal prediction. Bull. Am. Meteorol Soc. 81, 81– 2606. -
Silverman
, B.. Density Estimation for Statistics and Data Analysis . Chapman and Hall, New York. -
Stefanova
, L.and Krishnamurti, T. N.. Interpretation of seasonal climate forecast using Brier skill score, the Florida State University superensemble, and the AMIP-I data set. J. Climate, 537– 544. -
Stephenson
, D. B., Coelho, C. A., Doblas-Reyes, F. J.and Balmaseda, M.. Forecast assimilation: a unified framework for the combination of multi-model weather and climate predictions. Tellus 57A, this issue. -
Swets
, J.. The relative operating characteristic in psychology. Science, 990– 1000. -
Thompson
, P. D.. How to improve accuracy by combining inde-pendent forecasts. Mon. Wea. Rev. 105, 228– 229. -
Thornes
, J.and Stephenson, D. B.. How to judge the quality and value of weather forecast products. MeteoroL AppL, 307– 314. -
Tracton
, M. S.and Kalnay, E.. Operational ensemble prediction at the National Meteorological Center: practical aspects. Wea. Forecast-ing, 379– 398. -
Vislocky
, R. L.and Fritsch, J. M.. Improved model output statistics forecast through model consensus. Bull. Am. MeteoroL Soc. 76, 1157– 1164. -
Vislocky
, R. L.and Young, G. S.. The use of perfect prog forecasts to improve model output statistics forecasts of precipitation probabil-ity. Wea. Forecasting, 202– 209. -
von Storch
, H.. On the use of inflation in statistical downscaling. J. Climate, 3505– 3506. -
von Storch
, H.and Zwiers, F. W.. Statistical Analysis in Climate Research. Cambridge University Press, Cambridge, 494 pp. -
Willcs
, D. S.. Statistical Methods in the Atmospheric Sciences . Academic Press, New York. -
Yun
, W., Stefanova, L., Mitra, A., Vijayakumar, T., Dewar, W.and co-authors. 2005. A multi-model superensemble algorithm for seasonal climate prediction using DEMETER forecasts. Tellus 57A, 280- 289.
DOI: https://doi.org/10.3402/tellusa.v57i3.14658 | Journal eISSN: 3035-9554
Language: English
Page range: 234 - 252
Submitted on: Apr 6, 2004
Accepted on: Sep 24, 2004
Published on: Jan 1, 2005
Published by: Stockholm University Press
In partnership with: Paradigm Publishing Services
© 2005 Francisco J. Doblas-Reyes, Renate Hagedorn, T. N. Palmer, published by Stockholm University Press
This work is licensed under the Creative Commons Attribution 4.0 License.