Progress and future prospects of decadal prediction and data assimilation: A review

An, 2021, Atlantic multidecadal oscillation drives interdecadal Pacific variability via tropical atmospheric bridge, J. Clim., 34, 5543, 10.1175/JCLI-D-20-0983.1 Arcucci, 2021, Deep data assimilation: Integrating deep learning with data assimilation, Appl. Sci., 11, 1114, 10.3390/app11031114 Barnston, 2019, Deterministic skill of ENSO predictions from the North American Multimodel Ensemble, Clim. Dyn., 53, 7215, 10.1007/s00382-017-3603-3 Bauer, 2015, The quiet revolution of numerical weather prediction, Nature, 525, 47, 10.1038/nature14956 Bellucci, 2015, Advancements in decadal climate predictability: The role of nonoceanic drivers, Rev. Geophys., 53, 165, 10.1002/2014RG000473 Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., Tian, Q., 2022. Pangu-Weather: A 3D high-resolution model for fast and accurate global weather forecast. arXiv preprint. arXiv:2211.02556. Bloom, 1996, Data assimilation using incremental analysis updates, Mon. Wea. Rev., 124, 1256, 10.1175/1520-0493(1996)124<1256:DAUIAU>2.0.CO;2 Boer, 2016, The Decadal Climate Prediction Project (DCPP) contribution to CMIP6, Geosci. Model Dev., 9, 3751, 10.5194/gmd-9-3751-2016 Bonavita, 2021, Exploring the structure of time‐correlated model errors in the ECMWF data assimilation system, Q. J. R. Meteorol. Soc., 147, 3454, 10.1002/qj.4137 Bouttier, 2001, Observing-system experiments in the ECMWF 4D-Var data assimilation system, Q. J. R. Meteorol. Soc., 127, 1469 Chen, 2004, Predictability of El Niño over the past 148 years, Nature, 428, 733, 10.1038/nature02439 Chen, 2013, Seasonal predictions of tropical cyclones using a 25-km-resolution general circulation model, J. Clim., 26, 380, 10.1175/JCLI-D-12-00061.1 Chikamoto, 2015, Skilful multi-year predictions of tropical trans-basin climate variability, Nat. Commun., 6, 6869, 10.1038/ncomms7869 Choi, 2022, Seasonal-to-decadal prediction of El Niño–Southern oscillation and Pacific decadal oscillation, Npj Clim. Atmos. Sci., 5, 29, 10.1038/s41612-022-00251-9 Courtier, 1998, The ECMWF implementation of three-dimensional variational assimilation (3D-Var). I: Formulation, Q. J. R. Meteorol. Soc., 124, 1783 Delworth, 2007, Decadal to centennial variability of the Atlantic from observations and models Delworth, 2020, SPEAR: The next generation GFDL modeling system for seasonal to multidecadal prediction and projection, J. Adv. Model. Earth Syst., 12 (3), e2019MS001895 Ding, 2008, Inter-decadal variation of the summer precipitation in East China and its association with decreasing Asian summer monsoon. Part I: Observed evidences, Int. J. Climatol., 28, 1139, 10.1002/joc.1615 Doblas-Reyes, 2013, Initialized near-term regional climate change prediction, Nat. Commun., 4, 1715, 10.1038/ncomms2704 Dong, 2014, The Indian Ocean sea surface temperature warming simulated by CMIP5 models during the 20th century: Competing forcing roles of GHGs and anthropogenic aerosols, J. Clim., 27, 3348, 10.1175/JCLI-D-13-00396.1 Dong, 2014, Indian Ocean warming during 1958–2004 simulated by a climate system model and its mechanism, Clim. Dyn., 42, 203, 10.1007/s00382-013-1722-z Dong, 2016, The footprint of the Inter-decadal Pacific Oscillation in Indian Ocean sea surface temperatures, Sci. Rep., 6, 21251, 10.1038/srep21251 Dong, 2022, A framework for four-dimensional variational data assimilation based on machine learning, Entropy, 24, 264, 10.3390/e24020264 Du, 2012, Sensitivity of decadal predictions to the initial atmospheric and oceanic perturbations, Clim. Dyn., 39, 2013, 10.1007/s00382-011-1285-9 Emile-Geay, 2017, A global multiproxy database for temperature reconstructions of the Common Era, Sci. Data, 4, 170088 Eyring, 2016, Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9, 1937, 10.5194/gmd-9-1937-2016 Fu, 2011, Projection of global mean surface air temperature changes in next 40 years: Uncertainties of climate models and an alternative approach, Sci. China Earth Sci., 54, 1400, 10.1007/s11430-011-4235-9 García-Serrano, 2015, Added-value from initialization in predictions of Atlantic multi-decadal variability, Clim. Dyn., 44, 2539, 10.1007/s00382-014-2370-7 Guemas, 2013, Retrospective prediction of the global warming slowdown in the past decade, Nat. Clim. Chang., 3, 649, 10.1038/nclimate1863 Guemas, 2013, The Indian Ocean: The region of highest skill worldwide in decadal climate prediction, J. Clim., 26, 726, 10.1175/JCLI-D-12-00049.1 Ham, 2019, Deep learning for multi-year ENSO forecasts, Nature, 573, 568, 10.1038/s41586-019-1559-7 Hamill, 2000, A hybrid ensemble Kalman filter–3D variational analysis scheme, Mon. Wea. Rev., 128, 2905, 10.1175/1520-0493(2000)128<2905:AHEKFV>2.0.CO;2 He, 2017, Reduction of initial shock in decadal predictions using a new initialization strategy, Geophys. Res. Lett., 44, 8538, 10.1002/2017GL074028 He, 2023, Constraint of air-sea interaction significant to skillful predictions of North Pacific climate variations, J. Clim., 36, 5941, 10.1175/JCLI-D-22-0635.1 He, 2020, A new DRP-4DVar-based coupled data assimilation system for decadal predictions using a fast online localization technique, Clim. Dyn., 54, 3541, 10.1007/s00382-020-05190-w He, 2020, A DRP-4DVar-based coupled data assimilation system with a simplified off-line localization technique for decadal predictions, J. Adv. Model. Earth Syst., 12, 10.1029/2019MS001768 Ho, 2013, Statistical decadal predictions for sea surface temperatures: A benchmark for dynamical GCM predictions, Clim. Dyn., 41, 917, 10.1007/s00382-012-1531-9 Hoke, 1976, The initialization of numerical models by a dynamic-initialization technique, Mon. Wea. Rev., 104, 1551, 10.1175/1520-0493(1976)104<1551:TIONMB>2.0.CO;2 Hu, 2020, Improved ENSO prediction skill resulting from reduced climate drift in IAP-DecPreS: A comparison of full-field and anomaly initializations, J. Adv. Model. Earth Syst., 12(2), e2019MS001759 Huang, 2002, Research on the characteristics, formation mechanism and prediction of sever climatic disasters in China, J. Nat. Disasters, 11, 1 Huang, 2009, Four-dimensional variational data assimilation for WRF: Formulation and preliminary results, Mon. Wea. Rev., 137(1), 299, 10.1175/2008MWR2577.1 Huber, 2014, Natural variability, radiative forcing and climate response in the recent hiatus reconciled, Nat. Geosci., 7, 651, 10.1038/ngeo2228 Hudson, 2017, ACCESS-S1 the new Bureau of Meteorology multi-week to seasonal prediction system, J. Southern Hemisphere Earth Syst. Sci., 67, 132, 10.1071/ES17009 Hurrell, 2009, A unified modeling approach to climate system prediction, Bull. Am. Meteorol. Soc., 90, 1819, 10.1175/2009BAMS2752.1 1996, 572 Johnson, 2005, A singular vector perspective of 4D-Var: Filtering and interpolation, Q. J. R. Meteorol. Soc., 131, 1, 10.1256/qj.03.231 Keenlyside, 2008, Advancing decadal-scale climate prediction in the North Atlantic sector, Nature, 453, 84, 10.1038/nature06921 Kim, 2012, Evaluation of short-term climate change prediction in multi-model CMIP5 decadal hindcasts, Geophys. Res. Lett., 39, L10701, 10.1029/2012GL051644 Kirtman, 2013, Near-Term climate change: Projections and predictability, 953 Knight, 2005, A signature of persistent natural thermohaline circulation cycles in observe climate, Geophys. Res. Lett., 32, L20708, 10.1029/2005GL024233 Kosaka, 2013, Recent global-warming hiatus tied to equatorial Pacific surface cooling, Nature, 501, 403, 10.1038/nature12534 Kushnir, 2019, Towards operational predictions of the near-term climate, Nat. Clim. Chang., 9, 94, 10.1038/s41558-018-0359-7 Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., et al., 2022. GraphCast: Learning skillful medium-range global weather forecasting. arXiv preprint. arXiv:2212.12794. Latif, 2011, A perspective on decadal climate variability and predictability, Deep Sea Res. Part 2: Top. Stud. Oceanogr., 58, 1880, 10.1016/j.dsr2.2010.10.066 Lean, 2009, How will Earth's surface temperature change in future decades?, Geophys. Res. Lett., 36, L15708, 10.1029/2009GL038932 Lee, 2006, Incremental analysis updates initialization technique applied to 10-km MM5 and MM5 3DVAR, Mon. Wea. Rev., 134, 1389, 10.1175/MWR3129.1 Lee, 2006, Evidence of decadal climate prediction skill resulting from changes in anthropogenic forcing, J. Clim., 19, 5305, 10.1175/JCLI3912.1 Lewandowsky, 2016, The “pause” in global warming: Turning a routine fluctuation into a problem for science, Bull. Am. Meteorol. Soc., 97, 723, 10.1175/BAMS-D-14-00106.1 Li, 2006, Decadal/interdecadal variations of the ocean temperature and its impacts on climate, Adv. Atmos. Sci., 23, 964, 10.1007/s00376-006-0964-7 Li, 2021, Improved decadal predictions of East Asian summer monsoon with a weakly coupled data assimilation scheme, Int. J. Climat., 41, 5550, 10.1002/joc.7141 Li, 2021, Dynamical seasonal prediction of tropical cyclone activity using the FGOALS-f2 ensemble prediction system, Wea. Forecast, 36, 1759, 10.1175/WAF-D-20-0189.1 Li, 2007, Influence of the Atlantic Multidecadal Oscillation on the winter climate of East China, Adv. Atmos. Sci., 24, 126, 10.1007/s00376-007-0126-6 Li, 2018, Estimating convection parameters in the GFDL CM2.1 model using ensemble data assimilation, J. Adv. Model. Earth Syst., 10, 989, 10.1002/2017MS001222 Lienert, 2013, Decadal prediction of interannual tropical and North Pacific sea surface temperature, J. Geophys. Res. Atmos., 118, 5913, 10.1002/jgrd.50469 Lin, 2019, Two regimes of Atlantic multidecadal oscillation: Cross-basin dependent or Atlantic-intrinsic, Sci. Bull., 64, 198, 10.1016/j.scib.2018.12.027 Linsley, 2015, Decadal changes in South Pacific sea surface temperatures and the relationship to the Pacific decadal oscillation and upper ocean heat content, Geophys. Res. Lett., 42, 2358, 10.1002/2015GL063045 Liu, 2021, A study of capturing AMOC regime transition through observation-constrained model parameters, Nonlinear Proc. Geoph. 28, 481–500., 10.5194/npg-28-481-2021 Lu, 2023, An improved coupled data assimilation system with a CGCM using multi-timescale high-efficiency EnOI-like filtering, J. Clim., 36, 6045, 10.1175/JCLI-D-22-0558.1 Lu, 2020, GFDL’s SPEAR seasonal prediction system: Initialization and ocean tendency adjustment (OTA) for coupled model predictions, J. Adv. Model. Earth Syst., 12(12), e2020MS002149 Luo, 2008, Extended ENSO predictions using a fully coupled ocean–atmosphere model, J. Clim., 21, 84, 10.1175/2007JCLI1412.1 Luo, 2017, Inter-basin sources for two-year predictability of the multi-year La Niña event in 2010–2012, Sci. Rep., 7, 2276, 10.1038/s41598-017-01479-9 Mantua, 1997, A pacific interdecadal climate oscillation with impacts on salmon production, Bull. Am. Meteorol. Soc., 78, 1069, 10.1175/1520-0477(1997)078<1069:APICOW>2.0.CO;2 Medhaug, 2017, Reconciling controversies about the global warming hiatus, Nature, 545, 41, 10.1038/nature22315 Meehl, 2005, How much more global warming and sea level rise?, Science, 307, 1769, 10.1126/science.1106663 Meehl, 2009, Decadal prediction: Can it be skillful?, Bull. Am. Meteorol. Soc., 90, 1467, 10.1175/2009BAMS2778.1 Meehl, 2011, Decadal variability of Asian–Australian and monsoon–ENSO–TBO relationships, J. Clim., 24, 4925, 10.1175/2011JCLI4015.1 Meehl, 2012, Relating the strength of the tropospheric biennial oscillation (TBO) to the phase of the Interdecadal Pacific Oscillation (IPO), Geophys Res. Lett., 39, L20716, 10.1029/2012GL053386 Meehl, 2014, Decadal climate prediction: An update from the trenches, Bull. Am. Meteorol. Soc., 95, 243, 10.1175/BAMS-D-12-00241.1 Meehl, 2014, CMIP5 multi-model hindcasts for the mid-1970s shift and early 2000s hiatus and predictions for 2016–2035, Geophys. Res. Lett., 41, 1711, 10.1002/2014GL059256 Meehl, 2016, Contribution of the Interdecadal Pacific Oscillation to twentieth-century global surface temperature trends, Nat. Clim. Chang., 6, 1005, 10.1038/nclimate3107 Meehl, 2021, Initialized Earth System prediction from subseasonal to decadal timescales, Nat. Rev. Earth Environ., 2, 340, 10.1038/s43017-021-00155-x Merryfield, 2013, The Canadian seasonal to interannual prediction system. Part I: Models and initialization, Mon. Wea. Rev., 141, 2910, 10.1175/MWR-D-12-00216.1 Mochizuki, 2010, Pacific decadal oscillation hindcasts relevant to near-term climate prediction, Proc. Natl. Acad. Sci. U.S.A., 107, 1833, 10.1073/pnas.0906531107 Mochizuki, 2016, Multiyear climate prediction with initialization based on 4D-Var data assimilation, Geophys. Res. Lett., 43, 3903, 10.1002/2016GL067895 Monerie, 2017, Decadal prediction skill using a high-resolution climate model, Clim. Dyn., 49, 3527, 10.1007/s00382-017-3528-x Mu, 2003, Conditional nonlinear optimal perturbation and its applications, Nonlinear Processes Geophys., 10, 493, 10.5194/npg-10-493-2003 Osman, 2023, Sub-seasonal to decadal predictions in support of climate services, Clim. Services, 30, 100397, 10.1016/j.cliser.2023.100397 Parrish, 1992, The National Meteorological Center’s spectral statistical-interpolation analysis system, Mon. Wea. Rev., 120, 1747, 10.1175/1520-0493(1992)120<1747:TNMCSS>2.0.CO;2 Petrova, 2020, Rodó multiyear statistical prediction of ENSO enhanced by the tropical Pacific observing system, J. Clim., 33, 163, 10.1175/JCLI-D-18-0877.1 Pohlmann, 2023, Impact of ocean data assimilation on climate predictions with ICON-ESM, Clim. Dyn., 61, 357, 10.1007/s00382-022-06558-w Qi, 2017, An alternative multi-model ensemble mean approach for near-term projection, Int. J. Climatol., 37, 109, 10.1002/joc.4690 Ravuri, 2021, Skilful precipitation nowcasting using deep generative models of radar, Nature, 597, 672, 10.1038/s41586-021-03854-z Reynolds, 2017, Reconstructing North Atlantic marine climate variability using an absolutely-dated sclerochronological network, Palaeogeogr. Palaeoclimatol. Palaeoecol., 465, 333, 10.1016/j.palaeo.2016.08.006 Robson, 2014, Decadal predictions of the cooling and freshening of the North Atlantic in the 1960s and the role of ocean circulation, Clim. Dyn., 42, 1, 10.1007/s00382-014-2115-7 Saha, 2010, The NCEP climate forecast system reanalysis, Bull. Amer. Meteorol. Soc., 91, 1015, 10.1175/2010BAMS3001.1 Sanchez-Gomez, 2016, Drifts dynamics in a coupled model initialized for decadal forecasts, Clim. Dyn., 46, 1819, 10.1007/s00382-015-2678-y Santer, 2017, Causes of differences between model and satellite tropospheric warming rates, Nat. Geosci., 10, 478, 10.1038/ngeo2973 Shi, 2022, contributions of weakly coupled data assimilation-based land initialization to interannual predictability of summer climate over Europe, J. Clim., 35, 517, 10.1175/JCLI-D-20-0506.1 Shi, 2023, The 4DEnVar-based land coupled data assimilation system for E3SM version 2, Geosci. Mod. Dev. Discuss., [preprint], Shimose, 2017, Analysis of the 6 September 2015 tornadic storm around the Tokyo metropolitan area using coupled 3DVAR and incremental analysis updates, J. Disaster Res., 12, 956, 10.20965/jdr.2017.p0956 Smith, 2007, Improved surface temperature prediction for the coming decade from a global climate model, Science, 317, 796, 10.1126/science.1139540 Smith, 2013, A comparison of full-field and anomaly initialization for seasonal to decadal climate prediction, Clim. Dyn., 41, 3325, 10.1007/s00382-013-1683-2 Sun, 2018, ENSO hindcast skill of the IAP-DecPreS near-term climate prediction system: Comparison of full-field and anomaly initialization, Atmos. Ocean. Sci. Lett., 11, 54, 10.1080/16742834.2018.1411753 Sun, 2022, An online ensemble coupled data assimilation capability for the Community Earth System Model: System design and evaluation, Geosci. Model Dev., 15, 4805, 10.5194/gmd-15-4805-2022 Suckling, 2017, An empirical model for probabilistic decadal prediction: A global attribution and regional hindcasts, Clim. Dyn., 48, 3115, 10.1007/s00382-016-3255-8 Sutton, 2005, Atlantic Ocean forcing of North American and European summer climate, Science, 309, 115, 10.1126/science.1109496 Swingedouw, 2012, Initialisation and predictability of the AMOC over the last 50 years in a climate model, Clim. Dyn., 40, 2381, 10.1007/s00382-012-1516-8 Tatebe, 2012, The initialization of the MIROC climate models with hydrographic data assimilation for decadal prediction, J. Meteorol. Soc. Jpn., 90A, 275, 10.2151/jmsj.2012-A14 Taylor, 2012, An overview of CMIP5 and the experiment design, Bull. Am. Meteorol. Soc., 93, 485, 10.1175/BAMS-D-11-00094.1 Tian, 2015, A non-linear least squares enhanced POD-4DVar algorithm for data assimilation, Tellus A: Dyn. Meteorol. Oceanogr., 67, 25340, 10.3402/tellusa.v67.25340 Tian, 2019, An adjoint-free CNOP–4DVar hybrid method for identifying sensitive areas targeted observations: Method formulation and preliminary evaluation, Adv. Atmos. Sci., 36, 721, 10.1007/s00376-019-9001-5 Tierney, 2015, Tropical sea surface temperatures for the past four centuries reconstructed from coral archives, Paleoceanogr. Paleocl., 30, 226, 10.1002/2014PA002717 Toniazzo, 2014, Development of warm SST errors in the southern tropical Atlantic in CMIP5 decadal hindcasts, Clim. Dyn., 43, 2889, 10.1007/s00382-013-1691-2 Troccoli, 2007, Ensemble decadal predictions from analysed initial conditions, Philos. Trans. A: Math. Phys. Eng. Sci., 365, 2179, 10.1098/rsta.2007.2079 Tsuyuki, 2022, Nonlinear data assimilation by deep learning embedded in an ensemble Kalman filter, J. Meteorol. Soc. Jpn. Ser. II, 100, 533, 10.2151/jmsj.2022-027 van Oldenborgh, 2012, Decadal prediction skill in a multi-model ensemble, Clim. Dyn., 38, 1263, 10.1007/s00382-012-1313-4 Wang, 2010, An economical approach to four-dimensional variational data assimilation, Adv. Atmos. Sci., 27, 715, 10.1007/s00376-009-9122-3 Wei, 2015, A quantitative definition of global warming hiatus and 50-year prediction of global-mean surface temperature, J. Atmos. Sci., 72, 3281, 10.1175/JAS-D-14-0296.1 Wu, 2015, Initialized decadal predictions by LASG/IAP climate system model FGOALS-s2: Evaluations of strengths and weaknesses, Adv. Meteorol., 1 Wu, 2018, EnOI-IAU initialization scheme designed for decadal climate prediction system IAP-DecPreS, J. Adv. Model. Earth Syst., 10, 342, 10.1002/2017MS001132 Wu, 2019, Improved decadal prediction of Northern-Hemisphere summer land temperature, Clim. Dyn., 53, 1357, 10.1007/s00382-019-04658-8 Xin, 2018, Decadal prediction skill of BCC-CSM1.1 climate model in East Asia, Int. J. Climatol., 38, 584, 10.1002/joc.5195 Yeager, 2012, A decadal prediction case study: Late 20th century North Atlantic Ocean heat content, J. Clim., 25, 5173, 10.1175/JCLI-D-11-00595.1 Yeager, 2017, Recent progress in understanding and predicting decadal climate variability, Curr. Clim. Chang. Rep., 3, 112, 10.1007/s40641-017-0064-z Yu, 2007, Seasonality and three-dimensional structure of interdecadal change in the east Asian monsoon, J. Clim., 20, 5344, 10.1175/2007JCLI1559.1 Zang, 2022, Multi-scale three-dimensional variational data assimilation for high-resolution aerosol observations: Methodology and application, Sci. China Earth Sci., 65, 1961, 10.1007/s11430-022-9974-4 Zhang, 2009, Coupling ensemble Kalman filter with four-dimensional variational data assimilation, Adv. Atmos. Sci., 26, 1, 10.1007/s00376-009-0001-8 Zhang, 2020, Coupled data assimilation and parameter estimation in coupled ocean–atmosphere models: A review, Clim. Dyn., 54, 5127, 10.1007/s00382-020-05275-6 Zhang, 2018, A new hybrid coupled model of atmosphere, ocean physics, and ocean biogeochemistry to represent biogeophysical feedback effects in the tropical Pacific, J. Adv. Model. Earth Syst., 10, 1901, 10.1029/2017MS001250 Zhou, 2017, Decadal climate prediction: Scientific frontier and challenge, Adv. Earth Sci., 32, 331