Articles | Volume 7, issue 4
https://doi.org/10.5194/esd-7-813-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/esd-7-813-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Review
| Highlight paper
| 
01 Nov 2016
Review | Highlight paper |
| 01 Nov 2016
Towards improved and more routine Earth system model evaluation in CMIP
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Peter J. Gleckler
Program for Climate Model Diagnosis and Intercomparison (PCMDI), Lawrence Livermore National Laboratory, Livermore, CA, USA
Christoph Heinze
University of Bergen, Geophysical Institute and Bjerknes Centre for Climate Research, Bergen, Norway
Uni Research Climate, Bergen, Norway
Ronald J. Stouffer
Geophysical Fluid Dynamics Laboratory/NOAA, Princeton, NJ, USA
Karl E. Taylor
Program for Climate Model Diagnosis and Intercomparison (PCMDI), Lawrence Livermore National Laboratory, Livermore, CA, USA
V. Balaji
Geophysical Fluid Dynamics Laboratory/NOAA, Princeton, NJ, USA
Cooperative Institute for Climate Science, Princeton University, NJ, USA
Eric Guilyardi
Institut Pierre Simon Laplace, Laboratoire d'Océanographie et du Climat, UPMC/CNRS, Paris, France
National Centre for Atmospheric Science, University of Reading, Reading, UK
Sylvie Joussaume
Institut Pierre Simon Laplace, Laboratoire des Sciences du Climat et de l'Environnement, CNRS/CEA/UVSQ, Saclay, France
Stephan Kindermann
Deutsches Klimarechenzentrum, Hamburg, Germany
Bryan N. Lawrence
National Centre for Atmospheric Science, University of Reading, Reading, UK
Centre for Environmental Data Analysis, STFC Rutherford Appleton Laboratory, Didcot, UK
Gerald A. Meehl
National Center for Atmospheric Research (NCAR), Boulder, CO, USA
Mattia Righi
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Dean N. Williams
Program for Climate Model Diagnosis and Intercomparison (PCMDI), Lawrence Livermore National Laboratory, Livermore, CA, USA
Viewed
Total article views: 10,217 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 16 Jun 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 7,098 | 2,837 | 282 | 10,217 | 232 | 254 |
- HTML: 7,098
- PDF: 2,837
- XML: 282
- Total: 10,217
- BibTeX: 232
- EndNote: 254
Total article views: 9,189 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 01 Nov 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 6,646 | 2,271 | 272 | 9,189 | 215 | 239 |
- HTML: 6,646
- PDF: 2,271
- XML: 272
- Total: 9,189
- BibTeX: 215
- EndNote: 239
Total article views: 1,028 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 16 Jun 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 452 | 566 | 10 | 1,028 | 17 | 15 |
- HTML: 452
- PDF: 566
- XML: 10
- Total: 1,028
- BibTeX: 17
- EndNote: 15
Cited
66 citations as recorded by crossref.
- Bridging observations, theory and numerical simulation of the ocean using machine learning M. Sonnewald et al. 10.1088/1748-9326/ac0eb0
- Deep Emulators for Differentiation, Forecasting, and Parametrization in Earth Science Simulators M. Nonnenmacher & D. Greenberg 10.1029/2021MS002554
- Ocean biogeochemistry in the Norwegian Earth System Model version 2 (NorESM2) J. Tjiputra et al. 10.5194/gmd-13-2393-2020
- Atmospheric Convection J. Lin et al. 10.1080/07055900.2022.2082915
- Analysis of combined series of hydrological angular momentum developed based on climate models J. Nastula et al. 10.3389/feart.2024.1369106
- Process-Oriented Evaluation of Climate and Weather Forecasting Models E. Maloney et al. 10.1175/BAMS-D-18-0042.1
- PMIP4 experiments using MIROC-ES2L Earth system model R. Ohgaito et al. 10.5194/gmd-14-1195-2021
- A systematic analysis of climate model precipitation in southern Brazil M. Pereima et al. 10.1002/joc.7460
- Statistical downscaling of maximum temperature under CMIP6 global climate models and evaluation of heat wave events using deep learning methods for Indo‐Gangetic Plain M. Chaturvedi et al. 10.1002/joc.8366
- Current and future wind energy resources in the North Sea according to CMIP6 A. Hahmann et al. 10.5194/wes-7-2373-2022
- Variability of surface climate in simulations of past and future K. Rehfeld et al. 10.5194/esd-11-447-2020
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP V. Eyring et al. 10.5194/gmd-13-3383-2020
- Deep learning and process understanding for data-driven Earth system science M. Reichstein et al. 10.1038/s41586-019-0912-1
- Radar observations of winds, waves and tides in the mesosphere and lower thermosphere over South Georgia island (54° S, 36° W) and comparison with WACCM simulations N. Hindley et al. 10.5194/acp-22-9435-2022
- An interactive ocean surface albedo scheme (OSAv1.0): formulation and evaluation in ARPEGE-Climat (V6.1) and LMDZ (V5A) R. Séférian et al. 10.5194/gmd-11-321-2018
- A traceability analysis system for model evaluation on land carbon dynamics: design and applications J. Zhou et al. 10.1186/s13717-021-00281-w
- Uncertainty separation of drought projection in the 21st century using SMILEs and CMIP6 Y. Ji et al. 10.1016/j.jhydrol.2023.130497
- Quantifying the agreement between observed and simulated extratropical modes of interannual variability J. Lee et al. 10.1007/s00382-018-4355-4
- Process‐Informed Subsampling Improves Subseasonal Rainfall Forecasts in Central America K. Kowal et al. 10.1029/2023GL105891
- International Data Node System for CMIP6 Climate Change Projections J. Lee et al. 10.15531/KSCCR.2020.11.4.247
- Evaluating Precipitation Errors Using the Environmentally Conditioned Intensity‐Frequency Decomposition Method A. Di Luca et al. 10.1029/2020MS002447
- Retrospective research on the interactions between land-cover change and global warming using bibliometrics during 1991–2018 J. Li et al. 10.1007/s12665-021-09804-2
- Bringing it all together: science priorities for improved understanding of Earth system change and to support international climate policy C. Jones et al. 10.5194/esd-15-1319-2024
- Air–sea heat fluxes variations in the Southern Atlantic Ocean: Present‐day and future climate scenarios R. Moura et al. 10.1002/joc.8517
- Evaluating Climate Models with an African Lens R. James et al. 10.1175/BAMS-D-16-0090.1
- Quantifying 3D Gravity Wave Drag in a Library of Tropical Convection‐Permitting Simulations for Data‐Driven Parameterizations Y. Sun et al. 10.1029/2022MS003585
- Progress in Simulating the Quasi‐Biennial Oscillation in CMIP Models J. Richter et al. 10.1029/2019JD032362
- Requirements for a global data infrastructure in support of CMIP6 V. Balaji et al. 10.5194/gmd-11-3659-2018
- The use of the Community Earth System Model in human dimensions climate research and applications E. Laidlaw et al. 10.1002/wcc.582
- Quantifying climate feedbacks in polar regions H. Goosse et al. 10.1038/s41467-018-04173-0
- Analysis of the Atmospheric Water Cycle for the Laurentian Great Lakes Region Using CMIP6 Models S. Minallah & A. Steiner 10.1175/JCLI-D-20-0751.1
- Natural and Anthropogenic Forcing of Multi‐Decadal to Centennial Scale Variability of Sea Surface Temperature in the South China Sea N. Goodkin et al. 10.1029/2021PA004233
- Reducing the Uncertainty in the Tropical Precipitation through a Multi‐Criteria Decision‐Making Approach A. Majhi et al. 10.1002/joc.8665
- Constraining Climate Model Projections of Regional Precipitation Change B. Zhang & B. Soden 10.1029/2019GL083926
- Global evaluation of the Ecosystem Demography model (ED v3.0) L. Ma et al. 10.5194/gmd-15-1971-2022
- Global Environmental Change Perspectives on Integrated, Coordinated, Open, and Networked (ICON) Science G. Koren et al. 10.1029/2022EA002231
- Multivariable integrated evaluation of model performance with the vector field evaluation diagram Z. Xu et al. 10.5194/gmd-10-3805-2017
- Asymmetric Impacts of El Niño and La Niña on Equatorial Atlantic Warming L. Jiang et al. 10.1175/JCLI-D-22-0158.1
- The improvements of sea surface temperature simulation over China Offshore Sea in present climate from CMIP5 to CMIP6 models R. Deng et al. 10.1007/s00382-023-06843-2
- A CMA‐ES Algorithm Allowing for Random Parameters in Model Calibration V. Sauerland et al. 10.1029/2022MS003390
- Decomposing Temperature Extremes Errors in CMIP5 and CMIP6 Models A. Di Luca et al. 10.1029/2020GL088031
- Sustainability of Arctic Ecosystems in a Changing Climate O. Anisimov & E. Zhil’tsova 10.3103/S1068373922050077
- Evaluation of Leading Modes of Climate Variability in the CMIP Archives J. Fasullo et al. 10.1175/JCLI-D-19-1024.1
- Functionally Assembled Terrestrial Ecosystem Simulator (FATES) for Hurricane Disturbance and Recovery M. Shi et al. 10.1029/2023MS003679
- Projections of Greenland climate change from CMIP5 and CMIP6 Q. Zhang et al. 10.1016/j.gloplacha.2023.104340
- Do Emergent Constraints on Carbon Cycle Feedbacks Hold in CMIP6? S. Zechlau et al. 10.1029/2022JG006985
- Multivariable evaluation of land surface processes in forced and coupled modes reveals new error sources to the simulated water cycle in the IPSL (Institute Pierre Simon Laplace) climate model H. Mizuochi et al. 10.5194/hess-25-2199-2021
- Applying ensemble ecosystem model projections to future-proof marine conservation planning in the Northwest Atlantic Ocean A. Bryndum-Buchholz et al. 10.1139/facets-2023-0024
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview M. Righi et al. 10.5194/gmd-13-1179-2020
- Large model structural uncertainty in global projections of urban heat waves Z. Zheng et al. 10.1038/s41467-021-24113-9
- Data Distribution Centre Support for the IPCC Sixth Assessment M. Stockhause et al. 10.5334/dsj-2019-020
- Developing an Open Data Portal for the ESA Climate Change Initiative P. Kershaw et al. 10.5334/dsj-2020-016
- Taking climate model evaluation to the next level V. Eyring et al. 10.1038/s41558-018-0355-y
- Parallel Post-Processing of the Earth Climate Model Output G. van den Oord & R. Bakhshi 10.1016/j.procs.2017.05.146
- Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6 D. Waliser et al. 10.5194/gmd-13-2945-2020
- Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package Y. Planton et al. 10.1175/BAMS-D-19-0337.1
- Deep Learning-Based Weather Prediction: A Survey X. Ren et al. 10.1016/j.bdr.2020.100178
- Diverse Response of Western North Pacific Anticyclone to Fast‐Decay El Niño During Decaying Summer L. Jiang et al. 10.1029/2022GL102612
- Evaluation of Impact of Potential Extreme Rainfall Events on Mining in Peru F. Gonzalez et al. 10.1007/s11053-018-9396-1
- Evaluation of aerosol and cloud properties in three climate models using MODIS observations and its corresponding COSP simulator, as well as their application in aerosol–cloud interactions G. Saponaro et al. 10.5194/acp-20-1607-2020
- Impacts of climate change on global total and urban runoff L. Gray et al. 10.1016/j.jhydrol.2023.129352
- Benchmarking CMIP5 models with a subset of ESA CCI Phase 2 data using the ESMValTool A. Lauer et al. 10.1016/j.rse.2017.01.007
- Probabilistic evaluation of competing climate models A. Braverman et al. 10.5194/ascmo-3-93-2017
- The stratosphere: a review of the dynamics and variability N. Butchart 10.5194/wcd-3-1237-2022
- ESD Reviews: Climate feedbacks in the Earth system and prospects for their evaluation C. Heinze et al. 10.5194/esd-10-379-2019
- AerChemMIP: quantifying the effects of chemistry and aerosols in CMIP6 W. Collins et al. 10.5194/gmd-10-585-2017
66 citations as recorded by crossref.
- Bridging observations, theory and numerical simulation of the ocean using machine learning M. Sonnewald et al. 10.1088/1748-9326/ac0eb0
- Deep Emulators for Differentiation, Forecasting, and Parametrization in Earth Science Simulators M. Nonnenmacher & D. Greenberg 10.1029/2021MS002554
- Ocean biogeochemistry in the Norwegian Earth System Model version 2 (NorESM2) J. Tjiputra et al. 10.5194/gmd-13-2393-2020
- Atmospheric Convection J. Lin et al. 10.1080/07055900.2022.2082915
- Analysis of combined series of hydrological angular momentum developed based on climate models J. Nastula et al. 10.3389/feart.2024.1369106
- Process-Oriented Evaluation of Climate and Weather Forecasting Models E. Maloney et al. 10.1175/BAMS-D-18-0042.1
- PMIP4 experiments using MIROC-ES2L Earth system model R. Ohgaito et al. 10.5194/gmd-14-1195-2021
- A systematic analysis of climate model precipitation in southern Brazil M. Pereima et al. 10.1002/joc.7460
- Statistical downscaling of maximum temperature under CMIP6 global climate models and evaluation of heat wave events using deep learning methods for Indo‐Gangetic Plain M. Chaturvedi et al. 10.1002/joc.8366
- Current and future wind energy resources in the North Sea according to CMIP6 A. Hahmann et al. 10.5194/wes-7-2373-2022
- Variability of surface climate in simulations of past and future K. Rehfeld et al. 10.5194/esd-11-447-2020
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP V. Eyring et al. 10.5194/gmd-13-3383-2020
- Deep learning and process understanding for data-driven Earth system science M. Reichstein et al. 10.1038/s41586-019-0912-1
- Radar observations of winds, waves and tides in the mesosphere and lower thermosphere over South Georgia island (54° S, 36° W) and comparison with WACCM simulations N. Hindley et al. 10.5194/acp-22-9435-2022
- An interactive ocean surface albedo scheme (OSAv1.0): formulation and evaluation in ARPEGE-Climat (V6.1) and LMDZ (V5A) R. Séférian et al. 10.5194/gmd-11-321-2018
- A traceability analysis system for model evaluation on land carbon dynamics: design and applications J. Zhou et al. 10.1186/s13717-021-00281-w
- Uncertainty separation of drought projection in the 21st century using SMILEs and CMIP6 Y. Ji et al. 10.1016/j.jhydrol.2023.130497
- Quantifying the agreement between observed and simulated extratropical modes of interannual variability J. Lee et al. 10.1007/s00382-018-4355-4
- Process‐Informed Subsampling Improves Subseasonal Rainfall Forecasts in Central America K. Kowal et al. 10.1029/2023GL105891
- International Data Node System for CMIP6 Climate Change Projections J. Lee et al. 10.15531/KSCCR.2020.11.4.247
- Evaluating Precipitation Errors Using the Environmentally Conditioned Intensity‐Frequency Decomposition Method A. Di Luca et al. 10.1029/2020MS002447
- Retrospective research on the interactions between land-cover change and global warming using bibliometrics during 1991–2018 J. Li et al. 10.1007/s12665-021-09804-2
- Bringing it all together: science priorities for improved understanding of Earth system change and to support international climate policy C. Jones et al. 10.5194/esd-15-1319-2024
- Air–sea heat fluxes variations in the Southern Atlantic Ocean: Present‐day and future climate scenarios R. Moura et al. 10.1002/joc.8517
- Evaluating Climate Models with an African Lens R. James et al. 10.1175/BAMS-D-16-0090.1
- Quantifying 3D Gravity Wave Drag in a Library of Tropical Convection‐Permitting Simulations for Data‐Driven Parameterizations Y. Sun et al. 10.1029/2022MS003585
- Progress in Simulating the Quasi‐Biennial Oscillation in CMIP Models J. Richter et al. 10.1029/2019JD032362
- Requirements for a global data infrastructure in support of CMIP6 V. Balaji et al. 10.5194/gmd-11-3659-2018
- The use of the Community Earth System Model in human dimensions climate research and applications E. Laidlaw et al. 10.1002/wcc.582
- Quantifying climate feedbacks in polar regions H. Goosse et al. 10.1038/s41467-018-04173-0
- Analysis of the Atmospheric Water Cycle for the Laurentian Great Lakes Region Using CMIP6 Models S. Minallah & A. Steiner 10.1175/JCLI-D-20-0751.1
- Natural and Anthropogenic Forcing of Multi‐Decadal to Centennial Scale Variability of Sea Surface Temperature in the South China Sea N. Goodkin et al. 10.1029/2021PA004233
- Reducing the Uncertainty in the Tropical Precipitation through a Multi‐Criteria Decision‐Making Approach A. Majhi et al. 10.1002/joc.8665
- Constraining Climate Model Projections of Regional Precipitation Change B. Zhang & B. Soden 10.1029/2019GL083926
- Global evaluation of the Ecosystem Demography model (ED v3.0) L. Ma et al. 10.5194/gmd-15-1971-2022
- Global Environmental Change Perspectives on Integrated, Coordinated, Open, and Networked (ICON) Science G. Koren et al. 10.1029/2022EA002231
- Multivariable integrated evaluation of model performance with the vector field evaluation diagram Z. Xu et al. 10.5194/gmd-10-3805-2017
- Asymmetric Impacts of El Niño and La Niña on Equatorial Atlantic Warming L. Jiang et al. 10.1175/JCLI-D-22-0158.1
- The improvements of sea surface temperature simulation over China Offshore Sea in present climate from CMIP5 to CMIP6 models R. Deng et al. 10.1007/s00382-023-06843-2
- A CMA‐ES Algorithm Allowing for Random Parameters in Model Calibration V. Sauerland et al. 10.1029/2022MS003390
- Decomposing Temperature Extremes Errors in CMIP5 and CMIP6 Models A. Di Luca et al. 10.1029/2020GL088031
- Sustainability of Arctic Ecosystems in a Changing Climate O. Anisimov & E. Zhil’tsova 10.3103/S1068373922050077
- Evaluation of Leading Modes of Climate Variability in the CMIP Archives J. Fasullo et al. 10.1175/JCLI-D-19-1024.1
- Functionally Assembled Terrestrial Ecosystem Simulator (FATES) for Hurricane Disturbance and Recovery M. Shi et al. 10.1029/2023MS003679
- Projections of Greenland climate change from CMIP5 and CMIP6 Q. Zhang et al. 10.1016/j.gloplacha.2023.104340
- Do Emergent Constraints on Carbon Cycle Feedbacks Hold in CMIP6? S. Zechlau et al. 10.1029/2022JG006985
- Multivariable evaluation of land surface processes in forced and coupled modes reveals new error sources to the simulated water cycle in the IPSL (Institute Pierre Simon Laplace) climate model H. Mizuochi et al. 10.5194/hess-25-2199-2021
- Applying ensemble ecosystem model projections to future-proof marine conservation planning in the Northwest Atlantic Ocean A. Bryndum-Buchholz et al. 10.1139/facets-2023-0024
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview M. Righi et al. 10.5194/gmd-13-1179-2020
- Large model structural uncertainty in global projections of urban heat waves Z. Zheng et al. 10.1038/s41467-021-24113-9
- Data Distribution Centre Support for the IPCC Sixth Assessment M. Stockhause et al. 10.5334/dsj-2019-020
- Developing an Open Data Portal for the ESA Climate Change Initiative P. Kershaw et al. 10.5334/dsj-2020-016
- Taking climate model evaluation to the next level V. Eyring et al. 10.1038/s41558-018-0355-y
- Parallel Post-Processing of the Earth Climate Model Output G. van den Oord & R. Bakhshi 10.1016/j.procs.2017.05.146
- Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6 D. Waliser et al. 10.5194/gmd-13-2945-2020
- Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package Y. Planton et al. 10.1175/BAMS-D-19-0337.1
- Deep Learning-Based Weather Prediction: A Survey X. Ren et al. 10.1016/j.bdr.2020.100178
- Diverse Response of Western North Pacific Anticyclone to Fast‐Decay El Niño During Decaying Summer L. Jiang et al. 10.1029/2022GL102612
- Evaluation of Impact of Potential Extreme Rainfall Events on Mining in Peru F. Gonzalez et al. 10.1007/s11053-018-9396-1
- Evaluation of aerosol and cloud properties in three climate models using MODIS observations and its corresponding COSP simulator, as well as their application in aerosol–cloud interactions G. Saponaro et al. 10.5194/acp-20-1607-2020
- Impacts of climate change on global total and urban runoff L. Gray et al. 10.1016/j.jhydrol.2023.129352
- Benchmarking CMIP5 models with a subset of ESA CCI Phase 2 data using the ESMValTool A. Lauer et al. 10.1016/j.rse.2017.01.007
- Probabilistic evaluation of competing climate models A. Braverman et al. 10.5194/ascmo-3-93-2017
- The stratosphere: a review of the dynamics and variability N. Butchart 10.5194/wcd-3-1237-2022
- ESD Reviews: Climate feedbacks in the Earth system and prospects for their evaluation C. Heinze et al. 10.5194/esd-10-379-2019
- AerChemMIP: quantifying the effects of chemistry and aerosols in CMIP6 W. Collins et al. 10.5194/gmd-10-585-2017
Latest update: 25 Dec 2024
Short summary
We argue that the CMIP community has reached a critical juncture at which many baseline aspects of model evaluation need to be performed much more efficiently to enable a systematic and rapid performance assessment of the large number of models participating in CMIP, and we announce our intention to implement such a system for CMIP6. At the same time, continuous scientific research is required to develop innovative metrics and diagnostics that help narrowing the spread in climate projections.
We argue that the CMIP community has reached a critical juncture at which many baseline aspects...
Altmetrics
Final-revised paper
Preprint