Articles | Volume 17, issue 1
https://doi.org/10.5194/esd-17-23-2026
https://doi.org/10.5194/esd-17-23-2026
Research article
 | 
06 Jan 2026
Research article |  | 06 Jan 2026

Enhanced climate reproducibility testing with false discovery rate correction

Michael E. Kelleher and Salil Mahajan

Related authors

High sensitivity of simulated fog properties to parameterized aerosol activation in case studies from ParisFog
Pratapaditya Ghosh, Ian Boutle, Paul Field, Adrian Hill, Anthony Jones, Marie Mazoyer, Katherine J. Evans, Salil Mahajan, Hyun-Gyu Kang, Min Xu, Wei Zhang, Noah Asch, and Hamish Gordon
Atmos. Chem. Phys., 25, 11129–11156, https://doi.org/10.5194/acp-25-11129-2025,https://doi.org/10.5194/acp-25-11129-2025, 2025
Short summary
Adiabatic and radiative cooling are both important causes of aerosol activation in simulated fog events in Europe
Pratapaditya Ghosh, Ian Boutle, Paul Field, Adrian Hill, Marie Mazoyer, Katherine J. Evans, Salil Mahajan, Hyun-Gyu Kang, Min Xu, Wei Zhang, and Hamish Gordon
Atmos. Chem. Phys., 25, 11157–11182, https://doi.org/10.5194/acp-25-11157-2025,https://doi.org/10.5194/acp-25-11157-2025, 2025
Short summary
Assessing modifications to the Abdul-Razzak and Ghan aerosol activation parameterization (version ARG2000) to improve simulated aerosol–cloud radiative effects in the UK Met Office Unified Model (UM version 13.0)
Pratapaditya Ghosh, Katherine J. Evans, Daniel P. Grosvenor, Hyun-Gyu Kang, Salil Mahajan, Min Xu, Wei Zhang, and Hamish Gordon
Geosci. Model Dev., 18, 4899–4913, https://doi.org/10.5194/gmd-18-4899-2025,https://doi.org/10.5194/gmd-18-4899-2025, 2025
Short summary
The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation
Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich
Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022,https://doi.org/10.5194/gmd-15-9031-2022, 2022
Short summary

Cited articles

Anderson, T. W.: On the Distribution of the Two-Sample Cramer-von Mises Criterion, Ann. Math. Statist., 33, 1148–1159, https://doi.org/10.1214/aoms/1177704477, 1962. a
Baker, A. H., Hammerling, D. M., Levy, M. N., Xu, H., Dennis, J. M., Eaton, B. E., Edwards, J., Hannay, C., Mickelson, S. A., Neale, R. B., Nychka, D., Shollenberger, J., Tribbia, J., Vertenstein, M., and Williamson, D.: A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0), Geosci. Model Dev., 8, 2829–2840, https://doi.org/10.5194/gmd-8-2829-2015, 2015. a, b, c, d
Benjamini, Y. and Hochberg, Y.: Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing, Journal of the Royal Statistical Society: Series B (Methodological), 57, 289–300, https://doi.org/10.1111/j.2517-6161.1995.tb02031.x, 1995. a, b, c, d, e
Benjamini, Y. and Yekutieli, D.: The control of the false discovery rate in multiple testing under dependency, The Annals of Statistics, 29, 1165–1188, https://doi.org/10.1214/aos/1013699998, 2001. a, b
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., and Tian, Q.: Accurate medium-range global weather forecasting with 3D neural networks, Nature, 610, 87–93, 2022. a
Download
Short summary
Building numerical models of the Earth is a complex task that scientists and engineers around the world work on. It is important that results are repeatable accurately to help advance science. This study uses a statistical method to reduce errors when comparing two sets of simulations to see if they agree with each other. This approach helps identify if changes made to the model's code result in unexpected or unintended effects.
Share
Altmetrics
Final-revised paper
Preprint