Parallelization of Diagnostics for Climate Model Development
- 1 Lawrence Livermore National Laboratory, Livermore, California, USA
- 2 Lawrence Livermore National Laboratory, Livermore, California, USA
- 3 University of Utah, Salt Lake City, Utah, USA
- 4 Lawrence Livermore National Laboratory, Livermore, California, USA
- 5 Lawrence Livermore National Laboratory, Livermore, California, USA
- 6 Lawrence Livermore National Laboratory, Livermore, California, USA
- 7 Oak Ridge National Laboratory, Oak Ridge, Tennessee, USA
- 8 Lawrence Livermore National Laboratory, Livermore, California, USA
- 9 Lawrence Livermore National Laboratory, Livermore, California, USA
Abstract
The parallelization of the diagnostics for climate research has been an important goal in the performance testing and improvement of the diagnostics for the Department of Energy’s (DOE’s) Accelerated Climate Modeling for Energy (ACME) project [1]. The primary mission of the ACME project is to build and test the next-generation Earth system model for current and future generations of computing systems operated by the DOE office of science computing facilities, including the envisioned exascale systems foreseen in the early part of the next decade. As part of the underpinning workflow environment, a diagnostics, model metrics, and intercomparison Python framework, called UVC Metrics was created to aid in testing and production execution of the model. This framework builds on common methods and similar metrics to accommodate and diagnose individual component models, such as atmosphere, land, ocean, sea ice, and land ice. This paper reports on initial parallelization of UVC Metrics for the atmosphere model component using two popular frameworks: MPI and SPARK. A timing study is presented to assess the performance of each method in which significant improvement was achieved for both frameworks despite I/O contentions with NFS. The advantages and disadvantages of each framework are also presented.
- ACME Council (2014) Accelerated Climate Modeling for Energy: Project Strategy and Initial Implementation Plan. ACME Council, Department of Energy, 25 p. http://climatemodeling.science.energy.gov/sites/default/files/publications/acme-project-strategy-plan.pdf
- Overpeck, J.T., Meehl, G.A., Bony, S. and Easterling, D.R. (2011) Climate Data Challenges in the 21st Century. Science, 331, 700-702. http://dx.doi.org/10.1126/science.1197869
- Meehl, G.A., Moss, R., Taylor, K.E., Eyring, V., Stouffer, R.J., Bony, S. and Stevens, B. (2014) Climate Model Intercomparison: Preparing for the Next Phase. Eos, Transactions American Geophysical Union, 95, 77-78. http://dx.doi.org/10.1002/2014EO090001
- Taylor, K.E., Stouffer, R.J. and Meehl, G.A. (2012) An Overview of CMIP5 and the Experiment Design. Bulletin of the American Meteorological Society, 93, 485-498. http://dx.doi.org/10.1175/BAMS-D-11-00094.1
- Williams, D.N., Lautenschlager, M., Balaji, V., Cinquini, L., DeLuca, C., Denvil, S., Duffy, D., Evans, B., Ferraro, R., Juckes, M. and Trenham, C. (2015) Strategic Roadmap for the Earth System Grid Federation. 2015 IEEE International Conference on Big Data, Santa Clara, 29 October-1 November 2015, 2182-2190. http://dx.doi.org/10.1109/BigData.2015.7364005
- Williams, D.N., Balaji, V., Cinquini, L., Denvil, S., Duffy, D., Evans, B., Ferraro, R., Hansen, R., Lautenschlager, M. and Trenham, C. (2016) A Global Repository for Planet-Sized Experiments and Observations. Bulletin of the American Meteorological Society, 97.
- Williams, D.N. (2016) Better Tools to Build Better Climate Models. Eos, 97.
- Santos, E., Poco, J., Wei, Y. X., Liu, S.S., Cook, B., Williams, D.N., et al. (2013) UV-CDAT: Analyzing Climate Datasets from a User’s Perspective. Computing in Science & Engineering, 15, 94-103. http://dx.doi.org/10.1109/MCSE.2013.15
- Gropp, W., Lusk, E. and Skjellum, A. (1996) A High-Performance, Portable Implementation of the MPI Message Passing Interface. Parallel Computing, 22, 789-828. http://dx.doi.org/10.1016/0167-8191(96)00024-5
- Snir, M., Otto, S.W., Huss-Lederman, S., Walker, D.W. and Dongarra, J.J. (1998) MPI—The Complete Reference: Volume 1, The MPI Core. MIT Press, Cambridge.
- Gropp, W., Huss-Lederman, S., Lumsdaine, A., Lusk, E., Nitzberg, B., Saphir, W. and Snir, M. (1998) MPI—The Complete Reference: Volume 2, The MPI-2 Extensions. MIT Press, Cambridge.