Workflow-Based Platform Design and Implementation for Numerical Weather Prediction Models and Meteorological Data Service
- 1 National Meteorological Information Center, China Meteorological Administration, Beijing, China
- 2 Ministry of Education Key Laboratory for Earth System Modeling, Department of Earth System Science, and Joint Center for Global Change Studies (JCGCS), Tsinghua University, Beijing, China
- 3 National Meteorological Information Center, China Meteorological Administration, Beijing, China
Abstract
In this paper, we present a set of best practices for workflow design and implementation for numerical weather prediction models and meteorological data service, which have been in operation in China Meteorological Administration (CMA) for years and have been proven effective in reliably managing the complexities of large-scale meteorological related workflows. Based on the previous work on the platforms, we argue that a minimum set of guidelines including workflow scheme, module design, implementation standards and maintenance consideration during the whole establishment of the platform are highly recommended, serving to reduce the need for future maintenance and adjustment. A significant gain in performance can be achieved through the workflow-based projects. We believe that a good workflow system plays an important role in the weather forecast service, providing a useful tool for monitoring the whole process, fixing the errors, repairing a workflow, or redesigning an equivalent workflow pattern with new components.
- Zhao, L.C., Shen, W.H., Xiao, H.D., et al. (2016) The Application of High Performance Computing Technology in Meteorological Field. Journal of Applied Meteorological Science, 27, 550-558.
- dos Santos, D.R. (2017) Automatic Techniques for the Synthesis and Assisted Deployment of Security Policies in Workflow-based Applications, Ph.D. Thesis, University of Trento, Trento.
- Yudin, Y., Krasikova, T., Dorozhko, Y. and Currle-Linde, N. (2013) Modular Workflow System for HPC Applications, World Academy of Science, Engineering and Tchnology. International Journal of Computer, Electrical, Automation, Control and Information Engineering, 7, No. 2.
- Plóciennik, M., Winczewski, S. and Ciecielag, P. (2014) Tools, Methods and Services Enhancing the Usage of the Kepler-Based Scientific Workflow Framework. Procedia Computer Science, 29, 1733-1744. https://doi.org/10.1016/j.procs.2014.05.158
- https://software.ecmwf.int/wiki/display/ECFLOW/Tutorial
- Zhao, J., Zhang, Li.-L. and Song, J.-Q. (2010) Job-Level Parallel Implementation Method of Numerical Weather Prediction Post-Processing System. Journal of Computer Applcations, 30(Suppl.1), 241-242.
- Mahura, A., Petersen, C., Amstrup, B. and Sass, B.H. (2016) Post-Processing of NWP Models Forecasts: Case of Denmark and Greenland. Geophysical Research Abstracts, 18, EGU2016-10130.
- Hettne, K., Wolstencroft, K.J., Belhajjame, K. and Roos, M. (2012) Best Practices for Workflow Design: How to Prevent Workflow Decay. SWAT4LS, January 2012.
- Sub-Seasonal to Seasonal Prediction Project. http://www.s2sprediction.net/