Published on February 19, 2014
An HDF5-WRF module MuQun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign
What is WRF? • Weather Research and Forecasting Model – Framework for Weather Model Community • Primarily uses sequential I/O with NetCDF
Goal • Provide an optional HDF5 IO module for WRF • Investigate IO performance of WRF
Results • Map WRF data model to HDF5 • Implemented two WRF IO modules – Sequential IO module with compression – Parallel IO module – Parallel IO module is include in WRF distribution • Performance studies – Presented to WRF workshop, conferences
Findings 1. Parallel HDF5-WRF module can greatly reduce wall clock time in some WRF applications. 2. Sequential HDF5-WRF module can greatly reduce the WRF file size with szip or shuffling and deflate compression algorithms. 3. Parallel HDF5 library needs to be improved for chunking storage.
Impact • Parallel HDF5 WRF I/O is available to modelling community – Included in WRF 2.0 source distribution (May 2004) • This investigation has led to improvements in Parallel HDF5
For more information • HDF5 WRF IO: http://hdf.ncsa.uiuc.edu/apps/WRF-ROMS • WRF: http://www.wrf-model.org/
Acknowledgements • This work is part of NSF-funded Modeling Environment for Atmospheric Discovery Expedition (MEAD) (http://www.ncsa.uiuc.edu/AboutUs/Focus Areas/MEADExpedition.html)
An HDF5-WRF module -A performance report MuQun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University of Illinois,
The WRF User's Forum. An active forum dedicated to helping support the Weather Research and Forecast Model's developers and users alike.
View Hdf5 presentations online, ... Java (with ION), ActiveX. IDL. The IDL HDF5 Module ... An HDF5-WRF module - Implemented two WRF IO modules.
IO module, which has two limitations. First, the IO module may become an IO bottleneck and may exceed memory capacity in some applications.
Mike Folk, NCSA/University of Illinois November 12, 2004. Introduction. The year 2004 was the final year of a three-year project to provide HDF support for ...
An HDF5-WRF module -A p... 57 views. Implementing an Interfac... 50 views. Kurssin hinta/hlö: 12... 48 views. Políticas Públicas Pro... 50 views. Load ...
The HDF5 WRF IO module was written by the the HDF Group at NCSA, the * 3: !* National ... This module contains all necessary modules 1390: ...
WRF/MM5 Joint Workshop - Working Agenda. Physics Development and Testing. Dudhia, Jimy oral ... TITLE: performance study of HDF5-WRF IO module AUTHORS: ...