An HDF5-WRF module

50 %
50 %
Information about An HDF5-WRF module
Technology

Published on February 19, 2014

Author: HDFEOS

Source: slideshare.net

Description

The Weather Research Forecast (WRF) model developed at NCAR is the community weather model. WRF is designed in such a way that it has standard configuration and IO common APIs to enable external IO packages to be easily added to. An application can select which IO module to use. The current WRF software package supports a netCDF WRF IO module.

This talk presents a new HDF5 WRF IO modules, The Parallel HDF5-WRF uses the parallel HDF5 library, which is implemented with MPI IO. Performance studies show that this module can improve performance for computations with large IO requirements. The sequential HDF-WRF module can support in memory compression that can save disk space.

An HDF5-WRF module MuQun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign

What is WRF? • Weather Research and Forecasting Model – Framework for Weather Model Community • Primarily uses sequential I/O with NetCDF

Goal • Provide an optional HDF5 IO module for WRF • Investigate IO performance of WRF

Results • Map WRF data model to HDF5 • Implemented two WRF IO modules – Sequential IO module with compression – Parallel IO module – Parallel IO module is include in WRF distribution • Performance studies – Presented to WRF workshop, conferences

Findings 1. Parallel HDF5-WRF module can greatly reduce wall clock time in some WRF applications. 2. Sequential HDF5-WRF module can greatly reduce the WRF file size with szip or shuffling and deflate compression algorithms. 3. Parallel HDF5 library needs to be improved for chunking storage.

Impact • Parallel HDF5 WRF I/O is available to modelling community – Included in WRF 2.0 source distribution (May 2004) • This investigation has led to improvements in Parallel HDF5

For more information • HDF5 WRF IO: http://hdf.ncsa.uiuc.edu/apps/WRF-ROMS • WRF: http://www.wrf-model.org/

Acknowledgements • This work is part of NSF-funded Modeling Environment for Atmospheric Discovery Expedition (MEAD) (http://www.ncsa.uiuc.edu/AboutUs/Focus Areas/MEADExpedition.html)

Add a comment

Related presentations

Related pages

⚡Presentation "An HDF5-WRF module -A performance report ...

An HDF5-WRF module -A performance report MuQun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University of Illinois,
Read more

Problem with HDF5? - WRF User's Forum • Index page

The WRF User's Forum. An active forum dedicated to helping support the Weather Research and Forecast Model's developers and users alike.
Read more

HDF5 PowerPoint PPT Presentations - View millions of ...

View Hdf5 presentations online, ... Java (with ION), ActiveX. IDL. The IDL HDF5 Module ... An HDF5-WRF module - Implemented two WRF IO modules.
Read more

ATMOSPHERIC SCIENCES AND CLIMATE APPLICATIONS USING HDF ...

IO module, which has two limitations. First, the IO module may become an IO bottleneck and may exceed memory capacity in some applications.
Read more

A Proposal to Provide HDF Support for

Mike Folk, NCSA/University of Illinois November 12, 2004. Introduction. The year 2004 was the final year of a three-year project to provide HDF support for ...
Read more

luka's Presentations on SlideServe

An HDF5-WRF module -A p... 57 views. Implementing an Interfac... 50 views. Kurssin hinta/hlö: 12... 48 views. Políticas Públicas Pro... 50 views. Load ...
Read more

external/io_phdf5/wrf-phdf5.F90

The HDF5 WRF IO module was written by the the HDF Group at NCSA, the * 3: !* National ... This module contains all necessary modules 1390: ...
Read more

WRF/MM5 Users' Workshop - Working Agenda - The Weather ...

WRF/MM5 Joint Workshop - Working Agenda. Physics Development and Testing. Dudhia, Jimy oral ... TITLE: performance study of HDF5-WRF IO module AUTHORS: ...
Read more