An HDF-EOS Data Server Based on OPeNDAP and ECHO

60 %
40 %
Information about An HDF-EOS Data Server Based on OPeNDAP and ECHO

Published on February 19, 2014

Author: HDFEOS



We describe a data server for publishing HDF-EOS datasets to the web. This system makes HDF-EOS datasets:

o Findable - the datasets are visible on the web to their intended users, both in generic web search engines and in domain-specific search tools like ECHO.
o Browseable - each dataset has a web page associated with it that displays its metadata readably, and has links to allow fetching the data.
o Retrievable - for each dataset, there is a way to retrieve:
- The whole dataset
- Just the metadata
- Individual fields from the dataset
- Partial, sectorized data from fields

An HDF-EOS Data Server Based on OPeNDAP and ECHO Bob Bane, Mohammad Rabi, Weijun Su, Richard Ullman, Jingli Yang, Zhangshi Yin Data Usability Group, NASA/GSFC

HDF-EOS data access via web • Findable – With standard search engines – With domain-specific engines • Browseable – Per-granule web page • Readable metadata • Links for fetching data • Retrievable – – – – Whole dataset Metadata only Individual fields Sectorized fields

Intended Audience • Groups that are generating HDF-EOS products • Need a straightforward, inexpensive way to publish them to the web • Major archives already have their own systems - this is for everyone else

Tools used • Standard tools – Unix shell scripts – Apache web server • Earth science standards and protocols – OPeNDAP – ECHO • Our tools – ODL <-> XML <-> HTML

OPeNDAP • “netCDF via HTTP” • Also works for HDF 4/5 and HDF-EOS 2/5 •

ECHO • EOS ClearingHouse • Searchable repository for earth science metadata • Based on standard commercial tools – Databases – E-commerce middleware •

Our Tools • hemu - extracts ODL metadata • odl2xml - converts ODL to EOScompatible XML • heex - breaks an HDF-EOS dataset into field files with an HTML/XML table of contents • XSLT stylesheets - convert XML to pretty HTML

OPeNDAP server HDF_EOS files hemu Fetch/sectorize heex DODS client ODL metadata odl2xml XML contents Field files Web server Web browser Browse/fetch ECHO client XML metadata XSLT Pretty HTML XSLT Search engines ECHO XML Implemented by us ECHO server Other tools Search/query File transfer Web/HTTP Client-side services

Installation • Foundation – Unix – Apache – Java • Libraries – HDF4/5, HDF-EOS2/5 – SDP Toolkit – OPeNDAP server • Our software – heex, odl2xml, hemu – heserve scripts

Use • Two shell scripts – ingest granule-file.hdf • Publishes granule to the web – echoingest metadata.xml • Publishes web links for granule to ECHO • Optionally called by ingest

Granule Web Pages

Granule Web Pages

Granule Web Pages

Granule Web Pages

Screen shot Showing link dragged into DODS client

Where is the software? ’Tools’ link heserve system

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Agenda - HDF and HDF-EOS Workshop VIII

HDF and HDF-EOS Workshop VIII. October 26-28, 2004 Aurora, Colorado. Agenda. ... An HDF-EOS Data Server Based on OpenDAP and ECHO: Abstract: Presentation ...
Read more

OPeNDAP - Wikipedia, the free encyclopedia

The protocol is based on HTTP and the ... free reference implementations of OPeNDAP servers and ... OPeNDAP server for gridded and tabular data; ...
Read more

PPT – Audio Steganography Echo Data Hiding PowerPoint ...

An HDF-EOS Data Server Based on OPeNDAP and ECHO - Bob Bane, Mohammad Rabi, ... "Audio Steganography Echo Data Hiding" is the property of its rightful owner.
Read more

EPIC- Software - dapper: An OPeNDAP Server for in-situ data

What is dapper? Dapper is an OPeNDAP/Java-based web server ... The major strength of previous OPeNDAP-enabled data servers has ...
Read more

Data Server - HYCOM provides access to near real time global HYCOM + NCODA based ... org servers for additional processing. Daily data is ... OPeNDAP enabled clients ...
Read more

About Software Downloads | OPeNDAP

On this page you will find background information about the software we have ... from any OPeNDAP server and import data ... based interface to our ...
Read more

NASA - GSFC Open Source Software

Software; A set of programs ... Publish the HTML and the original HDF-EOS file to a web server and an OPeNDAP ... of how to work with HDF-EOS data produced ...
Read more

HDF-EOS, Hierarchical Data Format-Earth Observing System ...

... (HDF-EOS), based on HDF Version 4: Description: ... The OPenDAP project supports HDF-EOS data access through the HDF4 handler in its Hyrax software.
Read more

QuickStart - OPeNDAP Documentation

QuickStart. From OPeNDAP ... OPeNDAP data are HDF-EOS, EPIC, FGDC, ... But there are several other ways to find data served by OPeNDAP servers. 2.1 GCMD.
Read more

Hyrax Data Server | OPeNDAP

Hyrax Data Server Hyrax is the next generation server from OPeNDAP. ... A prototype SOAP interface for OPeNDAP data services.
Read more