advertisement

Grid Projects In The US July 2008

50 %
50 %
advertisement
Information about Grid Projects In The US July 2008

Published on July 15, 2008

Author: ianfoster

Source: slideshare.net

Description

A talk given at the HPC 2008 meeting in Cetraro, Italy
advertisement

Grid Projects in the US (an inevitably incomplete view) Ian Foster Computation Institute Argonne National Lab & University of Chicago

Grid Projects in the US Resources Resource Provider Resource Provider Resource Provider

Grid Projects in the US Service Provider Service Provider Service Provider Services Resources Resource Provider

Grid Projects in the US Community Community Community Service Provider Content Services Resources Resource Provider Software Providers

Grid Projects in the US Community Service Provider Content Services Resources Software Providers Resource Provider

Resource Providers Campus and regional grids Purdue, Wisc, UCLA, …, … TIGRE, UC system, … Open Science Grid 43,000 CPUs, 6 PB disk, 15,000 CPU days/day Allocations on basis of MOUs TeraGrid ~ 1.2 Pflop/s National Allocation Committee Amazon, Microsoft, IBM, etc. ?? CPUs, ?? storage Fee for service

Campus and regional grids

Purdue, Wisc, UCLA, …, …

TIGRE, UC system, …

Open Science Grid

43,000 CPUs, 6 PB disk, 15,000 CPU days/day

Allocations on basis of MOUs

TeraGrid

~ 1.2 Pflop/s

National Allocation Committee

Amazon, Microsoft, IBM, etc.

?? CPUs, ?? storage

Fee for service

Open Science Grid Sites (5/4/08) +3 in Brazil; 2 in Mexico; 2 in Taiwan; 1 in the UK. Grows by 10-20 per year.

Use by Community CMS ATLAS CDF Local Usage & bugs (unmapped to VO) D0 2,000,000 a week 1,000,000 a week

TeraGrid Participants

Growing User Community Source: TeraGrid Central Database

Growing Usage Source: TeraGrid Central Database 3.95B NUs delivered in CY2007

CY2007 Usage by Discipline 3.95B NUs delivered in CY2007 Molecular Biosciences 31% Chemistry 17% Physics 17% Astronomical Sciences 12% Materials Research 6% Earth Sciences 3% All 19 Others 4% Advanced Scientific Computing 2% Atmospheric Sciences 3% Chemical, Thermal Systems 5%

Grid Projects in the US For example: Build and test service (Wisc) Certificate Authorities Cancer Biology Informatics Grid LIGO Data Grid Community Service Provider Content Services Resources Software Providers Resource Provider Service Provider

For example:

Build and test service (Wisc)

Certificate Authorities

Cancer Biology Informatics Grid

LIGO Data Grid

caBIG: sharing of infrastructure, applications, and data. Data Integration! Services & Cancer Biology Globus

caBIG Under the Covers NCICB Research Center Grid-Enabled Client Research Center Tool 1 Tool 2 Tool 3 Tool 4 Grid Data Service Analytical Service Grid Portal Microarray Gene Database caArray Protein Database Image Tool 2 Tool 3 Grid Services Infrastructure (Metadata, Registry, Query, Invocation, Security, etc.) Globus

LIGO Data Grid Birmingham • Replicating >1 Terabyte/day to 8 sites 770 TB replicated to date: >120 million replicas MTBF = 1 month LIGO Gravitational Wave Observatory Ann Chervenak et al., ISI; Scott Koranda et al, LIGO Cardiff AEI/Golm Globus

Cardiff

Grid Projects in the US For example: Earth System Grid Children’s Oncology Grid Southern California Earthquake Center (SCEC) Science gateways Community Service Provider Content Services Resources Software Providers Resource Provider Community

For example:

Earth System Grid

Children’s Oncology Grid

Southern California Earthquake Center (SCEC)

Science gateways

Earth System Grid Main ESG Portal CMIP3 (IPCC AR4) ESG Portal 198 TB of data at four locations 1,150 datasets 1,032,000 files Includes the past 6 years of joint DOE/NSF climate modeling experiments 35 TB of data at one location 74,700 files Generated by a modeling campaign coordinated by the Intergovernmental Panel on Climate Change Data from 13 countries, representing 25 models 8,000 registered users 1,900 registered projects Downloads to date 49 TB 176,000 files Downloads to date 387 TB 1,300,000 files 500 GB/day (average) 400 scientific papers published to date based on analysis of CMIP3 (IPCC AR4) data ESG usage: over 500 sites worldwide ESG monthly download volumes Globus

198 TB of data at four locations

1,150 datasets

1,032,000 files

Includes the past 6 years of joint DOE/NSF climate modeling experiments

35 TB of data at one location

74,700 files

Generated by a modeling campaign coordinated by the Intergovernmental Panel on Climate Change

Data from 13 countries, representing 25 models

Downloads to date

49 TB

176,000 files

Downloads to date

387 TB

1,300,000 files

500 GB/day (average)

SCEC Community Modeling Environment Pathway Instantiations Knowledge Base Ontologies Curated taxonomies, Relations & constraints Pathway Models Pathway templates, Models of simulation codes Code Repositories Data & Simulation Products Data Collections FSM RDM AWM SRM Storage GRID Pathway Execution Policy, Data ingest, Repository access Grid Services Compute & storage management, Security DIGITAL LIBRARIES Navigation & Queries Versioning, Replication Mediated Collections Federated access KNOWLEDGE ACQUISITION Acquisition Interfaces Dialog planning, Pathway construction strategies Pathway Assembly Template instantiation, Resource selection, Constraint checking KNOWLEDGE REPRESENTATION & REASONING Knowledge Server Knowledge base access, Inference Translation Services Syntactic & semantic translation Computing Users A collaboratory for system-level earthquake science Globus

Seismic Hazard Analysis Defn: Max. intensity of shaking expected at a site during a fixed time interval Example: National seismic hazard maps Intensity measure: peak ground acceleration Interval: 50 yrs Probability of exceedance: 2% (http://geohazards.cr.usgs.gov/eq/) Globus

Defn: Max. intensity of shaking expected at a site during a fixed time interval

Example: National seismic hazard maps

Intensity measure: peak ground acceleration

Interval: 50 yrs

Probability of exceedance: 2%

SCEC Computations & Grid Prepare input to Pathway2 wave propagation code Pathway2PGV converts output into hazard map Map is visualized SDSC USC SCEC PSC TeraGrid ISI 12 CPUs 1,700 CPUs 1,200 CPUs 1 CPU 4 CPUs Globus

Prepare input to Pathway2 wave propagation code

Pathway2PGV converts output into hazard map

Map is visualized

Children’s Oncology Grid and MEDICUS Globus

Grid Projects in the US Community Service Provider Content Services Resources Resource Provider Software Providers

Software Providers Globus [GT4.2 released July 2, 2008] GRAM, GridFTP, MDS, RLS, DRS, … GSI, GridShib, MyProxy, … GridWay (Spain), OGSA-DAI (UK), Introduce, … Condor MPI-G, Swift, Pegasus, Taverna (UK), Kepler caBIG: e.g., Introduce Virtual Data Toolkit (includes VOMS [Italy], …) SRB, iRODS, MyCluster, … … Globus

Globus [GT4.2 released July 2, 2008]

GRAM, GridFTP, MDS, RLS, DRS, …

GSI, GridShib, MyProxy, …

GridWay (Spain), OGSA-DAI (UK), Introduce, …

Condor

MPI-G, Swift, Pegasus, Taverna (UK), Kepler

caBIG: e.g., Introduce

Virtual Data Toolkit (includes VOMS [Italy], …)

SRB, iRODS, MyCluster, …



Virtual Data Toolkit (VDT) Software Release Process VDT components over time: built for 15 Linux Versions Development & testing Globus

Creating Services: Introduce and gRAVI Introduce Define service Create skeleton Discover types Add operations Configure security Grid R emote A pplication V irtualization Infrastructure Wrap executables Index service Repository Service Introduce Container Ohio State University and Argonne/U.Chicago Appln Service Create Store Advertize Discover Invoke; get results Transfer GAR Deploy Globus

Introduce

Define service

Create skeleton

Discover types

Add operations

Configure security

Grid R emote A pplication V irtualization Infrastructure

Wrap executables

Composing Services Globus

Service Discovery: Registries Globus

Challenges Community Community Community Service Provider Content Services Resources Resource Provider Software Providers Conflicting Missions Sustainability Discipline science pull

The Future NSF eXtreme Digital (XD) solicitation Aka “TeraGrid III” DOE, NIH, etc.—what do they want? International cooperation

NSF eXtreme Digital (XD) solicitation

Aka “TeraGrid III”

DOE, NIH, etc.—what do they want?

International cooperation

Add a comment

Related pages

Smart Grid Information Clearinghouse (SGIC)

Smart Grid Projects. The SGIC smart grid project page archives smart grid projects in the United States. Use the filter below to browse the smart grid ...
Read more

2008 - Wikipedia, the free encyclopedia

2008 was a leap year ... over the Indo-US nuclear deal. July 23 – Ram Baran Yadav is sworn in as the first President of Nepal. ... 2008 Calendar at ...
Read more

Uraguay Brazil Electrical Interconnection Project

Power Technology July 2008 Page 2 authority, securing of funding from both Uruguay and Brazil, etc.).
Read more

Smart Grid | Department of Energy

Smart grid generally refers to a class of technology people ... Experiences from Six SGIG Projects (December 2014) Smart Grid Investments ... July 2012 ...
Read more

smart grid

... to modernize the electric power grid. Learn about the projects that utilized these investments to deploy smart grid technologies and their ...
Read more

National Grid - News

... National Grid Employees Do Earth Day In A Big Way Volunteers support local community projects, ... News Releases by Year
Read more

the SMART GRID - US Department of Energy

One afternoon in early 2008, ... enabled by the Smart Grid. This project will ... and innovation that drive the Smart Grid. He might even ask what took us ...
Read more

States Providing for Smart Metering - Legislative News ...

July 2008: The PUC issued an ... of Commonwealth Edison’s smart grid project, ... policy on smart grid infrastructure including employment of a smart ...
Read more

Financial incentives for photovoltaics - Wikipedia, the ...

Financial incentives for photovoltaics are ... solar projects was issued, and is about US$0 ... connected to the grid. Projects with a ...
Read more