PDSI

50 %
50 %
Information about PDSI
Entertainment

Published on November 21, 2007

Author: Dixon

Source: authorstream.com

PETASCALE DATA STORAGE INSTITUTE:  PETASCALE DATA STORAGE INSTITUTE The Drive to Petascale Computing Faster computers need more data, faster. -- 2001: 10 TF -- 2005: 100 TF -- 2008: 1 PF -- 2011: 10 PF 2015: 100 PF -- PDSI Thrusts: Data Capture Education & Dissemination Innovation Everything Must Scale with Compute Checkpoint at Terabytes/sec Petabyte files Billions of files Revisit programming for Input/Output Data center automation Acceleration for search Computing Speed Parallel I/O Network Speed Memory Archival Storage TFLOP/s GigaBytes/sec Gigabits/sec 1 2.5 25 250 TeraBytes 2,500 .5 5 50 5 50 500 5,000 5 500 50 .5 ‘00 ‘04 ‘08 2012 Year Disk PetaBytes .05 .5 5 50 Metadata Inserts/sec 200 200 20,000 2,000 500 GigaBytes/sec Application Performance Steeped in Terascale Experience:  Steeped in Terascale Experience Seaborg & GPFS PETASCALE DATA STORAGE INSTITUTE PETASCALE DATA STORAGE INSTITUTE:  PETASCALE DATA STORAGE INSTITUTE Peta-Bytes Tera-B/sec Giga-files Mega-CPUs Tera-Bytes Giga-B/sec Mega-files Kilo-CPUs Education & Dissemination Innovation Data Capture Education Workshops Tutorials Course materials Outreach Storage-research-list Collaboration w/ other Scidacs IT Automation Instrumentation Visualization Machine Learning Diagnosis Adaptation App Workloads INCITE resources Trace & replay tools (e.g. BLAST, CCSM, Calore, EVH1, MCNP, GYRO, Sierra, QCD and other Scidacs) API Standards POSIX API Rich metadata Compute-in-disk Archive API Quality of Storage Scaling Further Global/WAN access Federated security Metadata at scale Para-virtualization NFSv4 extended w/ layouts HPC NFS Parallel NFS Secure NFS IETF Standard Strategic Plan Failure Data Capture & publish Computer Failure Data Repository (e.g. LANL’s outages by root cause) Participating Organizations:  Carnegie Mellon University Garth Gibson (PI) University of California, Santa Cruz Darrell Long (co-PI) University of Michigan, Ann Arbor Peter Honeyman (co-PI) Los Alamos National Laboratory Gary Grider (co-PI) Lawrence Berkeley National Laboratory Bill Kramer (co-PI) Oak Ridge National Laboratory Philip Roth (co-PI) Pacific Northwest National Laboratory Evan Felix (co-PI) Sandia National Laboratory Lee Ward (co-PI) PETASCALE DATA STORAGE INSTITUTE Participating Organizations Programming for Storage:  Programming for Storage The Need for Training Programmers for Storage HPC IT managers work for users who program apps Often performance of apps/workflows dependent on storage Many times best solutions would be to change the program Reality is app specialists intolerant of requests to reprogram for better storage performance That is, reprogramming for storage performance often doesn’t get done Approach: Create tools, training to help a priori Give programmers libraries, performance debugging tools that avoid or detect poor storage patterns Give tutorials, case studies, help pages showing weak programming approaches and how to improve them PETASCALE DATA STORAGE INSTITUTE Example from BioInformatics:  Example from BioInformatics Pseudo code example from IT manager -- single thread for( I=0, I<1000, I++){ for( J=0, J<1000, J++){ buf = compute (I,J); f = open( “file_foo”); lseek(f, offset(I,J)); write(f, buf, lengthof(buff)) close(f); }} Buf turns out to be small, unaligned, fixed length Obvious fixes: Open/close outside both loops Malloc sizeof 1000000*lengthof(buff), copy into it in memory, one write at end PETASCALE DATA STORAGE INSTITUTE

Add a comment

Related presentations

Related pages

SOLEX 30PDSI + 35PDSI + 35PDSIT Vergaser Opel, Hanomag ...

Solex - Vergaser 35 PDSI , 30PDSI , 32PDSI , 32PDSI , 35PDSI Hanomag OPEL Rallye Kadett 1100 . 1600 / 54PS + 1800 / 70PS : Service ...
Read more

Palmer Drought Severity Index (PDSI)

Main References: Dai, A., K. E. Trenberth, and T. Qian, 2004: A global data set of Palmer Drought Severity Index for 1870-2002: Relationship with soil ...
Read more

PDSI

About PDSI Meet the Team. Turning Complex Challenges Into Innovative Solutions.
Read more

PDSI Construction Consultants | Combining Management ...

PDSI add value through collaboration, innovation and integration with clients and supply chain to deliver best practice solutions within a dynamic global ...
Read more

Privileg Teilintegrierbarer Einbau-Geschirrspüler PDSI ...

Küchenmaschinen und selbstverständlich Privileg Teilintegrierbarer Einbau-Geschirrspüler PDSI Edition 50, A++, 6 Liter, 13 Maßgedecke erspähen Sie ...
Read more

Palmer Drought Severity Index (PDSI) | NCAR - Climate Data ...

The Palmer Drought Severity Index (PDSI) uses readily available temperature and precipitation data to estimate relative dryness. It is a standardized index ...
Read more

Solex Vergaser Opel | eBay

Solex Vergaser 35 PDSI 2891 503 A Opel Rekord C Kadett B C CIH 1,5 1,7 1,9 l. EUR 245,00. Sofort-Kaufen + EUR 5,00 Versand.
Read more

Palmer drought index - Wikipedia

The Palmer drought index, sometimes called the Palmer drought severity index and often abbreviated PDSI, is a measurement of dryness based on recent ...
Read more

Solex Vergaser günstig online kaufen bei eBay

Original 2 Vergaser Anlage Solex 30 PDSI Opel Rallye Kadett 1,1 SR 3441045A 046A. EUR 579,90. Sofort-Kaufen. oder Preisvorschlag + EUR 7,99 Versand.
Read more

Distribution Software | Home

Protrac is a Wholesale Distribution ERP Software with Accounting, CRM, Order Entry, Purchasing, and Inventory Management for small to mid-sized businesses.
Read more