Google Techtalk 2006

New Frontiers in Astronomy Hubble and Beyond C. A. Christian and A. Conti Space Telescope Science Institute

 

Visible – Hubble Space Telescope Gamma rays - Compton Gamma Ray Obs. X-rays - Chandra X-ray Observatory Infrared - Spitzer Space Telescope

Visible – Hubble Space Telescope

Gamma rays - Compton Gamma Ray Obs.

X-rays - Chandra X-ray Observatory

Infrared - Spitzer Space Telescope

A New Era in Astronomy 1960: astronomical data goes digital New instruments collect 100s of GB/night Detectors follow Moore’s law Data avalanche: double every 2 years Growth over 25 years is a factor of 30 in collecting area, 3000 in pixels. Courtesy of Alex Szalay CCD area mpixels 3+ M telescopes area m^2

1960: astronomical data goes digital

New instruments collect 100s of GB/night

Detectors follow Moore’s law

Data avalanche: double every 2 years

UDF

Tadpole

 

Egg Nebula

Cat’s Eye

Hodge301/Trantula

Light Echo

 

Sombrero

Sombrero IR

Sombrero composite

Orion Nebula

 

M101

 

Pillars in the Eagle Nebula

Public Outreach Collaborations Astronomical Data & Image Collection Public Info Informal Science News K-14 College/Univ Museums/ Planetaria

Public Data Access Many observatories Individual interfaces User Mission A Mission B Mission C Observatory X Observatory Y

Many observatories

Individual interfaces

The Virtual Observatory Data Standards Related tools Mission A Mission B Mission C Observatory X Observatory Y User VO

Data Standards

Related tools

Press Release Collection Image Collection Registry: image collection description NVO Other astronomy registries Protocol: NVO simple access image protocol Recover coordinates Traceback to original data Automate process

Protocol: NVO simple access image protocol

Image WCS Recovery Press image Find data and select strongest filter detection (R, H  , etc.) Combine several and clean wcs.compute uses identified objects in each image Voila - WCS! Backup slide

Collaboration: CLEA Virtual Education Observatory Gettysburg College Students choose part of sky to “observe” Collect data from telescope/ instrument Perform simple photometric data analysis

Gettysburg College

Students choose part of sky to “observe”

Collect data from telescope/ instrument

Perform simple photometric data analysis

Sloan Digital Sky Interface

NVO Datascope Interface

Hubble Sky Coverage Map

DSS, SDSS, 2MASS, GALEX,…

NASA Data Centers MAST: Multimission Archive at STScI HEASARC: High Energy Astrophysics Science Archive Research Center IRSA: Infrared Science Archives LAMBDA: Legacy Archive for Microwave Background Data Analysis MSC: Michelson Science Center NASA ADS: Astrophysics Data System NED: NASA Extragalactic Database

MAST: Multimission Archive at STScI

HEASARC: High Energy Astrophysics Science Archive Research Center

IRSA: Infrared Science Archives

LAMBDA: Legacy Archive for Microwave Background Data Analysis

MSC: Michelson Science Center

NASA ADS: Astrophysics Data System

NED: NASA Extragalactic Database

The Age of Large Surveys Large number of new surveys multi-TB in size, 100 million objects or more individual archives planned, or under way Data publication an integral part of the survey Multi-wavelength view of the sky Impressive early discoveries

Large number of new surveys

multi-TB in size, 100 million objects or more

individual archives planned, or under way

Data publication an integral part of the survey

Multi-wavelength view of the sky

Impressive early discoveries

Data Volume Astronomers have ~ Petabytes online now. Mine for new or interesting objects in a 400-D space Positions, brightness, color, type, size, etc… Data doubles every 2 years Publishing data Providing good visualization and query tools

Astronomers have ~ Petabytes online now.

Mine for new or interesting objects in a 400-D space

Positions, brightness, color, type, size, etc…

Data doubles every 2 years

Publishing data

Providing good visualization and query tools

International Virtual Observatory Alliance

Data Formats: FITS FITS: Flexible Image Transport System Standard astronomical binary data format Composed of a sequence of Header Data Units (HDUs) keyword=value statements, describe the organization of the data in the HDU and the format of the contents HDU may contain a digital image, tables and multidimensional matrices

FITS: Flexible Image Transport System

Standard astronomical binary data format

Composed of a sequence of Header Data Units (HDUs)

keyword=value statements, describe the organization of the data in the HDU and the format of the contents

HDU may contain a digital image, tables and multidimensional matrices

Data Formats: VOTable XML format for tabular information Catalog query results List of images or spectra List of resources

XML format for tabular information

Catalog query results

List of images or spectra

List of resources

World Coordinate System Coordinate Systems: Galactic, Ecliptic, J2000 Equatorial, B1950 Equatorial WCS Projections: LIN, TAN, SIN, STG, AZP, ARC, ZPN, ZEA, AIR, CYP, CAR, MER, CEA, COP, COD, COE, COO, BON, PCO, SFL, PAR, AIT, MOL, CSC, TSC, DSS, PLT

Coordinate Systems: Galactic, Ecliptic, J2000 Equatorial, B1950 Equatorial

WCS Projections: LIN, TAN, SIN, STG, AZP, ARC, ZPN, ZEA, AIR, CYP, CAR, MER, CEA, COP, COD, COE, COO, BON, PCO, SFL, PAR, AIT, MOL, CSC, TSC, DSS, PLT

ZIP Code in the Sky (HTM)

NVO Protocols SOAP Web Services Cone search Simple query around a given region Simple image access Create an image of this region. First step produces VOTables with links to image User downloads images as FITS in second stage SkyNode Sophisticated access to tables Supports distributed queries Uses ADQL Should eventually subsume Cone-search

Cone search

Simple query around a given region

Simple image access

Create an image of this region.

First step produces VOTables with links to image

User downloads images as FITS in second stage

SkyNode

Sophisticated access to tables

Supports distributed queries

Uses ADQL

Should eventually subsume Cone-search

Resources Registry Collection of resources that users can find Registry-registry communication via OAI Some publishing registries are meant to be seen only by other registries

Registry

Collection of resources that users can find

Registry-registry communication via OAI

Some publishing registries are meant to be seen only by other registries

 

GALEX SQL Form

Sloan Digital Sky Interface

Challenges 41,253 square degrees 2 Trillion pixels One wavelength 4 Terabytes Multi-wavelength 10-100 Terabytes Time dimension 10 Petabytes Hard to publish data & programs Hard to find/understand data & programs New analysis & visualization tools are required Transition to the new astronomy Sociological issues

41,253 square degrees 2 Trillion pixels

One wavelength 4 Terabytes

Multi-wavelength 10-100 Terabytes

Time dimension 10 Petabytes

Hard to publish data & programs

Hard to find/understand data & programs

New analysis & visualization tools are required

Transition to the new astronomy

Sociological issues

Contact Information Carol Christian [email_address] Alberto Conti [email_address]

Carol Christian [email_address]

Alberto Conti [email_address]