TeraGrid's GRAM Auditing & Accounting, & its Integration with the LEAD Science Gateway

50 %
50 %
Information about TeraGrid's GRAM Auditing & Accounting, & its Integration with the LEAD...

Published on June 6, 2007

Author: marcuschristie

Source: slideshare.net

Description

I presented the few slides at the end about the LEAD project and integration with the GRAM auditing support.

TeraGrid's GRAM Auditing & Accounting, & its Integration with the LEAD Science Gateway Stuart Martin Computation Institute, University of Chicago & Argonne National Lab Marcus Christie Indiana University TeraGrid 2007 Madison, WI

Contributors / Collaborators UC/ANL Ian Foster Peter Lane (Formerly UC/ANL) Joe Bester Ravi Madduri Martin Feller Rachana Ananthakrishnan Ally Hume (EPCC) JP Navarro (TG GIG) TG Gateway Working Group

UC/ANL

Ian Foster

Peter Lane (Formerly UC/ANL)

Joe Bester

Ravi Madduri

Martin Feller

Rachana Ananthakrishnan

Ally Hume (EPCC)

JP Navarro (TG GIG)

TG Gateway Working Group

TG Gateways Lower the barrier for scientists and their applications to use TeraGrid resources Provide an application or domain-specific interface that a scientist can easily understand Each gateway may have 100s or 1000s of users accessing TG resources Must be efficient and scale

Lower the barrier for scientists and their applications to use TeraGrid resources

Provide an application or domain-specific interface that a scientist can easily understand

Each gateway may have 100s or 1000s of users accessing TG resources

Must be efficient and scale

Use Cases Group Access For efficiency, a “community” credential is used to multiplex many users over a single ID Query Job Accounting Gateways need a remote interface to obtain the TG units charged for their user’s jobs Auditing Grid services provide access to resources TG Resource Providers need a record of actions performed by services

Group Access

For efficiency, a “community” credential is used to multiplex many users over a single ID

Query Job Accounting

Gateways need a remote interface to obtain the TG units charged for their user’s jobs

Auditing

Grid services provide access to resources

TG Resource Providers need a record of actions performed by services

Requirements From Use Cases Grid Job Identifier Remote client interface to auditing and accounting information Creation of service audit and accounting information Access to remote LRM accounting information from the audit service Scalability in storing information/records Secure access (authentication and authorization) to audit and accounting information

Grid Job Identifier

Remote client interface to auditing and accounting information

Creation of service audit and accounting information

Access to remote LRM accounting information from the audit service

Scalability in storing information/records

Secure access (authentication and authorization) to audit and accounting information

Grid Job Identifier Uniquely identifies a job Shared between the client (Gateway) and service (TG RP) Obtained in the normal service interaction/protocol In GRAM4 it’s the EPR converted In GRAM2 it’s the job contact (as is) GRAM4 Example >>>

Uniquely identifies a job

Shared between the client (Gateway) and service (TG RP)

Obtained in the normal service interaction/protocol

In GRAM4 it’s the EPR converted

In GRAM2 it’s the job contact (as is)

GRAM4 Example >>>

GRAM4 EPR: <ns1:managedJobEndpoint xmlns:ns1= &quot;http://www.globus.org/namespaces/2004/10/gram/job&quot;> <ns2:Address xmlns:ns2= &quot;http://schemas.xmlsoap.org/ws/2004/03/addressing&quot;> https://127.0.0.1:8443/wsrf/services/ManagedExecutableJobService </ns2:Address> <ns3:ReferenceProperties xmlns:ns3= &quot;http://schemas.xmlsoap.org/ws/2004/03/addressing&quot;> <ns1:ResourceID cca8169a-c65f-11da-a61c-000d61215ff0 </ns1:ResourceID> </ns3:ReferenceProperties> <ns4:ReferenceParameters xmlns:ns4=&quot;http://schemas.xmlsoap.org/ws/2004/03/addressing&quot;/> </ns1:managedJobEndpoint> Grid Job ID: https://127.0.0.1:8443/wsrf/services/ManagedExecutableJobService?QQDzjbFVYImtVg8

GRAM4 EPR:

<ns1:managedJobEndpoint xmlns:ns1= &quot;http://www.globus.org/namespaces/2004/10/gram/job&quot;>

<ns2:Address xmlns:ns2= &quot;http://schemas.xmlsoap.org/ws/2004/03/addressing&quot;>

https://127.0.0.1:8443/wsrf/services/ManagedExecutableJobService </ns2:Address>

<ns3:ReferenceProperties xmlns:ns3= &quot;http://schemas.xmlsoap.org/ws/2004/03/addressing&quot;>

<ns1:ResourceID cca8169a-c65f-11da-a61c-000d61215ff0 </ns1:ResourceID>

</ns3:ReferenceProperties>

<ns4:ReferenceParameters

xmlns:ns4=&quot;http://schemas.xmlsoap.org/ws/2004/03/addressing&quot;/>

</ns1:managedJobEndpoint>

Grid Job ID:

https://127.0.0.1:8443/wsrf/services/ManagedExecutableJobService?QQDzjbFVYImtVg8

Remote Client Interface Flexible query interface to retrieve audit and accounting records Define an operation “getChargeForJob” to return the units consumed by a Grid Job ID Keep audit service interface separate from GRAM service to allow flexible deployment scenarios Allow a single audit service for multiple GRAM services Same client interface could be used for other services, for example, charging for data storage or transfers OGSA-DAI satisfies these requirements

Flexible query interface to retrieve audit and accounting records

Define an operation “getChargeForJob” to return the units consumed by a Grid Job ID

Keep audit service interface separate from GRAM service to allow flexible deployment scenarios

Allow a single audit service for multiple GRAM services

Same client interface could be used for other services, for example, charging for data storage or transfers

OGSA-DAI satisfies these requirements

Creation of Service Auditing Information Added GRAM audit record creation upon job termination Record fields: Job_grid_id, local_job_id, submission_job_id, subject_name, username, creation_time, queued_time, stage_in_gid, stage_out_gid, clean_up_gid, gt_verison, rm_type, job_description, success_flag Gerson Galang (APAC) contribution for GRAM4 audit record creation at beginning of job, update after LRM submission, and final update upon termination Records are needed soon after job termination Accounting information is created by the local resource managers

Added GRAM audit record creation upon job termination

Record fields: Job_grid_id, local_job_id, submission_job_id, subject_name, username, creation_time, queued_time, stage_in_gid, stage_out_gid, clean_up_gid, gt_verison, rm_type, job_description, success_flag

Gerson Galang (APAC) contribution for GRAM4 audit record creation at beginning of job, update after LRM submission, and final update upon termination

Records are needed soon after job termination

Accounting information is created by the local resource managers

Access to LRM Accounting Information TeraGrid uploads all LRM accounting information from each TG site to a central DB (TGCDB) The OGSA-DAI service can be configured to access the remote TGCDB

TeraGrid uploads all LRM accounting information from each TG site to a central DB (TGCDB)

The OGSA-DAI service can be configured to access the remote TGCDB

Scalability in Storing Information/Records Estimated that system should handle 100,000+ records GRAM service inserts records directly into audit DB Audit DB must be local to GRAM service to assure reliability Implemented to use either postgress or MySQL

Estimated that system should handle 100,000+ records

GRAM service inserts records directly into audit DB

Audit DB must be local to GRAM service to assure reliability

Implemented to use either postgress or MySQL

Secure access Standard authentication and authorization methods should be used to limit access to the audit and accounting information Clients must present a valid X.509 certificate Access can be controlled based on a range of policies Current policy is to allow access iff the DN of the requestor matches the DN in the audit record

Standard authentication and authorization methods should be used to limit access to the audit and accounting information

Clients must present a valid X.509 certificate

Access can be controlled based on a range of policies

Current policy is to allow access iff the DN of the requestor matches the DN in the audit record

GT4 Java Container Delegation Resource Manager RFT RM Accounting LEAD Gateway Resource Provider Site TG Central Accounting DB RFT Audit Table GRAM Audit Table AMIE OGSA DAI WS GRAM 1, 2 8 3 Compute Cluster 4 5 6 9 7

Sequence Description Gateway submits job and gets an EPR on the reply Gateway controls and monitors job with EPR GRAM submits and monitors job in RM GRAM inserts audit record at end of job RM writes job accounting record AMIE uploads RM accounting records to TGCDB. The RM accounting record is converted to TG accounting units. Gateway locally converts EPR to GJID Gateway calls OGSA-DAI getChargeForJob with GJID and gets the job usage on the reply OGSA-DAI processes remote join between GRAM audit and TGCDB

Gateway submits job and gets an EPR on the reply

Gateway controls and monitors job with EPR

GRAM submits and monitors job in RM

GRAM inserts audit record at end of job

RM writes job accounting record

AMIE uploads RM accounting records to TGCDB. The RM accounting record is converted to TG accounting units.

Gateway locally converts EPR to GJID

Gateway calls OGSA-DAI getChargeForJob with GJID and gets the job usage on the reply

OGSA-DAI processes remote join between GRAM audit and TGCDB

LEAD Project Integration LEAD – Linked Environments for Atmospheric Discover, NSF funded, 5 year large ITR research project Application codes wrapped as web services (“Application Services”) Workflows executed by a WS-BPEL compliant workflow engine Applications, workflow engine, other components communicate via pub/sub notification system

LEAD – Linked Environments for Atmospheric Discover, NSF funded, 5 year large ITR research project

Application codes wrapped as web services (“Application Services”)

Workflows executed by a WS-BPEL compliant workflow engine

Applications, workflow engine, other components communicate via pub/sub notification system

LEAD Architecture + Auditing App Service LEAD Portal Notification Broker GPEL Workflow Engine App Service App Service Auditing Service GRAM Gatekeeper 1. Portal registers workflow 2. Portal submits workflow 3. WF engine invokes app services 4. Launch GRAM jobs 5. Audit notifs 6. Queries for charge

OGSA-DAI Auditing Query Code public static final String QUERY_STRING = &quot;select &quot; + LOCAL_JOB_ID_COL + &quot;, &quot; + SUBJECT_NAME_COL + &quot;, &quot; + QUEUED_TIME_COL + &quot; &quot; + &quot;from &quot; + TABLE_NAME + &quot; &quot; + &quot;where &quot; + JOB_GRID_ID_COL + &quot;=?&quot; ; SQLQuery sqlQuery = new SQLQuery( QUERY_STRING ); sqlQuery.setParameter(1, job.getJobGridId()); WebRowSet rowset = new WebRowSet(sqlQuery.getOutput()); ActivityRequest request = new ActivityRequest(); request.add(sqlQuery); request.add(rowset); Response response = service .perform(request); ResultSet rs = rowset.getResultSet(); if (rs.next()) { job.setLocalJobId(rs.getString( LOCAL_JOB_ID_COL )); job.setSubjectName(rs.getString( SUBJECT_NAME_COL )); Timestamp ts = rs.getTimestamp( QUEUED_TIME_COL ); if (ts != null ) { job.setQueuedTime( new Date(ts.getTime())); } }

Auditing Portlet

Auditing Portlet – Detail Screen

Add a comment

Related presentations

Related pages

TERAGRID 2007 CONFERENCE, MADISON, WI 1 TeraGrid’s GRAM ...

TeraGrid’s GRAM Auditing & Accounting, & its ... TERAGRID’S GRAM AUDITING AND ACCOUNTING AND INTEGRATION WITH THE LEAD SCIENCE GATEWAY 3
Read more

TeraGrid’s GRAM Auditing & Accounting, & its Integration ...

... LEAD Gateway has integrated GRAM auditing ... Auditing & Accounting, & its Integration with ... & its Integration with the LEAD Science Gateway} ...
Read more

TeraGrid's GRAM Auditing & Accounting, & its Integration ...

Publication » TeraGrid's GRAM Auditing & Accounting, & its Integration with the LEAD Science Gateway.
Read more

TG GRAM auditing and LEAD Gateway - Docin.com豆丁网 ...

TG GRAM auditing and LEAD Gateway. ... WI 1 TeraGrid’s GRAM Auditing & Accounting, & its Integration with the ... A Science Gateway provides an ...
Read more

TeraGrid Science Gateway AAAA Model

... TeraGrid's GRAM Auditing & Accounting, & its Integration with ... ice sheets will lead to sea level ... A Science Gateway is a computational ...
Read more

Peter G. Lane - MuffinSpawn Home

Peter G. Lane 3120 Emerson St ... EDUCATION: Bachelor of Science, ... TeraGrid's GRAM Auditing & Accounting, & Its Integration with the LEAD Science ...
Read more

PPT - TG Gateway Job Accounting PowerPoint Presentation

... OGSA-DAI provides virtualization for audit and accounting DBs Accounting process obtains GRAM attributes ... TG Gateway Job Accounting ...
Read more

Reliable and Scalable Job Submission: LEAD Science Gateway ...

... LEAD Science Gateway’s Testing and ... accounting and auditing. WS GRAM provides a ... up to fix scalability issues in WS GRAM and its ...
Read more

Experience with Bursty Workflow-driven Workloads in LEAD ...

In LEAD Science Gateway, ... TeraGrid's GRAM Auditing & Accounting, & its Integration with the LEAD Science Gateway. Stuart Martin, Ian Foster, Marcus ...
Read more