Performance testing technical meeting

60 %
40 %
Information about Performance testing technical meeting

Published on April 22, 2014

Author: akbollinger



This presentation guides through the business and technical preparation meeting as part of a application performance testing project. Goals, Objectives, KPIs, Monitoring and Workload are among the subjects discussed

Customer Performance Tester Collaborative Phase I: Planning Project Meeting Technical Meeting Data Flow Diagram Infrastructure Diagram Technical Questionnaire Understand Customer Environment Understand Customer Application Verify Expectations Understand PT Methodology Establish PTKPI’s Create Performance Test Plan Output Business Process to Infra Mapping Business Processes The Performance Testing Process

Output Phase II: Setup & Script Development PT Environment Environment Analysis & Data Preparation Development & Validation Estimate Injector Requirements Setup Controllers & Injectors Identify PTE location (on site) Assist PTE setup (on site) Analyze Environment Monitoring Analyze Required Data Develop Test Scripts Develop Specialized Scripts Assist with Information Obtain Required DataComplete PTE setup Completed Test Scripts Validated PTE & Test Scripts Setup Monitoring Customer Performance Tester Collaborative The Performance Testing Process

Phase III: Performance Testing Sessions Initial Baseline Final BaselineSessions Collaborative Input Collaborative Input Collaborative Input Session Goals Lead Session Produce Summary Report Conduct Session De-Brief De-Brief Session Final Baseline Create Final Summary Report Initial Baseline Output Customer Performance Tester Collaborative The Performance Testing Process

The Performance Testing Project Phase I: Planning Phase III: Performance Testing Session (PTS) Phase II: Preparation and Scripting

Phase I: Planning  Define the goals  Business goals (Business Key Performance Indicators) ○ Define measurable goals for the performance of the application, for example:  The system needs to create X number of orders per hour with a response time per page of less than Y seconds in 95% of all cases.  IT goals (Technical Key Performance Indicators) ○ In addition to the business goals there can be IT specific goals, for example:  The bandwidth utilization should not exceed 8 mbps

Phase I: Planning  Define the Test Key Performance Indicators  Test Key Performance Indicators (TKPI’s) are used to measure the goal achievements, for example: ○ Response Time ○ Throughput ○ Utilization ○ Efficiency  Define the scope  Define which part of the application/service to test  Define which 3rd part service to include/exclude  Define the timeline

Phase II: Preparation  Application assessment  Business Processes  Scenario ○ Think time ○ Iteration ○ User distribution  Data Flow (in combination with Infrastructure Assessment)  Infrastructure assessment  Technical Questionnaire ○ Physical Access to the application ○ Monitoring ○ Data Flow

Phase II: Preparation  Data assessment  Volume data  Unique data  One time data  Reusable data  Asses the impact of  Write  Update  Delete

Phase II: Setup Monitoring Infrastructure

Phase III: PVS Session

Phase III: Analysis and Reporting  Summary Report for each performance test – KPI achievement – Changes since last test – Issues and bottlenecks  Analysis tool  Session data collected with Performance Center  De-brief

Phase III: Performance Testing Cycle Phase I: Planning Phase II: Preparation Phase III: Execution

Phase II: Preparation Application Assessment Infrastructure Assessment

Phase II: Application Assessment Analyze current or planned application usage Translate the business processes into scripts Define the think time and iteration pace Define the percentage user distribution Test the scenario against the plan Define the business processes

Phase II: Application Assessment  What key business functions are used ?  E.g. Submit Order, Search Products  What is the application flow for an end user to perform these business functions ?  E.g. “Go to homepage”, “Log-in”, “Enter Search Criteria”, “Click Submit”  What is the frequency of these business functions ?  E.g. 100 submitted orders per hour Step1: Analyze the current or planned usage “Use those business functions for load testing that generate 80% of the value.”

Phase II: Application Assessment Step1: Define the business process

Phase II: Application Assessment Step2: The business process is translated into a program

Phase II: Application Assessment  Think time and iteration pace Step3: Define the Scenario PacingRT TT TTRT RT TT Iteration Response Time Think Time

Phase II: Application Assessment  Percentage user distribution Business Process Name Percentage bp01_Transfer Funds 24 % bp02_DisplayTransactionDetails 67 % bp03_MakePayment 9 % Step3: Define the Scenario

Phase II: Infrastructure Assessment System Landscape (Scope) System Monitoring Domain specific Monitoring Resource Monitoring Domains

Phase II: Infrastructure Assessment Define System and Domain specific monitoring Work on the response time breakdown Draw the system landscape

Phase III: Performance Validation Session Performance test run Analysis and reporting Script calibration

Phase III: Performance test run

Add a comment

Related presentations

Online rank tracker!

Online rank tracker!

October 20, 2014

Rank tracker is a tool that helps everyone to find the traffic which a particular ...

Facebook y sus avances

Facebook y sus avances

November 11, 2014

facebook y sus avances

Preguntas Investigación

Preguntas Investigación

November 11, 2014

es una presentación de preguntas interesantes

Cartes interactives, frises chronologiques, diaporamas, carte Google Streetview in...

Related pages

Technical Performance Measurement (TPM) [ACQuipedia]

Key tools used in technical assessment include testing, technical ... Selecting Technical Performance ... predictions in meeting technical ...
Read more

Quality of testing? You can expect it, if you inspect it! ISSS-Technical meeting 2008, Rom, 16.+17.10.2008 Round Robin Quality of testing? Performance of Round Robin You can expect it, if you inspect it!
Read more

The Pilkington Planar™ System - Testing

MEETING PERFORMANCE REQUIREMENTS. Pilkington Planar™ can be tested by our own Research and Development facility, or by an independent body at the ...
Read more

What is performance testing? Why is performance testing ...

What is Performance Testing ! The primary goal of Performance Testing is to help ensure that the technology and processes that comprise the system ...
Read more

High-Performance Testing - PerfTestPlus

get your performance testing teams ... this data to have any special technical ... release due to performance test results not meeting the stated criteria.
Read more

Wrox Article:Performance Testing - Wrox

... has contributed to and written hundreds of commentary pieces and technical ... performance criteria, performance testing ... meeting these specific ...
Read more

What to include in a performance test plan

Before performance testing can be performed effectively, a detailed plan should be formulated that specifies how performance testing will proceed from a ...
Read more

Performance Testing

Performance Testing ... • a proven methodology dedicated to application performance issues • high technical-skilled ... • Meeting for the ...
Read more

Recruitment : Automotive Testing Technology International

Automotive Testing Expo North America 2014 Show ... fully meeting the project performance objectives of schedule, ... (cost, technical performance, ...
Read more