Published on April 22, 2014
Customer Performance Tester Collaborative Phase I: Planning Project Meeting Technical Meeting Data Flow Diagram Infrastructure Diagram Technical Questionnaire Understand Customer Environment Understand Customer Application Verify Expectations Understand PT Methodology Establish PTKPI’s Create Performance Test Plan Output Business Process to Infra Mapping Business Processes The Performance Testing Process
Output Phase II: Setup & Script Development PT Environment Environment Analysis & Data Preparation Development & Validation Estimate Injector Requirements Setup Controllers & Injectors Identify PTE location (on site) Assist PTE setup (on site) Analyze Environment Monitoring Analyze Required Data Develop Test Scripts Develop Specialized Scripts Assist with Information Obtain Required DataComplete PTE setup Completed Test Scripts Validated PTE & Test Scripts Setup Monitoring Customer Performance Tester Collaborative The Performance Testing Process
Phase III: Performance Testing Sessions Initial Baseline Final BaselineSessions Collaborative Input Collaborative Input Collaborative Input Session Goals Lead Session Produce Summary Report Conduct Session De-Brief De-Brief Session Final Baseline Create Final Summary Report Initial Baseline Output Customer Performance Tester Collaborative The Performance Testing Process
The Performance Testing Project Phase I: Planning Phase III: Performance Testing Session (PTS) Phase II: Preparation and Scripting
Phase I: Planning Define the goals Business goals (Business Key Performance Indicators) ○ Define measurable goals for the performance of the application, for example: The system needs to create X number of orders per hour with a response time per page of less than Y seconds in 95% of all cases. IT goals (Technical Key Performance Indicators) ○ In addition to the business goals there can be IT specific goals, for example: The bandwidth utilization should not exceed 8 mbps
Phase I: Planning Define the Test Key Performance Indicators Test Key Performance Indicators (TKPI’s) are used to measure the goal achievements, for example: ○ Response Time ○ Throughput ○ Utilization ○ Efficiency Define the scope Define which part of the application/service to test Define which 3rd part service to include/exclude Define the timeline
Phase II: Preparation Application assessment Business Processes Scenario ○ Think time ○ Iteration ○ User distribution Data Flow (in combination with Infrastructure Assessment) Infrastructure assessment Technical Questionnaire ○ Physical Access to the application ○ Monitoring ○ Data Flow
Phase II: Preparation Data assessment Volume data Unique data One time data Reusable data Asses the impact of Write Update Delete
Phase II: Setup Monitoring Infrastructure
Phase III: PVS Session
Phase III: Analysis and Reporting Summary Report for each performance test – KPI achievement – Changes since last test – Issues and bottlenecks Analysis tool Session data collected with Performance Center De-brief
Phase III: Performance Testing Cycle Phase I: Planning Phase II: Preparation Phase III: Execution
Phase II: Preparation Application Assessment Infrastructure Assessment
Phase II: Application Assessment Analyze current or planned application usage Translate the business processes into scripts Define the think time and iteration pace Define the percentage user distribution Test the scenario against the plan Define the business processes
Phase II: Application Assessment What key business functions are used ? E.g. Submit Order, Search Products What is the application flow for an end user to perform these business functions ? E.g. “Go to homepage”, “Log-in”, “Enter Search Criteria”, “Click Submit” What is the frequency of these business functions ? E.g. 100 submitted orders per hour Step1: Analyze the current or planned usage “Use those business functions for load testing that generate 80% of the value.”
Phase II: Application Assessment Step1: Define the business process
Phase II: Application Assessment Step2: The business process is translated into a program
Phase II: Application Assessment Think time and iteration pace Step3: Define the Scenario PacingRT TT TTRT RT TT Iteration Response Time Think Time
Phase II: Application Assessment Percentage user distribution Business Process Name Percentage bp01_Transfer Funds 24 % bp02_DisplayTransactionDetails 67 % bp03_MakePayment 9 % Step3: Define the Scenario
Phase II: Infrastructure Assessment System Landscape (Scope) System Monitoring Domain specific Monitoring Resource Monitoring Domains
Phase II: Infrastructure Assessment Define System and Domain specific monitoring Work on the response time breakdown Draw the system landscape
Phase III: Performance Validation Session Performance test run Analysis and reporting Script calibration
Phase III: Performance test run
Rank tracker is a tool that helps everyone to find the traffic which a particular ...
Cartes interactives, frises chronologiques, diaporamas, carte Google Streetview in...
Key tools used in technical assessment include testing, technical ... Selecting Technical Performance ... predictions in meeting technical ...
www.ofi.at ISSS-Technical meeting 2008, Rom, 16.+17.10.2008 Round Robin Quality of testing? Performance of Round Robin You can expect it, if you inspect it!
MEETING PERFORMANCE REQUIREMENTS. Pilkington Planar™ can be tested by our own Research and Development facility, or by an independent body at the ...
What is Performance Testing ! The primary goal of Performance Testing is to help ensure that the technology and processes that comprise the system ...
get your performance testing teams ... this data to have any special technical ... release due to performance test results not meeting the stated criteria.
... has contributed to and written hundreds of commentary pieces and technical ... performance criteria, performance testing ... meeting these specific ...
Before performance testing can be performed effectively, a detailed plan should be formulated that specifies how performance testing will proceed from a ...
Performance Testing ... • a proven methodology dedicated to application performance issues • high technical-skilled ... • Meeting for the ...
Automotive Testing Expo North America 2014 Show ... fully meeting the project performance objectives of schedule, ... (cost, technical performance, ...