DevOpsGuys Performance Testing with APM Tools workshop

40 %
60 %
Information about DevOpsGuys Performance Testing with APM Tools workshop

Published on March 6, 2014

Author: devopsguys



A set of static slides that accompanied a "Live Demo" of using APM tools (AppDynamics) during load testing to isolate a performance issue, fix it, de-deploy and compare the improvement. This presentation accompanies the workshop held at the NCC Group Web Performance event in March 2014. Videos should be available on the NCC Group Community website -

DevOpsGuys Perf Testing with APM Workshop Live demo without a safety net! @DevOpsGuys DevOpsGuys 1

Workshop agenda • • • • • • • • Intro – Steve – 10mins Load Testing Portal – Gareth – 10 mins APM Analysis – Steve – 10 mins Deploy Fix & Re-Test – Steve – 5 mins APM Demo + Q&A – Steve – 10 mins Test #2 Analysis – Steve – 10 mins Result Comparison – Gareth – 10 mins Wrap up Q&A – Steve & Gareth @DevOpsGuys DevOpsGuys 2

NCC Test Servers @DevOpsGuys Load Balancer Test Environment Web #1 MS SQL Server Web #2 DevOpsGuys 3

Cloud Servers @DevOpsGuys DevOpsGuys 4

Load Balancer Only one node active (for now) @DevOpsGuys DevOpsGuys 5

Test Application • Online Art Shop Demo App • .Net MVC Application • @DevOpsGuys DevOpsGuys 6

The Art Shop @DevOpsGuys DevOpsGuys 7

APM Weapon of Choice • AppDynamics APM – Gartner Magic Quadrant Leader • SaaS Portal • Agent install – 15 minutes to install on 2 web servers • OOTB Configuration – 2 minor instrumentation changes – Create a dashboard (~1hr) @DevOpsGuys DevOpsGuys 8

OctopusDeploy @DevOpsGuys DevOpsGuys 9

A brief overview of the Portal & Test setup NCC GROUP LOAD TESTING @DevOpsGuys DevOpsGuys 10

Where we break stuff live, for your viewing pleasure! WORKSHOP DEMO PART 1 @DevOpsGuys DevOpsGuys 11

AppDynamics Portal @DevOpsGuys DevOpsGuys 12

Failure in Minute 8(ish) @DevOpsGuys DevOpsGuys 13

What went wrong? @DevOpsGuys DevOpsGuys 14

SQL Client Exceptions @DevOpsGuys DevOpsGuys 15

Slow Connection Open? @DevOpsGuys DevOpsGuys 16

Code Bug (Thread.Sleep) @DevOpsGuys DevOpsGuys 17

Fix it problems, deploy & re-test WORKSHOP DEMO PART 2 @DevOpsGuys DevOpsGuys 18

Fix the Bugs… @DevOpsGuys DevOpsGuys 19

Deploy it… @DevOpsGuys DevOpsGuys 20

#3 Faster Iteration = Better Value @DevOpsGuys DevOpsGuys 21

Maximise Testing Value Deploy Fix @DevOpsGuys Test Analyse DevOpsGuys 22

While we wait for the load to ramp up… MORE ON APM… @DevOpsGuys DevOpsGuys 23

Comparing the two releases SHOW THE IMPROVEMENT @DevOpsGuys DevOpsGuys 24

10,000 vs 45,000 @DevOpsGuys DevOpsGuys 25

Summary 1. 2. 3. 4. See the Big Picture (systems thinking) Drill down to the details Faster Iteration = Better Value Stop the “Blame Game” – aka “There’s your Problem!” @DevOpsGuys DevOpsGuys 26

DevOpsGuys Thank You AppDynamics Free Trial operations | availability | performance | scalability | migration | strategy @DevOpsGuys DevOpsGuys 27

What We Do DevOpsGuys provide development & operations support (DevOps) services for your online applications. You run your business. We run your website. It’s as simple as that. @DevOpsGuys DevOpsGuys 28

Our service portfolio • 24 x 7 Application-Centric web operations • DevOps Transformation & Training • Continuous Delivery implementation • Infrastructure Automation & “Infrastructure as Code” • Application Performance Management • AppDynamics Implementation & Consultancy @DevOpsGuys • Web Performance consulting • Web monitoring • Load Testing • Test Automation and scripting • JetBrains Product Implementation & Consultancy • Octopus Deploy implementation DevOpsGuys 29

The Leadership Team James Smith (@TheDevMgr) Steve Thair (@TheOpsMgr) • 16 years of software delivery experience. • Proven track record • 25 years of IT Operations experience. • Proven track record – – – – – – – Pizza Hut KFC Dell RAC Aviva Fujitsu Siemens Whitbread @DevOpsGuys – – – – – – – DevOpsGuys Vodafone Credit Suisse Group IBM BNP Paribas Zurich Financial Services Totaljobs Group TSL Education 30

Contact Us Visit us at Call our team on +44 (0)20 8798 3079 Email our engineers at @DevOpsGuys DevOpsGuys 31

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Welcome - DevOpsGuys

... testing compliance and progress against each ... implementing best of breed tools to ... DEVOPSGUYS LAUNCH WORKSHOPS & TRAINING. DevOpsGuys, ...
Read more

Performance | DevOpsGuys

RedGate and DevOpsGuys DLM Workshops; ... benefits of using an APM solution while performance testing ... of using APM tools while load testing. ...
Read more

How National Australia Bank (NAB) used CA APM during ...

... used CA APM during performance testing to improve ... Performance Testing with APM Workshop. ... DevOpsGuys Performance Testing with APM Tools ...
Read more

A look back at NCC Group’s web performance conference

Website Load Testing ; Performance Analyser ; Software Testing. Overview ; Software Testing Services ; Test Centre ; Specialist Software Testing ;
Read more

Application Performance Management | Dynatrace

Dynatrace, formerly Compuware APM, ... Performance Test; Benchmarks; APM Tools ; PARTNERS. Partner Program; Become a Partner; Partner Portal; Selling Partners;
Read more

Application Performance Management | APM Performance ...

Application Performance Management ... (APM) Application Performance Management system. Home; ... Performance Testing.
Read more

Application Performance Monitoring Tools | Dynatrace

Free Products. Dynatrace Free Trial. ... Web Load Testing. ... Performance Test; Benchmarks; APM Tools ; PARTNERS. Partner Program;
Read more

APM Project Risk Management Professional Certification | UK

The learning outcomes for the qualification are detailed in the APM Project Risk Management Certificate syllabus. ... Performance Through People; SR Education;
Read more