Automated Acceptance Testing of High Capacity Network Gateway

50 %
50 %
Information about Automated Acceptance Testing of High Capacity Network Gateway

Published on February 19, 2014

Author: IsmoAro



Experience paper presentation from XP2010. Paper itself can be found from:

Automated Acceptance Testing of High  Capacity Network Gateway Ran Nyman, Ismo Aro, Ronald Wagner RANNICON   NSN

Content Background Initial Phase Agile Acceptance  Testing Growing CI Scaling Now Challenges with  ATDD Conclusions RANNICON   NSN

Who are We Ran Nyman Ismo Aro Agile Coach Agile Coach Consultant Scrum Master Developer Tester Developer RANNICON   NSN

Background Product development started in 2007 The product  High capacity GGSN and SAE  Gateway Two teams and cultures  Waterfall  Agile RANNICON   NSN

The Starting Phase Two teams Mixing teams No legacy code First steps:  PBL   Initial architecture and   Development environment RANNICON   NSN

Growing First Wave Two more teams from traditional  background   C team grasped new development ideas  fast D team had difficulties in changing RANNICON   NSN

Growing Second Wave More local teams Subcontractor on different continent  Same rules apply  CI challenges  Customs problems  Lot's of traveling And it slowly started to work  RANNICON   NSN

Current Setup More than 20 teams Located in four countries Development staff is still growing  More teams on existing sites RANNICON   NSN

How Does it Work Release at least every other sprint “As a result of our agility in developing  products, we have been able to demonstrate the  product capabilities at an early stage of the  development cycle itself, helping us to win new  customers cases.”   Head of the product line RANNICON   NSN

Agile Acceptance Testing RANNICON   NSN

Agile Acceptance Testing Acceptance test are decided in beginning  of sprint Tests are automated during development All acceptance test are automated Test scripts are only documentation that is  written from tests RANNICON   NSN

Tools CI servers: Bamboo, BuildBot Automation Framework: Robot  Framework Protocol tester: Catapult RANNICON   NSN

Continuous Integration CI  Build (compilation and Unit Tests)  Sanity  Nightly regression RANNICON   NSN



Test Growth RANNICON   NSN


Challenges with ATDD Limited e2e testing: No visibility what is ready for shipping Hard to troubleshoot Changing functionality leads to  unpredictable failures in tests ATDD is done on to low level RANNICON   NSN

E2E Tests in Future Test cases are created before code and they  work as a tool of communication. Test Cases are going to be written using  BDD. eg. Given activate customer license  When customized packet is send to A interface Then packet is delivered from A interface to B interface. And no counters are increased.  RANNICON   NSN

Conclusions Automated acceptance testing pays off 100% test automation is the target Real life is more complex than you think Do not forget the CI challenges Splitting requirements and tracking  progress RANNICON   NSN

Questions RANNICON   NSN

Contact Us Ran Nyman   www: Ismo Aro   Twitter: ismoaro  www: Roland Wagner  RANNICON   NSN

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Automated Acceptance Testing of High Capacity Network Gateway

Automated Acceptance Testing of High Capacity Network Gateway 309 2.2 Growing Second Wave
Read more

Automated Acceptance Testing of High Capacity Network Gateway

Automated Acceptance Testing of High Capacity Network Gateway Ran Nyman1, Ismo Aro2, Roland Wagner3, 1,2,3 Nokia Siemens Network, PO Box 1 FI-02022 Nokia ...
Read more

Automated Acceptance Testing of High Capacity Network Gateway

In this paper we will explore how agile acceptance testing is applied in testing a high capacity network gateway. We will demonstrate how the organisation ...
Read more

Scalability testing - Wikipedia, the free encyclopedia

Scalability Testing, ... under a high load, ... This means that the current memory capacity can cope with all 3 stages of the test.
Read more

Load testing - Wikipedia, the free encyclopedia

Load testing is especially important if the ... WSim simulates one or many network terminal ... system testing, regression testing, capacity ...
Read more

Chapter 2 – Types of Performance Testing

Performance Testing ... The goal of stress testing is to reveal application bugs that surface only under high ... disk capacity, or network ...
Read more

Test Central - Platform to Create Organizational Testing ...

Welcome to! We provide a software testing platform with amazingly robust functionality and flexibility for you to easily ... The network.
Read more

MyConnection Server network assessment testing, network ...

MyConnection Server. Network Quality Management. ... • SPEED and CAPACITY • AUTOMATED and Managed Testing ... • Automated Testing
Read more

Network Throughput Testing Tools :: General Networking ...

In this article we'll take a look at a few network throughput testing ... Just remember that network testing can be ... Stress Testing File Server Capacity.
Read more