advertisement

Introduction to Database Benchmarking with Benchmark Factory

67 %
33 %
advertisement
Information about Introduction to Database Benchmarking with Benchmark Factory
Technology

Published on July 31, 2013

Author: Michael_Micalizzi

Source: slideshare.net

Description

When you are faced with making changes to your database environment such as upgrades, patches, hardware installation or virtual machine implementations, there are inherent risks that database performance or availability can suffer.

Oracle ACE and author Bert Scalzo will show how to reduce these risks and demonstrate how Benchmark Factory can help you scale your database for best possible results.
advertisement

1 Global Marketing Bert Scalzo PhD, MBA & Oracle ACE Database Expert & Product Architect Avoiding the Risks of Database Change using Benchmark Factory

2 Quest Software is now a part of Dell Books by Bert Scalzo

3 Quest Software is now a part of Dell • Database Benchmarking Basics • Benchmark Factory Overview • Benchmarking Options • Customizing Benchmarking Projects • Running a Benchmark • Examining Runtime Reports • Error Messages and Log Files • Benchmark Factory Demonstration • Questions & Answers Purpose / Agenda

4 Quest Software is now a part of Dell Database Benchmarking is complicated Even with a Benchmarking Tool There is no substitute for your knowledge and expertise

5 Quest Software is now a part of Dell Successful Database Benchmarking Expert – must know database, O/S, hardware, software, tuning & have read the benchmark specsStress test the database ?

6 Quest Software is now a part of Dell Database Benchmarking Most Common Mistakes

7 Quest Software is now a part of Dell Wrong Person Doing the Heavy Lifting

8 Quest Software is now a part of Dell Trying to make do without the right tools

9 Quest Software is now a part of Dell Wrong number of virtual users Don’t cut corners

10 Quest Software is now a part of Dell Industry Standard Database Benchmarks • Industry Standard Database Benchmarks have been around for over 20 years • TPC.ORG – TPC-C: Older OLTP benchmark. Basic “order entry” type application. – TPC-H: Data warehousing queries. 22 queries – not star schema design. – TPC-E: Newer OLTP benchmark. Simulates workload of brokerage firms. – TPC-DS: New, evolving complete DW. Spec still evolving – not yet in BMF. – TPC-VMS: New, evolving virtual DB’s. Spec still evolving – not yet in BMF. • Be Sure to Read the Specs – Understand basic database design – Implementation options up to you – Sizing options for data load and concurrency – How to interpret results and/or gauge success • Majority of failures due to insufficient preparation, unrealistic expectations, and uncertain metrics for success

11 Quest Software is now a part of Dell Examples of Info in the Spec: TPC-C BMF Prompts for DB size – you must know how to answer 100 concurrent users = scale factor of 10

12 Quest Software is now a part of Dell Examples of Info in the Spec: TPC-H BMF does not know what Oracle options you are licensed for (partitioning), nor your hardware setup such as spindles per LUN, RAID level, CPU count, RAM size, and son on. BMF creates basic & correct tables and indexes – you must manually optimize them within spec.

13 Quest Software is now a part of Dell Database Design – Reference Full Disclosure Reports for Similar Setups

14 Quest Software is now a part of Dell Database Design Reference Full Disclosure Reports for Similar Setups

15 Quest Software is now a part of Dell Database Design – Appendix B Will Show DDL for Optimal Design Very common technique to load very large data sets into ETL or staging tables, and then to do create table as select (CTAS) to populate the benchmark tables

16 Quest Software is now a part of Dell Common Database Benchmark Metrics TPS and Avg. Response Time • Transactions per Second – Gets far too much attention – Meaningless to most users – Sort of like automobile RPM’s (how fast internal engine is working – not how fast car is moving or how soon we’ll arrive) – Misconception that TPS equates to IOPS (IO Operations per Second) – ignores database memory caching and logging – BMF does not report IOPS (on roadmap for possibly 7.0) • Average Response Time – Gets far too less attention – Meaningful to most users – Sort of like MPH (or KPH) (how fast car actually is moving – so infers how soon we’ll arrive or amount of fuel we’ll use) – When examined in conjunction with TPS, then a generally observable and clear pattern often emerges (next slide) … • Be sure to read my blog: The Myth of Transactions per Second (TPS)

17 Quest Software is now a part of Dell Common Database Benchmark Pattern – True Point of Saturation 0 1000 2000 3000 4000 5000 6000 7000 100 200 300 400 500 600 700 800 900 1000 TPS Avg Resp Time Looking for inflection point where TPS is still increasing or just decreasing and close to max where average response time is below customer defined SLA Notice the line characteristics between roughly 750 and 850 concurrent users – for current configuration and optimization benchmark results interesting Common mistake to simply attempt maximize TPS – remember TPS is not IOPS

18 Quest Software is now a part of Dell Benchmark Factory Architecture – Console (Control Center) and Agents You must manually install BMF agent software on servers – otherwise BMF will simply spawn agents on your console machine (major bottleneck) Each 32-bit BMF agent can handle 500 concurrent user sessions Each 64-bit BMF agent can handle 1,000 concurrent user sessions Each server running one or more agents requires its own separate BMF license! Agent servers can be virtual machines

19 Quest Software is now a part of Dell Hardware Sizing is Very Difficult Requires Lots of Thought Let’s assume doing TPC-C benchmark for sale factor 100, so 1,000 concurrent users, and roughly 8-10 BMF agents Note we already have a huge built-in bottleneck – there’s only one NIC for 1,000 concurrent database sessions! Let’s assume using virtual machines for entire BMF architecture on a seemingly large VMware ESX / vSphere server

20 Quest Software is now a part of Dell Benchmark Factory Architecture BMF Offers Two Repository Options DEFAULT

21 Quest Software is now a part of Dell BMF Offers Many Types of Tests Industry Standard Benchmarks

22 Quest Software is now a part of Dell BMF Offers Many Types of Tests Scalability & Workload Capture/Replay

23 Quest Software is now a part of Dell BMF Offers Many Types of Tests Custom Load Scenario

24 Quest Software is now a part of Dell BMF Offers Many Types of Tests Goal Testing to Meet Customer SLA BMF will test from 100 to 1,000 concurrent users in increments of 100 additional users, and will stop when the average response time is more than 2 seconds (e.g. common customer defined SLA).

25 Quest Software is now a part of Dell Example of Benchmark Factory Project – Default Creation

26 Quest Software is now a part of Dell Example of Benchmark Factory Project Custom (Highly Recommended)

27 Quest Software is now a part of Dell Example of Benchmark Factory Project Custom (Highly Recommended)

28 Quest Software is now a part of Dell Example of Benchmark Factory Running

29 Quest Software is now a part of Dell Benchmark Factory Runtime Reports – Results from Runs

30 Quest Software is now a part of Dell Benchmark Factory Error Logging – Where to Look

31 Quest Software is now a part of Dell Benchmark Factory Error Logging – Where to Look

32 Quest Software is now a part of Dell On-Demand Webcast - Intro to Database Benchmarking and product demo • Download the webcast now

33 Quest Software is now a part of Dell • www.toadworld.com – Expert Blogs – Articles – How-To Videos – User Forum – Wiki – Direct access to product experts and much more Additional Resources

34 Quest Software is now a part of Dell Additional Resources • Benchmark Factory Home Page • Download a free 30 day trial edition of Benchmark Factory • White Paper – Top 10 Benchmarking Misconceptions • On-Demand Webcast - Introduction to Database Benchmarking

35 Quest Software is now a part of Dell

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Benchmark Factory for Databases - Introduction - YouTube

Benchmark Factory for Databases enables you to conduct repeatable and measurable performance and scalability testing. Through the use of ...
Read more

Benchmark Factory - Toad World

Benchmark Factory® for Databases is a database performance testing tool that allows you to conduct database ... Introduction to Database Benchmarking ...
Read more

Benchmark Factory for Databases - Dell Software Official ...

Benchmark Factory for Databases is a ... Conduct database performance and benchmark ... ODBC Database Server: Benchmark Factory supports almost all ...
Read more

Benchmark Factory for Databases - Introduction - Videos ...

Benchmark Factory for Databases enables you to conduct repeatable and measurable performance and scalability testing. Through the use of database workload ...
Read more

Release Notes - Benchmark Factory for Database 7.1 Release ...

Dell Benchmark Factory for Database Technical Documentation ... When testing against a SQL Server 2014 database, Benchmark Factory cannot create memory ...
Read more

Benchmark Factory for Databases | Dell Australia

Benchmark Factory™ for Databases is ... .NET Framework 2.0 is required to use Oracle workloads captured with Benchmark Factory 6.9.3 or earlier. Database ...
Read more

Benchmark Factory (formerly Benchmark Factory for Databases)

Download Benchmark Factory (formerly Benchmark Factory ... and database servers, Benchmark Factory is able ... (formerly Benchmark Factory ...
Read more

Benchmark Factory for Databases Freeware - Free download ...

Benchmark Factory for Databases is a database performance and scalability testing tool ... Submit a problem report for Benchmark Factory for Databases ...
Read more

Benchmark Factory for Databases | Dell UK

Benchmark Factory for Databases is a scalable database testing ... ODBC Database Server Benchmark Factory supports almost all databases that you can ...
Read more