What is Delphix

50 %
50 %
Information about What is Delphix

Published on February 19, 2014

Author: khailey

Source: slideshare.net

What is Delphix

kylehailey.com/delphix Use Cases What is Delphix Competition

What is Delphix

Three Physical Copies Three Virtual Copies Delphix

Install Delphix on Intel commodity hardware Intel hardware

Allocate Any Storage to Delphix Allocate Storage Any type Pure Storage + Delphix Better Performance for 1/10 the cost

One time backup of source database Production Supports Instance Instance Instance Database File system Application Stack Virtualization Upcoming

DxFS (Delphix) Compress Data Production Instance Instance Instance Database File system Data is compressed typically 1/3 size

Incremental forever change collection Production Instance Instance Instance Database Changes Time Window File system • Collected incrementally forever • Old data purged

Change collection works with snapshots Snapshot 0: Source Full Copy Snapshot 1: Changed blocks at time T1

Snapshots immediately look like full copies as they are mapped onto the previous copy Snapshot 0 Snapshot 1

Snapshot 0 Snapshot 1 Snapshot 2: Changed blocks at time T2

Snapshot 0 Snapshot 2 Snapshot 1

Purging old snapshot releases any blocks that have been since replaced, but keeps all unchanged blocks Snapshot 2 Snapshot 1 Drop Snapshot 0

Cloning : almost no storage at creation since it is all shared. Upon usage changed blocks will add to storage used Production Instance Instance Instance Instance Instance Database Database Time Window File system

Typical Architecture Production Dev, QA, UAT Reporting Instance Instance Instance Instance Instance Instance Instance Instance Database Database Database Database Database File system File system File system File system File system File system File system File system File system File system File system Backup Instance Instance Instance File system File system

With Delphix Production Instance Instance Database File system Dev & QA Instance Instance Instance Instance Instance Instance Database Database Database Reporting Backup Instance Instance Database Database

Delphix Use Cases 1. 2. 3. 4. 5. Fast, Fresh, Full Free Branching Federated Self Serve

Fast, Fresh, Full Source Development VDB Instance Instance Time Window

Free Instance Source Instance Instance Instance gif by Steve Karam

Branching Source Instance branching Dev Instance Source QA branched from Dev Instance

Federated Cloning

Federated Source1 Instance Source1 Instance Source2 Instance Instance

“I looked like a hero” Tony Young, CIO Informatica

Self Service

Use Cases 1. Development Acceleration 2. Quality 3. BI

DevOps

DevOps With Delphix 1. 2. 3. 4. 5. Efficient QA: Low cost, high utilization Quick QA : Fast Bug Fix Every Dev gets DB: Parallelized Dev Full DB : Less Bugs Fast Builds: Culture of Yes

Without Delphix 1. Inefficient QA: Long Build times Build QA Test Build Time 96% of QA time was building environment $.04/$1.00 actual testing vs. setup

: With Delphix 1. Efficient QA: Lower cost Build QA Test Build Time B u i l d T i m e QA Test 1% of QA time was building environment $.99/$1.00 actual testing vs. setup

Rapid QA via Branching

Without Delphix 2. QA Delays: bugs found late require more code re-work Build QA Env Sprint 3 Sprint 2 Sprint 1 X Build QA Env QA Bug Code 70 60 50 40 30 20 10 0 Cost To Correct 1 2 3 4 5 6 7 Delay in Fixing the bug Software Engineering Economics – Barry Boehm (1981) QA

: With Delphix 2. QA Immediate: bugs found fast and fixed Build QA Env Sprint 2 Sprint 1 X Q A Build QA Env Q A Sprint 3 Bug Code QA QA Sprint 2 Sprint 1 X Bug Code Sprint 3

Without Delphix 3. Full Copy Shared : Bottlenecks Old Unrepresentative Data Frustration Waiting

: With Delphix 3. Private Copies: Parallelize gif by Steve Karam

Without Delphix 4. Subsets : cause bugs

Without Delphix 4. Subsets : cause bugs The Production ‘Wall’ Classic problem is that queries that run fast on subsets hit the wall in production. Developers are unable to test against all data

: With Delphix 4. Full Size DB : Eliminate bugs

Without Delphix 5. Slow Environment Builds: Slow Environment Builds: 3-6 Months to Deliver Data Developer Asks for DB Get Access Manager DBA System Admin Storage Admin approves Request system Setup DB Request storage Setup machine Allocate storage (take snapshot)

Without Delphix 5. Slow Environment Builds: culture of no DBA Developer

Without Delphix Never enough environments

: With Delphix 5. Self Service: Fast, Efficient. Culture of Yes!

Quality 1. Forensics 2. Testing 3. Recovery

1. Forensics: Investigate Production Bugs Development Instance Instance Time Window Anomaly on Prod Possible code bug At noon yesterday Spin up VDB of Prod as it was during anomaly

2. Testing : Rewind for patch and QA testing Prod Development Instance Instance Time Window Time Window

2. Testing: A/B Instance Test A with Index 1 Instance Instance Time Window • Keep tests for compare • Production vs Virtual – invisible index on Prod – Creating index on virtual • Flashback vs Virtual Test B with Index 2

3. Recovery: Surgical recover of Production Source Development Instance Instance Spin VDB up Before drop Time Window Problem on Prod Dropped Table Accidently

3. Recovery Surgical or Full Recovery on VDB Dev1 VDB Source Instance Instance Dev2 VDB Branched Source Time Window Dev1 VDB Time Window Instance

3. Recovery: Virtual to Physical Source VDB Instance Instance Spin VDB up Before drop Time Window Corruption

50 days of backup in size of Original 3. Recovery

Business Intelligence

ETL and Refresh Windows 1pm noon 10pm 8am

ETL and DW refreshes taking longer 1pm noon 10pm 2011 2012 2013 2014 2015 8am

ETL and Refresh Windows Globalization limits ETL windows to weekends 6am 8am 10pm 10pm 1pm noon 8am 10pm 2011 2012 2013 2014 2015 noon 9pm 8am

ETL and DW Refreshes Prod DW & BI Instance Instance Data Guard – requires full refresh if used Active Data Guard – read only, most reports don’t work

Fast Refreshes • Collect only Changes • Refresh in minutes Prod Instance BI DW Instance Instance ETL 24x7

Temporal Data

Oracle 12c

80MB buffer cache ?

200GB Cache

with Latency Tnxs / min 5000 300 ms 1 5 10 20 30 60 100 200 Users 1 5 10 20 30 60 100 200

Latency Tnxs / min 8000 600 ms 1 5 10 20 30 60 100 200 Users 1 5 10 20 30 60 100 200

Five 200GB database copies are cached with : $1,000,000 1TB cache on SAN $6,000 200GB shared cache on Delphix

Data Center Migration : clone migration 5x Source Data Copy < 1x Source Data Copy

Data Center Migration : clone migration + source S S 5x Source Data Copy < 2 x Source Data Copy

Data Center Migration : clone migration + source S C C C 5x Source Data Copy C S V V V < 1 x Source Data Copy V

Consolidation Without Delphix Active Active With Delphix Idle Active Idle Active

DBMS License Utilization • Most DBMS time spent waiting on environment setup, data loads, backups, etc. • Coupling of data and DB servers forces over-provisioning, limits utilization • Delphix can attach / detach data to server tier on-demand to drive consolidation • Potential 2X reduction in DB server footprint cuts HW and DBMS license © 2014 DELPHIX. ALL RIGHTS RESERVED. PRIVATE & CONFIDENTIAL. costs 69

Dev v2.6 v2.6 QA v2.6 v2.6 UAT v2.6 v2.6 v2.6 v2.7 v2.6 v2.7 v2.7 v2.6 v2.6 v2.6 v2.8 v2.8 v2.6 v2.8

Production Dev v2.6 v2.6 QA v2.6 v2.6 UAT v2.6 v2.6 v2.6 v2.7 v2.6 v2.7 v2.7 v2.6 v2.6 v2.6 v2.8 v2.8 v2.6 v2.8 Source Control for the database data

2.6 branching Dev Prod checkout bookmark

2.6 QA Dev Prod

2.6 UAT QA Dev Prod

2.6 UAT QA Dev Prod Dev QA UAT 2.7

2.6 2.8 UAT QA UAT QA Dev Dev Prod Dev QA UAT 2.7

2.6 2.8 UAT QA UAT QA Dev Dev Prod Dev QA UAT 2.7 Data Control = Source Control for the Database

2.6 2.8 UAT QA UAT QA Dev Dev Production Time Flow Dev QA UAT 2.7 Data Control = Source Control for the Database

Add a comment

Related presentations

Related pages

Data Virtualization and Data Masking Solutions | Delphix

Delphix provides data virtualization and data masking solutions. Deliver new applications, features and upgrades to market faster with Delphix data.
Read more

About | Delphix

Delphix is radically changing the way companies deliver their data – providing fast, flexible, efficient access to data. Learn more about how we do it
Read more

Data Virtualizer » Delphix

What Delphix Does . Delphix eliminates the number one bottleneck in IT, as considered by many, which is provisioning data to backup, business analysis, and ...
Read more

Delphix - Wikipedia

Delphix is a Menlo Park, California-based software company that develops software for simplifying the building, testing, and upgrading of applications ...
Read more

DelphiX pages

Installation (un)DelphiX installation program (beta version) Installation program (un)DelphiX 1.0.15.0 release Sep 1, 2015 Full source code with basic demos.
Read more

scholarship.delphix.com

At Delphix we care about diversity because we believe diverse teams build better products. We also believe that enabling people to do their best work ...
Read more

Delphix Accounts

Please use your Delphix Support Portal or Delphix Community credentials. If you do not have a Delphix Community account, please create one below.
Read more

Delphix | Facebook

Delphix, Menlo Park, CA. 3,227 likes · 1 talking about this · 64 were here. Delphix accelerates, simplifies, & transforms application development. We...
Read more

Delphi Automotive is a global supplier of vehicle technology.

Delphi is a leading global supplier of technologies for the automotive and commercial vehicle market, making vehicles smarter, safer, and efficient.
Read more

Home | Delphi-Treff

Willkommen auf Delphi-Treff! Thema dieser Website ist das Entwicklungstool Delphi von Embarcadero (früher Borland, Inprise ...
Read more