advertisement

Building a Big Data Warehouse

50 %
50 %
advertisement
Information about Building a Big Data Warehouse
Technology

Published on June 5, 2013

Author: mids106

Source: slideshare.net

Description

Big Data presentation at XebiCon2013 - http://xebicon.nl/
advertisement

GoDataDrivenPROUDLY PART OF THE XEBIA GROUP@mids106jorisbontje@godatadriven.comBuilding a Big DataWarehouseJoris BontjeBig Data Hacker

About MeBig Data HackerData Driven Solution ArchitectHadoopTrainer

About GoDataDriven

Data WarehouseEvolution

http://en.wikipedia.org/wiki/Data_warehouseIn computing, a data warehouse is adatabase used for reporting and dataanalysis.

Database Architecture (1.0)Products)Customers)Orders)Inventory)Sales)DB)

Analytical Database (2.0)Sales&Inventory&Customers&Products&Orders&

Basic DWH ArchitectureTX#DB#Analy+cal#DB#BI#ETL

Data MartsTX#DB#DW#Sales#Mktg#Prch#BI#

Multiple Data-Sourcesother&Files&TX&DB&DW&Sales&Mktg&Prch&BI&

Operational Data StoreDW#ODS#other#Files#TX#DB# Sales#Mktg#Prch#BI#

Hadoop

GoDataDrivenNo HadoopDW#ODS#other#Files#TX#DB# Sales#Mktg#Prch#BI#

GoDataDrivenETL Engineother&Files&TX&DB& Sales&Mktg&Prch&DWBI&

GoDataDrivenTiered Data Warehouseother&Files&TX&DB& Sales&Mktg&Prch&BI&

GoDataDrivenAnalytical Query Engineother&Files&TX&DB&BI&

Tools

Tools

Tools Applied

Tools Applied

Considerations

ConsiderationsBig Data is dirtyAutomate everythingMonitoring and QA become the same thing

My Past TrendsBig Data Forum 2012

My PastTrendsCloud / On-demand

My PastTrendsHadoop Hardware

My PastTrendsBatch → Real-Time

New TrendsXebiCon 2013

TrendsImpalaOpen Source, Real-time Query enginefor Hadoop

TrendsDefacto standard for Hadoop metadata

Simple Database ArchitectureProducts)Customers)Orders)Inventory)Sales)DB)

The future?Products)Customers)Orders)Inventory)Sales)

GoDataDrivenWe’re hiring / Questions? / Thank you!@mids106jorisbontje@godatadriven.comJoris BontjeBig Data Hacker

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Big Data Debate: End Near For Data Warehousing ...

And without building a data warehouse, ... He is an industry veteran and big data ... To save this item to your list of favorite InformationWeek ...
Read more

Big Data Implementation vs. Data Warehousing by Bill Inmon ...

Big Data Implementation vs. Data ... Maybe you don’t need a data warehouse if you have big ... And it is true that the homes and buildings in ...
Read more

Building a Big Data Warehouse - Technology - documents

1. GoDataDrivenPROUDLY PART OF THE XEBIA GROUP@mids106jorisbontje@godatadriven.comBuilding a Big DataWarehouseJoris BontjeBig Data Hacker. 2. About MeBig ...
Read more

Building a Hadoop Data Warehouse Video - Cloudera

Building a Hadoop Data Warehouse Video. ... describes how Apache Hadoop complements and integrates effectively with the existing enterprise data warehouse.
Read more

Building a Big Data DWH - GOTO Conference

GoDataDriven PROUDLY PART OF THE XEBIA GROUP @fzk frisovanvollenhoven@godatadriven.com Building a Big Data DWH Friso van Vollenhoven CTO Data Warehousing ...
Read more

Building a Data Warehouse, Part 1: When to Build - DZone ...

/ Big Data Zone. Over a million ... Building a Data Warehouse, ... building the data warehouse and supporting ETL.
Read more

Integrating data warehouse architecture with big data ...

Integrating data warehouse architecture with big data technology. ... Disk performance is an important consideration when building big data systems, ...
Read more

Steps Involved in Building a Data Warehouse - InformIT

This article by Baya Pavliashvili gives you an overview of what a data warehouse is and what ... The third step in building a data warehouse is coming up ...
Read more