An introduction to Google Spanner

43 %
57 %
Information about An introduction to Google Spanner
Technology

Published on September 4, 2013

Author: mikejf12

Source: slideshare.net

Description

A short introduction to Google Spanner, what is
it and how does it work ? How does it relates to
big table ?

Google Spanner ● What is it ? ● How does it work ? ● Future Scale ● Architecture ● Terms www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – What is it ? ● The world's largest distributed database ● Internally used by Google ● Has a true time API to avoid latency problems ● Supports Google's Advertising business ● It is fault tolerant to large scale outages ● Offers very high availability and latency – Aiming for 99% and 50 ms www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – How does it work ? ● Has a true time API – Atomic clocks – GPS Clocks – Locally determine accurate time – No need for global time sync ● One single global name space ● Data stored globally via directory namespace ● Uses a Paxos algorithm www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Scale ● How big is it , what are they aiming for ? – Aiming for 107 machines – 1013 directories – 1018 bytes of storage – 1000's of storage locations – 109 clients ● Current data centres up to 100 ms apart www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Architecture ● A zonemaster has 100's of spanservers ● Zonemasters assign data to spanservers which serve clients ● Location proxies help clients locate spanservers ● Universe master displays zone status information ● Placement driver automates data zone movement www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Architecture www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Architecture ● Each spanserver manages 100's of tablets ● Each spanserver has a paxos machine ● Paxos machine supports replication ● Lead replica has lock table ● Lead replica has transaction manager ● For transactions over multiple paxis groups – 2 phase commit used – For control of transactions ● Coordinator leader & ● Coordinator slaves used www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Terms ● NewSQL – A modern RDBMS that scales like NoSQL but offers OLTP ACID guarantees ● BigTable – Google's storage system built on GFS ● Google F1 – Google RDBMS for the Adwords system ● Paxos – An algorithm for determining concensus in a network of unreliable processors www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Terms ● RDBMS – Relational Database Management System ● NoSQL – A highly optimized database for large storage volumes, it offers a less constrained consistency model than traditional rdbms's ● ACID – ACID (Atomicity, Consistency, Isolation, Durability) is a set of properties that guarantee that database transactions are processed reliably ● OLTP – Online transaction processing www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Google Spanner – Terms ● Time Synchronisation – The coordination of events to operate a system in unison ● Global Consistency – Ensuring global users have a consistent view of data ● Atomic clock – Clocks based upon atomic physics principles ● GPS clock – Clocks that use GPS to determine time from multiple satellite atomic clocks www.semtech-solutions.co.nz info@semtech-solutions.co.nz

Contact Us ● Feel free to contact us at – www.semtech-solutions.co.nz – info@semtech-solutions.co.nz ● We offer IT project consultancy ● We are happy to hear about your problems ● You can just pay for those hours that you need ● To solve your problems

Add a comment

Related presentations

Related pages

An introduction to Google Spanner - YouTube

A short introduction to Google Spanner, what is it and how does it work ? How does it relates to big table ?
Read more

Spanner: Google’s Globally-Distributed Database

Spanner: Google’s Globally-Distributed Database James C. Corbett, Jeffrey Dean, ... 1 Introduction Spanner is a scalable, globally-distributed database de-
Read more

Spanner (database) - Wikipedia, the free encyclopedia

Spanner is Google's globally distributed NewSQL ... Relations, Part II. The Relational Model", An Introduction to Database Systems (8th ed.), Addison ...
Read more

An introduction to zeppelin - Video Dailymotion

A introduction to zeppelin, what does it do and what is it used for ? How can it be used with Spark ? ... An introduction to Google Spanner
Read more

Google Spanner - GitHub Pages

Google’s Spanner. Spanner is Google’s globally distributed NewSQL ... Relations, Part II. The Relational Model”, An Introduction to Database ...
Read more

Spanner | LinkedIn

View 3916 Spanner posts, presentations, experts, and more. Get the professional knowledge you need on LinkedIn. LinkedIn Home What is LinkedIn? Join Today
Read more

Spanner: Google’s Globally-Distributed Database

... Google’s Globally-Distributed Database ... Google, Inc. Abstract Spanner is Google’s scalable, ... 1 Introduction Spanner is a scalable, ...
Read more

www.powershow.com

Hier sollte eine Beschreibung angezeigt werden, diese Seite lässt dies jedoch nicht zu.
Read more