Scaling Deployment at Etsy

48 %
52 %
Information about Scaling Deployment at Etsy

Published on April 18, 2013

Author: mrtazz



How we keep deployments fast at Etsy presented at Scaleconf 2013

Scaling Deployment at EtsyDaniel, April 18, 13

Thursday, April 18, 13

the marketplace we maketogetherThursday, April 18, 13

February 2013•1.49 billion page views•4,215,169 items sold•$94.7 million of goods sold•22+ million members•800,000+ active shops | Items by RockerDollJewellery, ZulamimiLand, codice, 42ThingsThursday, April 18, 13

LAMMPItem by TheBackPackShoppeThursday, April 18, 13

Item by FrankelPhotosMonolithic AppThursday, April 18, 13

No BranchingItem by NurseryWallArtThursday, April 18, 13

Deploy FrequencyThursday, April 18, 13

First DayItem by flowersandfleuronsThursday, April 18, 13

Thursday, April 18, 13

IRCThursday, April 18, 13

Thursday, April 18, 13

DeveloperVMs•KVM•Dev version of full Etsy stack•Chef•DevToolsThursday, April 18, 13

Thursday, April 18, 13

Item by codecardsThursday, April 18, 13

% review -r dschauenbergThursday, April 18, 13

automatically assignedautomatically assignedThursday, April 18, 13

TryItem by CSSDesignThursday, April 18, 13

Actually ...Thursday, April 18, 13

CI - The Old Way•~10 buildtest servers, single SSD•running multiple Jenkins executors•tests pegging IO•Jenkins is much better at running single executorsThursday, April 18, 13

The BobsItem by SignzThursday, April 18, 13

The Bobs•LXC containers on buildtests•Multiple SSDs•Labels for heavy/any execution•One heavy executor per diskThursday, April 18, 13

CI/Try•~200 Bobs•Mostly for try•Constant monitoring for slow testsThursday, April 18, 13

push trainItem by decomodwallsThursday, April 18, 13

#push•IRC channel to organize push trains•Join a train if you want to deploy changes•Schedule is planned via the channel topic•First in the train is the driver (controls the deploy)•Opening hours: 7am - 10pm NYC timeThursday, April 18, 13

#push<prod> kseever* + jameslee | jpaul | DanielConvissor (c)Thursday, April 18, 13

#pushbateman* + krunal* + enorris* | tristan (c) + jameslee (c)+ jlaster (c) | dawa + corey + sandosh + jklein + magera+ seth_home + mpascual + nathan | bateman | russp (c)Thursday, April 18, 13

pushbot•.join•.in•.good•.doneThursday, April 18, 13

pushbotThursday, April 18, 13, April 18, 13

Item by EsalonPhotographyThursday, April 18, 13

DeployinatorThursday, April 18, 13

Thursday, April 18, 13

Thursday, April 18, 13

stale commitsThursday, April 18, 13

version checksbuttons disabledbuttons disabledThursday, April 18, 13

version checksThursday, April 18, 13

lock down deploysThursday, April 18, 13, April 18, 13

Dashboardsdeploy linesdeploy linesThursday, April 18, 13, April 18, 13

SupergrepThursday, April 18, 13, April 18, 13

Thursday, April 18, 13

Summary•Current setup has scaled to ~150 people•Constantly trying to improve the speed of deployment•Find weak parts in the process and make them morerobust/faster•Bring Dev closer to Prod•Not being able to deploy has the same status as the sitebeing downThursday, April 18, 13, April 18, 13

Questions?Thursday, April 18, 13

Scaling Deployment at EtsyDaniel, April 18, 13

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

Scaling Deployment at Etsy - Hakka Labs

In this talk, Scaling Deployment, Daniel Schauenberg of Etsy talks about the development and deployment infrastructure at Etsy.
Read more

Daniel Schauenberg: Scaling Deployment at Etsy - YouTube

At Etsy we have over 100 engineers deploying more than 40 times a day. This culture of continuously deploying small change sets enables us to ...
Read more

Scaling Deployment at Etsy // Speaker Deck

Scaling Deployment at Etsy by Daniel Schauenberg. Published April 18, 2013 in Technology. How we keep deployment fast at Etsy, presented at Scaleconf 2013.
Read more

Scaling Software Deployment at Etsy by Daniel Schauenberg ...

Scaling Software Deployment at Etsy by Daniel Schauenberg Hakka Labs. ... Daniel Schauenberg: Scaling Deployment at Etsy - Duration: 44:28.
Read more

ScaleConf - Schedule

Continuous deployment to millions of users 40 times a day ... Scaling Infrastructure at Etsy ... this schedule is tentative and subject to ...
Read more

Etsy - Engineering Talks

Etsy Talks Presentations by the people who build and run Etsy. Featured Presentations. ... Scaling Deployment at Etsy (revised) Daniel Schauenberg. October ...
Read more

Scaling CI at Etsy: Divide and Concur, Revisited - Code as ...

Very interesting idea and plugin to divide your projects into logical jobs – Your master jobs are deployment to prod, qa, princess for each of your tabs ...
Read more

Scaling startups – Chad Dickerson's blog

The Scaling Startups panel I was on last week at Supernova generated a little coverage, ... Before Etsy, I had done the ... Scaling a Startup, jQuery ...
Read more