Monitoring with Stackdriver

43 %
57 %
Information about Monitoring with Stackdriver
Technology

Published on March 4, 2014

Author: nonsenso

Source: slideshare.net

Description

A presentation on how we came to find Stackdriver for system and service monitoring, how we implemented it and how we use it on a day to day basis.

Monitoring with Stackdriver Or: How I Learned How to Stop Worrying and Dig Hosted Monitoring. denise stockman - denise@stockmans.org

Mad Props Thanks to Coupa for hosting and to Stackdriver for sponsoring and to Advanced AWS for organizing.

Hi, I’m denise ● ● ● ● ● System Architect @ Maverix Biomics 18 years button pushing Musical Chair Champion Data center to cloud Early Stackdriver user & puppet module maintainer

What is Stackdriver? “Intelligent Monitoring for your AWS Infrastructure, Systems and App”

Agenda ● ● ● ● ● ● The Environment Selection Process Implementation Day to Day TODO Questions

A Diverse Stack

Further Context ● ● ● ● ● Green field! We treat instances like cattle* Modern and crusty backend services “Quaint” team Monitor & report system, service, event and application statistics in one place. * As much as possible

What to do for monitoring? Evaluate & Select ● In-house or hosted? ● Modern vs proven? ● Specialized vs general? ● Paid vs free?

Let’s Be Honest ● ● ● ● Not enough time Small environment More important work to do Everyone else is doing it

Winner, Winner, Chicken Dinner ● ● ● ● ● ● ● System & service metrics Alerting Custom metrics & annotations collectd agent Anomaly detection AWS integration & cloud friendly Cost per resource

Implementation

Consistent Resource Naming Resource name format env-function-id.location.domain.com Tags for resources env, owner, purpose, version

● ● ● ● Installs base agent on all hosts Configures API key Includes plugins for supported services Auto-upgrades agent node /^dev-redis.*.stockmans.org$/ { class { "stackdriver::redis": stackdriver_redis_port => 6379, stackdriver_redis_host => localhost, stackdriver_redis_timeout => 2000, } } Agent Deployment

● ● ● ● Create groups based on filtering criteria Dashboards auto-created for each group Groups used in custom dashboarding and alerting policies Set it once and fuggetaboutit* Groups

Alerting

Day to Day Use

Custom Dashboards

Anomaly Detection

Event Correlation

Event Logging

curl -X POST -H "x-stackdriver-apikey: DOOOOWEEEEOOOO" -H "Content-Type: application/json" -d '{"message":"Mind taking!", "annotated_by":"Mentok"}' https://event-gateway.stackdriver.com/v1/annotationevent Annotations

Ruby example customer_id = 31337 api_key = "DOOOOWEEEEOOOO" StackDriver.init customer_id, api_key redis = Redis.new mindsTaken = redis.zcard("minds:taken") StackDriver.send_metric "mentok.minds.taken", mindsTaken, Time.now.to_i Custom Metrics

TODO.txt ● ● ● ● ● Expand app metrics with statsd Automate group creation & management Annotate orchestrated events Cloudwatch custom metrics Stackdriver @ our colo

Thanks! Questions? denise stockman denise@stockmans.org github.com/maverixbio/puppet-stackdriver-agent forge.puppetlabs.com/dstockman/stackdriver

Add a comment

Related presentations

Related pages

Cloud Monitoring as a Service for AWS and Rackspace

Introducing Google Stackdriver. We recently announced Google Stackdriver, an integrated monitoring, logging, and diagnostics solution for Amazon Web ...
Read more

About Stackdriver, the intelligent monitoring company

Stackdriver provides AWS monitoring-as-a-service with unprecedented intelligence. Venture-backed with a team of DevOps and SaaS experts
Read more

Stackdriver - Hybrid Monitoring | Google Cloud Platform

Google Stackdriver BETA Monitoring, logging, and diagnostics for applications on Cloud Platform and AWS Try It Free
Read more

Stackdriver | Server Monitoring (BETA)

Stackdriver now has beta support for monitoring any server anywhere and not just servers in your cloud environment. With Stackdriver server monitoring, you ...
Read more

Monitoring Agent Overview | Stackdriver Monitoring ...

Beta. This is a Beta release of Stackdriver Monitoring. This feature is not covered by any SLA or deprecation policy and may be subject ...
Read more

Stackdriver | Kafka Monitoring

As you install the Kafka plugin on your instances, Stackdriver will populate the Kafka service page with inventory and metrics.
Read more

Introducing Google Stackdriver: unified monitoring and ...

The same support for AWS is maintained throughout Stackdriver, from IAM-based setup and API integration to preconfigured dashboards for widely used AWS ...
Read more

AWS Case Study: Stackdriver

Founded in 2012, Stackdriver provides a monitoring service for cloud-powered applications, enabling its customers to track performance and availability of ...
Read more

Stackdriver Uptime Monitoring - YouTube

Stackdriver Uptime Monitoring provides endpoint checks to web applications and other HTTP(S) services running on your cloud environment. With ...
Read more