Published on September 22, 2015
1. Performance Vision and Elastic Search / Hotrod Brett Airey September 2015
2. Products we use
3. What we do ! • Network Performance analysis. • Application Performance analysis. • Build Big Data Systems (Splunk & Hotrod) • Troubleshooting IT incidents full stack. • Manage and traffic-shape networks for maximum performance. ( Bandwidth still issue outside of major cities) • Custom Logging pipeline for Clients
4. The Challenges • Securactive - Technical Tool for the Tech’s • Disparate systems all have own Reporting • No Central point for Correlation and Collaboration. • Aggregation of Data , lose the ability to drill in to the fine resolution in a reasonable time period. Need more transparency of key Metrics
5. The Dream for resolving Incidents all stakeholders metrics in one place Incident COMMON TIME SERIES NETWORK METRICS ALL DEVICE ACCESS LOGS CHANGE CONTROL EVENTS SERVER RESOURCE METRICS APPLICATION METRICS / LOGS STORAGE PERFORMANCE METRICS APM NPM (Securactive )
6. Why we believe tools like Elasticsearch is the way • Open-source (Important community for us) • In memory searching, so it’s fast, scalable. • Has proven performance. • Hardware requirements low spec. • Works well with Docker “ Micro Services”
7. How we are doing it • HTML “API” into Securactive • Program ….. • Import • Naming convention - Std names ie Host,ipadd • HOTROD “ Panoptix”
8. Why HotRod into Elasticsearch • Authentication as standard. • Reader app to track highwatermark. • Alerting on variances to baseline. • Limit user view through role based access. • Loosley coupled, ability to change components with relative ease.
9. So how does it all work.. I am sure in the future versions we will get nicely formatted JSON. Performance Vision Elastic DB Hotrod/Elastic Interface
10. How it all fits Together
11. Harvesting Data from Securactive
12. The Elasticsearch Query
13. HotRod RESTful endpoint (API)
14. Displaying the Chart
15. Screen Shots Quick select periods and aggregation as well as Refresh interval for Dashboards
16. Screen Shots Visualise your key metrics
17. Screen Shots Visualise your Data using the extensive graphs available
18. HotRod is Opensource panoptix-za/HotRod · GitHub
They are a common way to let internal & external users access and modify data. ... Performance Vision ... custom dashboards in Elastic Search / Kibana ...
Elastic is building out Kibana, Elastic's Open Source Data Visualization ... be combined into custom dashboards that help users ... vision , disability ...
... Create Custom Dashboards in CA App Experience Analytics with Elastic Search and Kibana ... Search and Kibana Application Performance Management
... Elastic set forth a vision that search can ... Elastic is building out Kibana, Elastic's Open Source Data ... into custom dashboards that help ...
... Create Custom Dashboards in CA App Experience Analytics with Elastic Search and Kibana ... DO5T16S Vision and Roadmap: ...
... Servicemedarbejde at Vision Data A/S Education Erhvervsakademi Aarhus / Business Academy Aarhus, Erhvervsakademi Aarhus / Business Academy Aarhus, ...
... search and query performance, ... with their data through prebuilt and custom dashboards. ... Expand Your Data Search and Analysis Capability Across a ...