Steve Waterworth - Asserts - Automation for Prometheus and OpenTelemetry stack

How to control costs of your Observability stack

Observability is mandatory but really expensive. Commercial tools provide convenience at a price. Open source tools are now mature enough to challenge those commercial offerings and provide considerable savings.

Prometheus

Prometheus Exporters and Libraries

Expanding Prometheus coverage of your applications is easy. Exporters can be added with just minor configuration changes. Adding client libraries for code coverage is just a few lines.

Prometheus

Prometheus - Getting data in is easy, getting value out is tough

With the minimal effort of a day, a Prometheus server can be up, running, and collecting data. However, as many soon find out this is but the first step of a very long and never-ending journey.

SLOs

Keep Your Applications SAAFE with Asserts

Asserts is built around the best practices laid out in the SRE Handbook [https://sre.google/sre-book/table-of-contents/] and uses SAAFE for its assertion categories extending the Golden Signals [https://sre.google/sre-book/monitoring-distributed-systems/#xref_monitoring_golden-signals] described in the handbook. Traditionally Golden Signals have used the Rate, Errors and

Tracing

Tracing is on Trial

Tracing is just structured logging at DEBUG level. Would you run logging at DEBUG in production? No!

Prometheus

An Introduction to Prometheus

Over the years it has become the de facto standard for time series metrics across the CNCF Landscape, with many projects providing a Prometheus metrics endpoint as standard.

Root Cause Analysis

Speed up RCA by Going SLO

Once you stop fretting over each individual service, you should change your monitoring strategy accordingly. Your primary consideration becomes making sure your application is processing requests in a prompt and error free manner.