Low-Cost, Unlimited Metrics Storage with Thanos: Monitor All Your K8s Clusters Anywhere and More.
Conference (INTERMEDIATE level)
Dhalia
As enterprises scale Kubernetes across multiple clouds and on-prem, monitoring distributed clusters gets complex. Traditional solutions struggle with high metric cardinality, long data retention needs, and querying across diverse environments. This session explores Thanos, a highly available metric system complementing Prometheus, providing a powerful, cost-effective solution for unlimited metrics storage and querying in multi-cloud Kubernetes.
We'll dive into Thanos' architecture: Sidecar, Receiver, Compactor, Store Gateway, and Querier. Learn to set up Thanos to aggregate and store metrics from multiple Kubernetes clusters across clouds, enabling long-term retention and efficient PromQL querying.
We'll cover optimizing resource utilization, reducing storage costs, and integrating Thanos with Grafana for visualization. Gain insights into implementing a scalable, cost-effective, highly available monitoring solution for multi-cloud Kubernetes.
Key topics: Monitoring multi-cloud K8s challenges, Thanos architecture, setting up components, configuring Prometheus forwarding, leveraging cloud storage for cost-effective retention, querying/visualizing across clusters with Grafana, optimizing resources/costs, and best practices for multi-cluster monitoring.
By session's end, attendees will understand implementing Thanos for cost-effective, unlimited metrics storage and monitoring in multi-cloud Kubernetes, enabling better visibility, efficiency, and cost optimization.
We'll dive into Thanos' architecture: Sidecar, Receiver, Compactor, Store Gateway, and Querier. Learn to set up Thanos to aggregate and store metrics from multiple Kubernetes clusters across clouds, enabling long-term retention and efficient PromQL querying.
We'll cover optimizing resource utilization, reducing storage costs, and integrating Thanos with Grafana for visualization. Gain insights into implementing a scalable, cost-effective, highly available monitoring solution for multi-cloud Kubernetes.
Key topics: Monitoring multi-cloud K8s challenges, Thanos architecture, setting up components, configuring Prometheus forwarding, leveraging cloud storage for cost-effective retention, querying/visualizing across clusters with Grafana, optimizing resources/costs, and best practices for multi-cluster monitoring.
By session's end, attendees will understand implementing Thanos for cost-effective, unlimited metrics storage and monitoring in multi-cloud Kubernetes, enabling better visibility, efficiency, and cost optimization.
Zakaria EL BAZI
NetApp
I am a DevOps/SRE engineer with more than 5 years of experience from Morocco (Ouarzazate) and now based in France (Paris). I specialise in containerisation technologies such as Docker and Kubernetes, and have solid experience in data engineering, Big Data solutions and information security. My certifications include Kubernetes (CGOA, KCNA, CKA in progress) and Cloud (Azure, Aws solution architect, Terraform certified associate).