AI Featured Building an AI Gateway Building an AI Gateway to centralise common LLM use case cross functional requirements, to accelerate LLM product development.
Kubernetes Moving to Native Sidecars Upgrading all our sidecar containers to Kubernetes Native Sidecars, including cloudsql-proxy and istio-proxy.
Istio Retry Policies in Istio The default retry configuration on Istio is not safe, and can retry requests you may not want retrying!
Istio Upgrading to Istio 1.21.x Upgrading Istio from 1.20 to 1.21. Issues with JWT auth in dynamicMetadata and AuthorizationPolicies.
Istio Featured Compress your Mesh How to transparently compress response traffic between your microservices, consistently, using EnvoyFilters in Istio
Cloudflare Featured Incident Summaries using LLMs How to use llama-2 7b to generate summaries of your incidents, using Cloudflare workers and Workers AI. Including Pirate mode.
Kubernetes Alert and Incident Enrichment Evolution of Alerting and Incident Management: Navigating Chaos in a Remote Work Era. From Desk Huddles to Digital Collaboration and how we adapted.
Kubernetes To Auto Scale or not to Auto Scale, that is the question The challenges of Auto Scaling, from cold start impact, tech debt, and cost realities. Prioritising scaling as code and shared responsibility for optimal performance in cloud efficiency.
Istio Scaling the Sidecar Scaling Istio Sidecars, and how we consider the relationship of Sidecar resources tightly coupled to the application.
Elasticsearch Speeding up Jaeger on Elasticsearch How to improve the performance of Jaeger when using Elasticsearch as the storage backend.
Prometheus Featured Anomaly Alerting in Prometheus Exploring how to do anomaly alerting on seasonal data in Prometheus.
Kubernetes Enabling GZIP Response Compression with EnvoyFilter How to enable GZIP compression of responses using EnvoyFilter
Kubernetes Managing Services: Metadata Capturing, validating, storing and discovering service metadata. Keeping that metadata consistent across numerous integration points.
Kubernetes Cold Start Applications Using Istio, Kubernetes and Prometheus to build dynamically scaling infrastructure that can scale unused workloads to zero.
Istio Using EnvoyFilters to Debug Requests Using EnvoyFilter to debug HTTP requests, and locate those missing important tracing headers
Kubernetes Kubernetes Service Discovery Storing rich metadata as Custom Resources on the Kubernetes API to enable Service Discovery.
Istio CI for Istio Mesh How we build, test and release Istio across 5 environments using a custom release process + chart.
Istio Upgrading to Istio 1.8 & 1.9 Some good news! 1.8 and 1.9 were a lot less painful than previous releases, so I bundled them into a single blog post. Remember that you shouldn't skip-version upgrade so if you're still on 1.7, go through 1.8 to 1.9. This
Istio Upgrading Istio to 1.7 Upgrade from 1.6 to 1.7 was less effort, but caused more impact than previous releases. Memory usage jumped again, but there's light at the end of the tunnel.
Istio Upgrading Istio to 1.6 Upgrade to Istio 1.6 was quite painful. This post details all the issues we faced and how we tackled them - to hopefully save others some time.
Istio Istio Upgrades: Prometheus SDS How to handle the migration to Istio SDS in your prometheus instances.
Istio Istio at Scale: Sidecar Configuring Istio using the Sidecar resource to minimise the load and footprint of both the control and data plane at scale
Istio Locality Aware Routing Talking through the Pros and Cons of the default-enabled Locality Aware Routing on Istio and the steps you can take to make it work for you.
Istio Reduce Istio Sidecar metric cardinality How to configure the Istio stats EnvoyFilter to reduce the cardinality of metrics in istio-proxy to greatly reduce the load on Prometheus