Observability
Did Your Prometheus Sum Hide a Counter Reset?
One instance resets while the fleet total keeps rising. Follow the raw counters and see why Prometheus needs rate() before sum().
Observability
OpenTelemetry Overflow: Why Route Metrics Go Missing
An OpenTelemetry counter can keep its total after losing route detail. Find the overflow point, trace where labels disappeared, and verify the fix.
Opinion
The Alert That Fires Every Day Is Not an Alert
The page has been acknowledged without action for six weeks, and the acknowledgement is the decision, and the decision is that nothing is wrong, and the…
Opinion
The Runbook Nobody Reads at Three in the Morning
The document is thorough and long and correct, and the person on call at three in the morning needs three commands and one decision, and the gap between the…
Opinion
Your Logs Are a Product and Nobody Owns Them
Everyone writes logs and nobody is responsible for whether they can be read, so the incident arrives and the data exists, and the answer does not, and the…
DevOps
The Node That Evicted Everything Because Logs Filled the Disk
Container logs grew without rotation until the node hit disk pressure, and the kubelet evicted every pod on it, including the healthy ones, and the eviction…
Tooling
The Span Per Tool Call That Made One Agent Step Debuggable
The trace had one span for the whole run, which explained nothing, and one span per tool call turned an opaque minute into a readable sequence with a single…