Skip to main content

# lab note

LLMs for Ops: log triage that can’t leak or lie

A retrieval-first incident summarizer with hard data boundaries and a disable switch.

1 min readLLMs for Ops

Sean · wrote this at the bench

aiobservability

An LLM that reads logs is useful right up until it invents a root cause or ships a secret to an API. We built guardrails first, capability second.

The problem

A small, annoying task that was eating time and attention every week. We measured it before touching anything.

The approach

One focused change, reproducible, with a guardrail and an obvious way to turn it off. No magic, no vibes.

$ ./run --dry-run
[ ok ] plan looks sane
$ ./run --apply

The receipts

Before/after benchmarks, the failure modes we hit, and the tradeoffs we accepted. The repo has the full runbook.

$ subscribe --email

Automation patterns and lab updates. No hype, no spam.