Notes on building AI agents that regulated teams can actually trust.
Most agent platforms give you a trace. Traces are mutable observations. Here's why regulated teams need a sealed, replayable record instead — and what changes when they have one.
Almost every agent tool can show you a trace of what happened: the prompts, the tool calls, the output. That's useful for debugging. It is not the same as proof.
A trace is a mutable observation — it lives in a logging service that someone with access can edit, drop, or lose. When your risk team asks "prove this agent only did what it was authorized to do," a trace can't answer, because nothing stops it from having been changed after the fact.
A sealed ledger is different. Every consequential action is hash-chained: each record commits to the one before it, so a single altered or missing entry breaks the chain and is detectable. Pair that with version-pinned inputs and you can replay any decision exactly as it happened — which policy applied, which model version, what it cost.
The practical payoff isn't philosophical. It's that a compliance officer can sign off on an AI system for the first time, because for the first time they can verify — not trust — what it did.
A confidence threshold that's stored but never compared. A delegation that's minted but never checked. We shipped the boring, critical work of turning governance you model into governance that actually stops an action.
It's surprisingly common for a platform to model a control and never enforce it. A policy has a confidence threshold — but nothing compares against it. An agent is granted a delegation — but no tool call ever checks whether it's still valid.
That gap is invisible in a demo and fatal in a security review. The control exists on the screen; it does nothing in the runtime.
The unglamorous fix is to wire each control to the exact point where it can stop an action: compare the confidence gate before auto-executing; check the delegation at every tool call so a mid-run revoke hard-fails the next step; require the second approver before the risky action runs, not after.
It doesn't demo any differently. But it's the difference between "we log everything" and "here's proof it couldn't have happened."
Unattended agents are where the value is — and where the fear is. A fleet-wide spend ceiling, a one-click emergency stop, and trust that a human can't be talked out of make "let it run" a decision an executive can actually make.
The value of agents shows up when they run without a human in the loop — draining a queue overnight, chasing a standing goal, sending the morning digest. That's also exactly where leaders get nervous, and they're right to.
What makes unattended autonomy safe isn't a better prompt. It's a governor: an aggregate ceiling on how much the whole fleet can spend or do in a day, a kill-switch that freezes everything and cancels in-flight work in one click, and an autonomy level that rises only as an agent proves reliable and tightens itself the moment quality slips.
With those in place, "turn autonomy up" stops being a leap of faith and becomes a dial an executive can move — and move back — with confidence.
Want these in your inbox? Say hi →