BombadilLabs

The workshop

What we're building.

Four agentic systems, each a working answer to the same question: what becomes possible when an agent can prove what it did? These are active lab projects — the briefs below are the real ones, exhibits included.

in developmentsoftware engineeringautonomous maintenancesupply-chain security

Warden

The codebase custodian

The problem

Every engineering team carries an invisible second job: the custody of its own codebase. Issue triage, bug reproduction, dependency patching, flaky-test forensics, the long tail of "known, shallow, and nobody's priority." It is the work that makes everything else possible, and it loses the prioritization argument every single sprint.

Coding agents made it cheap to generate changes. They did not make it cheap to trust them. A pull request without a reproduction, a failing-then-passing test, and a scoped diff is not help — it's review burden wearing a helpful expression.

The bet

Warden is built on a simple inversion: the agent's job is not to write code, it's to produce evidence. Code is a byproduct.

For every piece of work it takes on, Warden assembles a case file:

  1. Reproduce. The bug is confirmed in a disposable sandbox, with a minimal failing test checked in before any fix is attempted.
  2. Fix narrowly. The smallest diff that turns the test green. No drive-by refactors, no opportunistic cleanup.
  3. Prove. Full suite, lints, type checks, and a risk note: what was touched, what could regress, what wasn't verified.
  4. Stand for review. The PR opens with the case file attached. A reviewer reads evidence, not vibes.

The same loop covers dependency custody — supply-chain-aware updates that quarantine new releases, read changelogs and diffs, and ship upgrades with proof that nothing observable changed.

Warden — case filefix: TOCTOU race in cache eviction
Reproduceconfirmedsandbox repro · failing test committed first: cache/test_evict_concurrent_readers
Fix narrowly+14 −32 files · no drive-by refactors · diff scoped to eviction lock ordering
Prove2,412 passedfull suite · lints · types · race detector re-run ×200, zero flakes
Risk notelowblast radius: cache layer only · not verified: Windows file-lock edge case
autonomy tier 2 — merge with reviewgate record 47 / 47

The case file is the product. Every Warden pull request opens with one — reproduction, scoped diff, proof, and an honest account of what was not verified. Reviewers read evidence, not vibes.

What makes it different

Most autonomous-coding products chase breadth: more languages, bigger tasks, flashier demos. Warden chases custody — the narrow, deep set of maintenance work where correctness is checkable and autonomy is therefore provable. Its autonomy budget is explicit: actions are tiered, every tier is gated on its own track record, and the gate moves only when the eval record says it has earned the move.

Where it stands

Warden runs against the lab's own repositories today — this site included — and is in development toward a private beta with a small set of teams who maintain serious production codebases.

research previewresearch synthesisknowledge systemsprovenance

Loremaster

A living review of everything you cannot afford to miss

The problem

The reading is unbounded and the readers are not. In any fast-moving field — AI itself being the worst offender — the half-life of a literature review is measured in weeks. Teams make consequential decisions on top of an understanding that quietly expired months ago, and nobody can say precisely which belief expired, because beliefs were never written down with their sources attached.

Retrieval-augmented chat doesn't solve this. Asking a model "what does the literature say?" produces an answer, but not an accountable one: no claim-level citations, no record of what was searched, no notification when the answer changes.

The bet

Loremaster treats a body of knowledge as a living artifact with a maintenance contract, not a one-shot summary.

  • Continuous reading. Agents monitor sources you designate — preprint servers, journals, standards bodies, internal docs — and triage what's new against what you already believe.
  • Claim-level provenance. Syntheses are built from atomic claims, each pinned to its sources, extraction date, and confidence. Every sentence in a brief can answer the question "says who?"
  • Contradiction detection. When new evidence undercuts a standing claim, the claim is flagged, the dependent conclusions are traced, and the humans who relied on it are told — proactively, with the receipts.
  • Auditable briefs. Output is a document a careful skeptic can verify: claims, sources, the search trail, and an explicit list of what was not covered.
Loremaster — contradiction flagged

standing claim · confidence 0.82

Agent task survival is consistent with a constant hazard rate — a fixed “half-life” per unit of task length.

Ord 2025 — The Half-Life of AI Agentsingested 2025-08-04
contradicted by

new evidence · auto-extracted

The measured 50%/80% horizon ratio is ~5×, not the ~3.1× a constant hazard predicts — failure risk falls as runs progress.

METR — Time Horizon 1.1ingested 2026-01-29
3 dependent briefs traced2 owners notifiedresolution: claim revised

A real flag from the lab's own agent-reliability literature base. The standing claim was three months stale when the new measurement landed; Loremaster traced the briefs that relied on it and notified their owners the same morning.

What makes it different

Synthesis tools optimize for the moment of asking. Loremaster optimizes for the months after — the slow drift between what the field knows and what your team believes. It is the difference between a search engine and a librarian who has read everything, remembers what you've read, and taps you on the shoulder at exactly the right moment.

Where it stands

Loremaster is in research preview inside the lab, where it maintains our own agent-reliability literature base. The provenance model and contradiction-detection evals are the current focus before we open it to outside research teams.

design partnersagent reliabilityevaluationverification

Mirrormere

See the reliability you actually have

The problem

Ask an agent team their model's benchmark scores and you'll get a slide. Ask them their verifier's catch rate — the fraction of agent mistakes their checks actually intercept — and you'll get silence. Nobody measures it. Yet Field Note 001 shows it's the single highest-leverage number in the stack: the catch rate sets a hard ceiling on how long an agent can run unattended, no matter which model is doing the running.

The failure mode this creates is specific and expensive: silent failures — the mistakes nothing caught, compounding quietly through a run, surfacing weeks later as a production incident with no breadcrumb trail. Teams respond by buying a better model. The arithmetic says they're shopping in the wrong store.

The bet

Mirrormere makes the catch rate a measured, managed quantity — the way latency and cost already are.

  • Replay, don't survey. Mirrormere ingests production agent traces and re-executes them in deterministic sandboxes against independent checkers — stronger models, property tests, invariant suites. Every divergence the original run didn't flag is a silent failure, caught and catalogued.
  • Measure the dividend. From the replay corpus, Mirrormere computes the team's actual catch rate and the runway multiplier it implies — and, more usefully, the multiplier sitting just beyond it.
  • Price the gap in months. Using METR's measured doubling cadence, the report converts "raise your catch rate from 62% to 90%" into "ship the horizon gain of ten months of model progress, this quarter, for about 1% overhead." Reliability work finally arrives at the budget meeting with a number attached.
  • Attack the blind spots. Misses are clustered by failure mode, ranked by mass, each paired with the cheapest checker that would have caught it. The roadmap writes itself in priority order.
Mirrormere — reliability reportfleet: order-ops agents · 30-day window
runs replayed1,41231 silent failures surfaced
measured catch rate62%current dividend: 2.6×
at 90% catch rate9.9×checker upgrades identified: 4
headroom+5.6 moof frontier progress, on the shelf
top blind spotSchema-valid but semantically wrong tool outputs — 38% of missed failures. Recommended checker: property tests on tool post-conditions, est. one sprint.

A representative engagement report. Mirrormere replays production traces against independent checkers to measure the catch rate a team actually has — then prices the gap between that and the catch rate they could have, in the only unit that survives a budget meeting.

What makes it different

Evaluation products grade the actor — pass rates, leaderboards, regression suites for the model's behavior. Mirrormere is the only instrument pointed at the checker. That inversion comes straight from the lab's research: the verifier's dividend means a point of catch rate is worth more than a point of model quality, and it's purchasable without waiting for anyone's training run. We built the instrument we kept needing on our own engagements.

It's also honest about what it is. Mirrormere doesn't promise your agents won't fail. It promises you'll know — loudly, with the receipts, and with the cheapest path to fewer misses already costed.

Where it stands

In design-partner engagements with teams running agent fleets in production. The replay harness and the failure-mode taxonomy are stable; the current work is hardening trace ingestion across the major agent frameworks. The math underneath is published, unit-tested, and running live in Field Note 001 — the rare case where the product demo is an essay.

research previewEthereumagent economyverification

Goldberry

Proof of conduct for economic agents

The problem

The agent economy arrived onchain faster than anyone scheduled it. ERC-8004 went live on Ethereum mainnet in January 2026 and crossed two hundred thousand registered agents across twenty-plus networks in its first quarter; x402 settled its hundred-millionth agentic payment on Base around the same time. The registries answered who is this agent and the payment rail answered how does it get paid.

Nobody shipped the answer to should you let it touch your money. The standard's own Validation Registry — the part that would make "trustless agents" mean something — remains under revision, and the spec authors say so plainly. Meanwhile audits of the registries find the overwhelming majority of registered agents are dead endpoints, and reputation, where it exists, is a feedback field anyone can farm. The result is a market where identity is cheap, claims are free, and verification is nowhere: exactly the conditions under which capital correctly refuses to delegate.

The bet

Goldberry makes an agent's conduct a first-class, slashable, onchain fact. Three mechanisms, composed:

  • Policy-scoped execution. Every Goldberry engagement runs under an EIP-7702 session key whose policy — venues, sizes, counterparties, loss bounds — is enforced at the account layer, not promised in a system prompt. The agent physically cannot exceed its mandate; the mandate is readable by anyone before they delegate.
  • Staked re-execution. Sampled jobs are replayed by independent validators in deterministic sandboxes against the same inputs, with results posted through ERC-8004's validation hooks. Validators stake against their attestations; catching a deviation pays, signing a false pass slashes. Verification becomes a market with the correct sign on every incentive.
  • Conduct-gated settlement. Payment flows over x402 with a holdback that releases when validation clears. Intent-based order flow (ERC-7683) keeps execution venue-agnostic; the conduct record travels with the agent's identity, not with any one chain.

An agent operating under Goldberry doesn't ask to be trusted. It accumulates a public record of policy-bound, re-executed, stake-backed work — and "trust me" becomes "slash me."

Goldberry — conduct pipeline
MandateEIP-7702 policy keyExecutionERC-7683 intentsValidationERC-8004 staked re-runSettlementx402 holdback releasebefore the runthe gatedeviation caught → validator paid, agent slashed“trust me” becomes “slash me”

The gate is the product. Execution is policy-bound before it starts, re-executed by staked validators after it ends, and settlement clears only when conduct does. A deviation doesn't argue — it slashes.

What makes it different

This is the lab's reliability research with money on the line. Field Note 001 derives why verification, not actor quality, is the binding constraint on how much autonomy a system can be given — the verifier's dividend. Goldberry is that same arithmetic applied to economic delegation: raise the catch rate on misconduct and you raise, mechanically, the amount of capital it is rational to leave in an agent's hands. Everyone else in the agent economy is scaling the actor. We're scaling the verifier, because that's where the dividend is.

It's also deliberately unglamorous about scope. Goldberry doesn't trade memecoins, predict markets, or promise yield. It is plumbing — the conduct layer the standards left open — built to be the boring, load-bearing thing every serious economic agent ends up standing on.

Where it stands

Research preview. The policy-enforcement layer and the deterministic re-execution harness are running against testnet deployments of the ERC-8004 registries; the validator economics are being red-teamed on paper before they're red-teamed by the internet. We're talking with teams operating real agent fleets who want their conduct on the record — the strongest possible signal in a market of dead endpoints.