Projects

Systems built to answer a measurable question. Each one is running somewhere a stranger can reach, its benchmark reproduces from one command, and its published result includes whatever came out worse than hoped.

Retrieval / Security2026
Count-Stable Permission-Aware Retrieval
RAG over permissioned documents leaks through result counts. Filtering after retrieval makes absence measurable, so a junior engineer can map what is hidden from them without reading a word of it.
17 restricted documents revealed becomes 0
What does not work
A relevance channel survives. Padded results share no terms with the query, so the person receiving them can spot the filler and recover the full original inference by reading — 15/15 exact, one request, no statistics.
Read the writeup →Live instance Source
Infrastructure / Cost Control2026
A Spend Ceiling That Holds Under Concurrency
Configured LLM budgets do not block. Cost is unknowable until after the money is spent, so a limit checked after the call is a report, not a control — and four common patterns fail open by 95–100%.
Four post-hoc patterns fail open by 95–100%; reserve-then-settle holds at 0%
What does not work
The first deployment overran its own ceiling by 303% in production — 25 concurrent requests were served by 25 serverless instances, each holding a separate in-memory ledger. The failure mode was already documented in the code that shipped it.
Read the writeup →Live instance Source
Protocols / Tooling2026
MCP Protocol Conformance Auditing
Protocol conformance is mechanically checkable, and checking it finds real defects in servers whose authors have read the spec. The first server audited was my own; it failed 6 of 8 MUSTs.
4 of 5 public MCP servers accept requests from any website
What does not work
No audited server implements the revision being checked. All five target earlier revisions, so 26 of 31 findings are version gaps rather than defects — and a naive audit would have reported all 31 as violations.
Read the writeup →Live instance Source

Count-Stable Permission-Aware Retrieval

A Spend Ceiling That Holds Under Concurrency

MCP Protocol Conformance Auditing