Skip to the content.

Solo developer on a flat-rate plan — UNDECIDABLE

One person running claude all day against a subscription. They are not paying per token, so the token bill is somebody else’s problem; what they feel is the session dying mid-task and having to re-explain everything. Their patience for setup is about one evening, and it competes with actually shipping. This is the largest population by headcount and the hardest to win, because the incumbent is already installed, already works, and costs them nothing to keep.

facet weight w_eff verdict β load vs
Run integrity 0.20 +1.00 CRUISE +1.00 +0.75 an agent loop that trusts its own completion report
Raw speed 0.05 -0.28 DRAG -0.03 +0.25 a raw SGLang endpoint, unmediated
Token economy 0.10 -0.63 DRAG -0.36 +0.25 bare claude, as installed
Steady-state ops 0.15 -4.06 REGRESSIVE -1.50 +0.25 bare claude, as installed
Session longevity 0.35 ? NEVER MEASURED
Injection control 0.05 ? NEVER MEASURED
Observability 0.05 ? NEVER MEASURED
Portability 0.05 ? NEVER MEASURED

Run integrity — +1.00 (CRUISE)

When you are not watching, does the run end in a state you can trust and resume?

Raw speed — -0.28 (DRAG)

How fast do tokens actually come out, against the hardware’s physical limit?

Token economy — -0.63 (DRAG)

For the same delivered work, how much of the input-token bill does it remove?

Steady-state ops — -4.06 (REGRESSIVE)

After you have adopted it, what does it cost every month to keep it running?

Session longevity — never measured (weight 0.35)

the deciding comparison for this buyer – fak’s compaction versus Claude Code’s own native auto-compaction, over a session long enough for both to fire repeatedly – has never been run. The repo has fak’s per-fire shed (~107K tokens against a 48K budget) but no measurement of the alternative on the same session, and docs/benchmarks/AUTHORITY-GENERATED-SAMPLE.md:465 states plainly that sessionbench has no checkpoint/resume. A number for one arm is not a comparison.

Next: run one long real task twice (bare claude vs fak manage -- claude), same prompt and same tools, and report turns-to-context-exhaustion and re-explanation events for both arms

Injection control — never measured (weight 0.05)

the formal-isolation tier fak’s 0/38 AgentDojo result is at parity with (CaMeL, MELON) costs more to deploy than this buyer’s entire tolerance, so it is not their next-best option – and no ASR measurement exists against what they would actually use, which is the host agent’s own permission prompts.

Next: run AgentDojo against bare claude with default permission prompting as the alternative arm, so the comparison is against the thing this buyer actually has

Observability — never measured (weight 0.05)

the alternative here is the agent’s own transcript, not an OTel tracing stack, and nobody has decomposed what a bare Claude Code transcript does and does not let you reconstruct after the fact.

Next: take one failed real session and score both artifacts against the same five decision classes (model traffic, cache reuse, compaction, tool verdicts, recovery)

Portability — never measured (weight 0.05)

for this buyer portability means keeping their agent and their login, not the model x backend grid; there is no committed comparison of what bare Claude Code locks in versus what fak locks in.

Next: enumerate the swap points (agent, provider, model, host) for both and mark which are actually exercised in CI