Skip to the content.

Answer-degeneration detection alternatives — 2026-08-10

Status: INCOMPLETE. Issue #6370 tracks real provider/generation witnesses.

The same coherent response, phrase loop, short-period byte loop, and repeated-line loop are classified without false positives. Arms: fak native multi-signal detector; exact-line baseline; fak + OpenAI; fak + Anthropic; llama.cpp; vLLM; Transformers; NeMo Guardrails. OpenAI conformance and MCP interop are separate package capabilities. Completion requires precision/recall, reason accuracy, latency/throughput, tokens/resources/network, setup/operator time, total cost, pinned models/settings/commands, and independent labels. Three Windows/amd64 samples were 1,657,279, 930,215, and 645,095 ns/op (median 930,215 ns/op; about 3.28 MB/op; 304-309 allocs/op). Unavailable arms stay measurement-zero; no cross-system ranking exists yet.