Skip to the content.

vLLM related-system adjacency at 2026-08-26T22:35:00Z

Anchor corpus

Scope criteria

Include

Exclude

Declared set (14)

Processed members (14/14)

NVIDIA Dynamo (ai-dynamo/dynamo)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:9e49e551c3966f612159a773265363d753396d795ece243fdb59165a88676be2; file-sha256:6547f197b42a31ba78579d32f66de440f128d23e8a9ce417bdd72b0392577bd9; records:13979; bytes:45421438 Complete validated study-forge corpus at the shared cutoff and pinned revision 6fa28c2f84e0ceab4c4cf60f147f63dff77b7f17; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:0579a280eb576396695dac7b0e0b4a43c1bf953e7cbedec1e3513bf7e786f53b Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree partial Reused docs/research/inventory/ai-dynamo-dynamo.json at stale pin f494601e; 5,401 files were exhaustive there, not at the cutoff pin.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
dynamo-kv-router-planner KV-aware router and disaggregated planner ownership ai-dynamo/dynamo vLLM worker/backend integration, block-level KV events, prefill/decode disaggregation, and request scheduling Determines whether FAK should import routing signals and planner receipts while retaining native policy, cache, scheduling, and kernel ownership.

FlashInfer (flashinfer-ai/flashinfer)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:90ad57df79a5c82656c41aaeb644c807117f6c0cff1227053f3806ab6ea1bb4e; file-sha256:31b45236b77a1e279f909762075437b80629acfd1446e01f2d44ba8bbcd127a1; records:5203; bytes:17238820 Complete validated study-forge corpus at the shared cutoff and pinned revision e4b7fa4b7c3ba5e17286d9c59f2bcf2ca07e0a6d; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:901583878dc508e37e7bc6877575e3bcea1e732ba38baab4961e6310491d4a47 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree partial Reused docs/research/inventory/flashinfer-ai-flashinfer.json at stale pin fb28d724; exact cutoff tree remains uncaptured.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
flashinfer-plan-run-kernel-contract Reusable kernel plan/run workspace contracts flashinfer-ai/flashinfer vLLM attention and MoE backend integration, kernel selection, and reusable execution plans Changes how FAK can borrow optimized kernel contracts without yielding fak-native engine ownership.

llama.cpp (ggml-org/llama.cpp)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:f2b36ab2c7d52df411d588df4c18ba136702de4edca778728247cc99c82afca3; file-sha256:f865ff875d3f4af44d954f5bae5ea4e746b5649d48b17202e6ff43fc7f8fef8e; records:34633; bytes:114986090 Complete validated study-forge corpus at the shared cutoff and pinned revision 925e1179947ea0c0ebfb0032df18af3a729822be; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:bb7561b67dae0ce068cb1afd368457a03ca5ea9ab7b34fda9e801ae7fcc28638 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree complete docs/research/inventory/ggml-org-llama-cpp.json#upstream.tree.truncated=false Exact cutoff revision recursive tree: 3,871 entries, 3,498 blobs, 373 trees, not truncated.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
llamacpp-portable-native-frontier Portable GGUF single-binary runtime frontier ggml-org/llama.cpp llama.cpp’s CPU/GPU/Metal GGUF runtime and single-binary deployment change the portability and low-resource frontier relative to vLLM’s accelerator-first distributed serving. Keeps FAK’s native portability and artifact decisions honest while llama.cpp remains benchmark/reference only unless explicitly selected.

llm-d (llm-d/llm-d)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:89d9fbfa7ed92f44f5d6a303ddf99cc004f15c0ce66b3115cfa94f3fca72064e; file-sha256:e1c78998333edc530101554d13ec90c8c40758a2dbe6b7971490ffd2fec83bab; records:2470; bytes:5259930 Complete validated study-forge corpus at the shared cutoff and pinned revision bc20f73bd344b5a0faad5afca93831088aeee957; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:57c031e130d149f50ee163d60355ecbbd06ba15de421f960f58d76a11f5fa184 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree partial Reused docs/research/inventory/llm-d-llm-d.json at stale pin 3243fcf1; the exact cutoff tree is not captured.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
llmd-kv-event-endpoint-routing KV-event-aware endpoint selection and ownership boundary llm-d/llm-d vLLM serving pods, KV events, prefix locality, flow control, and prefill/decode disaggregation Changes whether FAK integrates external locality signals while remaining authoritative for policy and model selection.

TensorRT-LLM (NVIDIA/TensorRT-LLM)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:b80845eff4b726afc73a8aa3c7c64274bbef235a8f1964b6156a17bbf4634ef2; file-sha256:2fd1d9a546567b402df6db0a1c6a953ac1c89f2008bca1fb7d56357c399daaf1; records:18376; bytes:87650376 Complete validated study-forge corpus at the shared cutoff and pinned revision c2f5f31912bf2257bfc42f79fa6621766cd4f9e4; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:d45dd09104d1edd45b1737d57248bb9793e11f70f206a6eba4c3fa5b743985b6 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No machine-readable runtime tree inventory exists for c2f5f319; docs/notes/CONCEPT-STUDY-TENSORRT-LLM-2026-07-18.md is stale source guidance only.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
tensorrt-llm-compiled-runtime-frontier Compiled NVIDIA runtime and inflight-batching frontier NVIDIA/TensorRT-LLM vLLM continuous batching, paged KV management, quantized execution, and disaggregated serving Changes FAK’s borrow/bind/stay-minimal decisions for NVIDIA kernels, expert dispatch, quantization, and matched serving benchmarks.

SGLang (sgl-project/sglang)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:f1636085e8c9bfbb3a0c20fb4f684d329f76b8b17f54627001b22970ecaf0c7a; file-sha256:2103ccac2d04cc23e6a0bd405bd5ac5f6e1d6005efa81c83dc28490fe7d00056; records:36658; bytes:164718108 Complete validated study-forge corpus at the shared cutoff and pinned revision 7f27bf470824f452a34e866d22ab5e332a23e26f; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:114d9a9af75479da6cb8ca5bb4df91d4bc0ff3559d1225ac7dbf0d5309e7813f Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No standard inventory for full sgl-project/sglang at 7f27bf47; existing mini-sglang map is a different repository and cannot satisfy this member.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
sglang-radix-hicache-contrast RadixAttention and hierarchical cache contrast sgl-project/sglang vLLM PagedAttention, prefix caching, continuous batching, chunked prefill, and scheduler admission Changes FAK decisions on prefix identity, hierarchical residency, eviction, and whether to ride or own each cache seam.

vLLM attention-FFN disaggregation plugin (vllm-project/afd-plugin)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:76e106727641b361c9aa00b129fc7f8b7f0a02c652001b24a946a7e8697dc989; file-sha256:e1f191632e40c167aa9012f1142c8c12561fe7eaddbb249a5e8100eb86a05d63; records:290; bytes:1153460 Complete validated study-forge corpus at the shared cutoff and pinned revision b00e884c4e8eb542544d3eba623e74ca01252c92; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:5478d62c626fab3bfcb978ff3d46827a85270113f221a4f7ee3e3b06a57ea76c Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No pinned runtime tree slice is retained in git or allocated scratch for this run.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
afd-attention-ffn-disaggregation Attention/FFN disaggregation topology vllm-project/afd-plugin vLLM worker execution split across attention and feed-forward stages Changes the topology frontier beyond conventional prefill/decode disaggregation and can alter FAK routing and receipt boundaries.

AIBrix (vllm-project/aibrix)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:498dfd478eb302fc630665c0b23e66ff728e3caad168851e84a0c3f6d9800c25; file-sha256:f43e945d1fcb0a9131bf9aed741cd0ba5a1fb65160f16a351c5c94898f4ead62; records:2690; bytes:8549752 Complete validated study-forge corpus at the shared cutoff and pinned revision 7540088967a00a00d9e954688543914ec84ec832; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:8bf963bedc1b4fd3d55c0b32a840b25f50c23f1d0e01426dd5a2d85cb955caa3 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No pinned runtime tree inventory is present.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
aibrix-autoscale-cache-control Autoscaling and distributed cache-control frontier vllm-project/aibrix vLLM serving deployment, request routing, KV cache/offload, and replica management Separates external cluster elasticity from the FAK-native request policy, scheduling, and cache-ownership decisions.

vLLM Production Stack (vllm-project/production-stack)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:80a468dc2d1da9db5a752de66e69fce311274f533b8782739ba095b422e2b00c; file-sha256:57702b0369e5a9a68dfb407dd71af425aa11f0143cbe83eb93462f8d67da67a2; records:1088; bytes:4109839 Complete validated study-forge corpus at the shared cutoff and pinned revision 58a0935955d5b29f615c784a3533ff2433075bdd; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:1e45cba00cf8e04e5a30ef31858375d287db6b2ab866d40bbcd3a84a81ef8083 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No standard pinned runtime tree inventory was produced in this run.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
production-stack-kubernetes-topology Cluster-wide deployment assembly vllm-project/production-stack vLLM Kubernetes serving topology, replicas, routing, observability, and operational recipes Changes which deployment/operations conclusions are attributable to vLLM itself versus its reference production assembly.

vLLM Router (vllm-project/router)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:1973cac7a70d66f60cb0f778f05561eb184b0e39f3e61dd03241c361a902a97c; file-sha256:bbc3cf9f2dba1e006a3eb35e825f9b0c728141c9970589689ac34bedba4c3543; records:232; bytes:736345 Complete validated study-forge corpus at the shared cutoff and pinned revision 1d10e71fb7bb4c0adc9f2c16ec77bf5dd4aa1586; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:6000415ff90e6b649bd860b38b96980ff79252009cdcb221ac68bce0f66a201f Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No standard pinned runtime tree inventory was produced in this run.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
router-prefix-aware-placement Prefix-aware endpoint placement vllm-project/router vLLM request routing using prefix/KV residency and backend load Changes whether FAK should consume external residency signals or keep placement entirely inside its own fleet router.

vLLM Semantic Router (vllm-project/semantic-router)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:0955662d24595bed793fecd2b8ba64616b5961980ec16fdb00585a95af99792a; file-sha256:4b141321dabc1f2b2495f791a46804d699756aa87da3c0f66e24ddee394c7c33; records:3112; bytes:11625722 Complete validated study-forge corpus at the shared cutoff and pinned revision 2aaf0a647e491e8dde22a4ce6888975e358c9008; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:80e031c77a6249d52c331027c34ca49a155ba7ed588533a1481da8dc721a2b38 Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No pinned runtime tree inventory is present.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
semantic-router-model-choice Semantic model-choice control plane vllm-project/semantic-router Semantic routing chooses among heterogeneous model endpoints before vLLM execution, unlike prefix-aware placement among replicas and unlike FAK’s policy-constrained model routing. Prevents conflating semantic model selection, policy routing, and cache-aware replica placement into one mechanism.

vLLM Speculators (vllm-project/speculators)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:37d3929622cbda83b513febdd5bf601f6a4ca58c4e06c38a961ad99bb62d7b11; file-sha256:dd6210c8045fa95e2fdc298c765670b68e435555415497157c05633042cfa92e; records:1078; bytes:3839241 Complete validated study-forge corpus at the shared cutoff and pinned revision 51f8e02f077c9336f9e4cc66155e22127f354c5d; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:ae7848b63e4245d5d6ed8c8915a0e19bd91dda17a42132cf2ed07dc08b461d3b Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree partial Reused docs/research/inventory/vllm-project-speculators.json at stale pin 0faffeb3; exact cutoff tree is not inventoried.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
speculators-dynamic-draft-controllers Dynamic speculative-draft controllers vllm-project/speculators vLLM speculative decoding, draft-model loading, acceptance, and multi-token prediction Changes FAK decisions on adaptive draft length, acceptance telemetry, checkpoint alias regression tests, and when the external engine owns speculation.

vLLM GGUF plugin (vllm-project/vllm-gguf-plugin)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:e2c5eb1f769d6729dc4eee0899a52d8df116702ada123ff3a93a99ea4bbedfa0; file-sha256:7349113f2ff31fe8c0522a573d90eeb94e87e72b1692b32e6ed4e47a1531fd5a; records:140; bytes:392667 Complete validated study-forge corpus at the shared cutoff and pinned revision fb973ad784f38b98b054e136bec3414b7cd8494d; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:e78d016fc2451101764ecba28ee58f733a05fa7915773a6fcd93a44d606e068c Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No pinned runtime tree inventory is present.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
vllm-gguf-artifact-compatibility GGUF artifact interoperability vllm-project/vllm-gguf-plugin vLLM model loading and quantization-plugin interfaces GGUF is native to llama.cpp and FAK’s portable artifact path but enters vLLM through a separately versioned plugin, changing compatibility and benchmark-envelope assumptions. Keeps artifact identity and quantization evidence separate from token-engine performance claims.

vLLM Metal (vllm-project/vllm-metal)

Source-class receipts

Class Status Terminal receipt Notes
forge_history complete study-forge:sha256:2da0ed39efa76b19305d4f7039debb7245e6eb27101326e193f0dc7fcf17422d; file-sha256:c4e674cc13c122438aa5f862aa96de63b4586edaa693a525683da8994ede5902; records:1114; bytes:2288792 Complete validated study-forge corpus at the shared cutoff and pinned revision db4d7c57c7d72f731f7010fd3b60fc25fc489229; full corpus retained in allocated scratch.
repository_metadata complete github-graphql:defaultBranchRef.history(first:1,until=2026-08-26T22:35:00Z); response-sha256:99d629405d298eb28c0707403bca1bd692debf08a5c682a644c86712871ee3fd Authoritative GitHub GraphQL returned the canonical identity, default branch, cutoff revision, and commit timestamp. The normalized one-line response digest is retained here; raw responses remain allocated scratch.
runtime_tree missing No standard pinned runtime tree inventory was produced in this run.

Candidates (1)

ID Candidate Repository links vLLM mechanism Frontier-changing contrast Rationale
vllm-metal-apple-runtime Apple-Silicon vLLM-compatible runtime vllm-project/vllm-metal vLLM scheduler/API semantics mapped onto an Apple Metal backend A vLLM-compatible Apple backend changes the comparison baseline, but FAK must remain native rather than silently route native-performance work through another engine. Defines an optional comparator and interoperability source without weakening fak-native ownership.