CodingGenesis archive2026-09
Qwen 27B on SGLang at NVFP4 with a 180K contextA short but specific configuration note: Qwen 3.8 27B served with SGLang in NVFP4, deliberately capped at a 180K context to stay out of the degradation zone.
Capacity range
Exact reported VRAM
Practice
Model
Quantization
Context length
Reported speed
Runtime
Tools / workflow (harness)
Record origin
EXPLORE BY CAPACITY
Start with your machine.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
8 GB or lessLaptops, iGPUs and modest cards9–12 GBEntry-level local inference13–16 GBCurrent mid-range cards17–20 GBRX 7900 XT and compact pro cards21–24 GB3090, 4090 and 7900 XTX class25–32 GB5090 and workstation cards33–48 GBWorkstation and multi-GPU setups49–96 GBLarge multi-GPU and datacenter setups97 GB+Unified memory, servers and clusters
2 resultsEvery record keeps its origin visible.
CodingGenesis archive2026-09
Eight A100s in tensor-parallel, inside a company with a hundred moreA large enterprise deployment: eight A100 80GBs running Qwen 3.8 under SGLang with tensor parallelism, while the company brings newer B200s online for bigger models.