CodingGenesis archive2026-09
Qwen 3.8 27B at a true 128K context with vision on a single 16GB RTX 5080 (NInfer)A purpose-built engine (NInfer v1.3) fits Qwen 3.8 27B at a real 131,072-token context and KV capacity, plus vision, on one RTX 5080 16GB, qualifying ~71.6 tok/s decode and ~1,381 tok/s prefill on a 118,001-token prompt.