Coding · 2026-09-13

Qwen 27B on SGLang at NVFP4 with a 180K context

A short but specific configuration note: Qwen 3.8 27B served with SGLang in NVFP4, deliberately capped at a 180K context to stay out of the degradation zone.

This person runs Qwen 3.8 27B locally with SGLang in NVFP4 quantisation and reports it working really well and impressively capable. They set the maximum context at 180K on purpose, to avoid pushing deep into the range where they feel output quality degrades.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · score 4

View source

Correct or update this entry

Is this your setup? Claim it to keep the snapshot current

SETUP HISTORY

Snapshots over time

1 version

CURRENT2026-09-13Qwen 27B on SGLang at NVFP4 with a 180K context

A short but specific configuration note: Qwen 3.8 27B served with SGLang in NVFP4, deliberately capped at a 180K context to stay out of the degradation zone.

CodingHardware unspecifiedQwen 3.8 27BSGLang

This is the currently published snapshot.

Qwen 27B on SGLang at NVFP4 with a 180K context

Snapshots over time

Read next