vram.wiki
My space Add your setup
Back to directory
Coding · 2026-09-13

Qwen 27B on SGLang at NVFP4 with a 180K context

A short but specific configuration note: Qwen 3.8 27B served with SGLang in NVFP4, deliberately capped at a 180K context to stay out of the degradation zone.

This person runs Qwen 3.8 27B locally with SGLang in NVFP4 quantisation and reports it working really well and impressively capable. They set the maximum context at 180K on purpose, to avoid pushing deep into the range where they feel output quality degrades.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · 4 upvotes at capture

View source

Correct or update this entry

Is this your setup? Claim it to keep the snapshot current

SETUP HISTORY

Snapshots over time

1 version
CURRENT2026-09-13Qwen 27B on SGLang at NVFP4 with a 180K context

A short but specific configuration note: Qwen 3.8 27B served with SGLang in NVFP4, deliberately capped at a 180K context to stay out of the degradation zone.

CodingHardware unspecifiedQwen 3.8 27BSGLang

This is the currently published snapshot.

Read next

CodingCoding a SaaS product on an M1 Max, one well-scoped feature at a timeCoding98% local, on a self-extended Pi Agent 'software factory'CodingThe first local model this person actually trusts with real work

Discussion

0 comments

No comments yet. Questions and corrections on this setup are welcome.

Leave a comment

Comments are reviewed before they appear. Keep it civil, cite your sources, and stay on topic.