vram.wiki
My space Add your setup
Back to directory
Coding · 2026-09-11

The first local model this person actually trusts with real work

On a 12GB 5070, a heavily quantized Qwen 3.8 27B through a custom Hermes backend is, in their words, the first local model that's felt confidently productive.

Running Qwen 3.8 27B at a UD-Q2 quant through Hermes on a custom backend, on just a 12GB RTX 5070, this person calls it the first local model they've felt they could confidently use for productive work. It can take a while to work through a problem, but they describe it as thorough, genuinely able to code and debug rather than just producing plausible-looking output.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · 2 upvotes at capture

View source

Correct or update this entry

Is this your setup? Claim it to keep the snapshot current

SETUP HISTORY

Snapshots over time

1 version
CURRENT2026-09-11The first local model this person actually trusts with real work

On a 12GB 5070, a heavily quantized Qwen 3.8 27B through a custom Hermes backend is, in their words, the first local model that's felt confidently productive.

Coding1 machineQwen 3.8 27BRuntime unspecified

This is the currently published snapshot.

Read next

CodingCoding a SaaS product on an M1 Max, one well-scoped feature at a timeCoding98% local, on a self-extended Pi Agent 'software factory'CodingSwitching back a model version to escape endless self-checking loops

Discussion

0 comments

No comments yet. Questions and corrections on this setup are welcome.

Leave a comment

Comments are reviewed before they appear. Keep it civil, cite your sources, and stay on topic.