Back to directory
Coding · 2026-09-11

A context-aware router working on the first try

A router in front of compiled llama.cpp servers, feeding Qwen 3.8 27B through OpenCode with downloaded skills, worked essentially out of the box.

This person set up a context-aware router in front of compiled llama.cpp servers, running Qwen 3.8 27B through LM Studio and OpenCode with downloaded skills — and says it worked correctly almost immediately, with the remaining effort going into extra features and optimization rather than getting it functional at all. They expect it to eventually handle most of what they currently use Opus 4.8 for at work, just at a slower pace, and say it's already usable for that today.

VERIFIABLE SOURCE

Reported anonymously by an r/LocalLLM contributor · 2 upvotes at capture

View source
SETUP HISTORY

Snapshots over time

1 version
CURRENT2026-09-11A context-aware router working on the first try

A router in front of compiled llama.cpp servers, feeding Qwen 3.8 27B through OpenCode with downloaded skills, worked essentially out of the box.

CodingHardware unspecifiedQwen 3.8 27BLM Studio

This is the currently published snapshot.

Discussion

0 comments

No comments yet. Questions and corrections on this setup are welcome.

Leave a comment

Comments are reviewed before they appear. Keep it civil, cite your sources, and stay on topic.