Unit tests and reviews for NDA-bound client code on a single 3090

This person's customers do not allow their source code to be read by commercial LLM providers, so the work runs locally on an RTX 3090 with 96GB of RAM. The main uses are generating unit tests and performing code reviews.

Their working configuration is Qwen 3.8 27B GGUF on llama.cpp with OpenCode, using a 163840-token context and q4_0 quantisation for both the K and V caches, which they found gave enough performance for that context size. They were surprised at how well it works.

Correct or update this entry

Is this your setup? Claim it to keep the snapshot current