Every published setup that reports this runtime, with its machines, models, quantization and reported results. Use the directory filters below to narrow by capacity, model or quantization.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
Daily OCR of math- and table-heavy PDFs into LaTeX-correct Markdown and Word, using Qwen vision models on llama.cpp instead of a smaller model that misreads numbers.
A developer reports shipping seven projects with a custom harness and customized llama.cpp inference server.
A laptop workflow combines Qwen Flash Next, llama.cpp and a DeepSeek harness, using system memory and SSD-backed loading to make a MoE model practical on 12GB of VRAM.
A contractor whose clients forbid commercial providers from reading their source code runs unit tests and code reviews locally on a 3090, with a long-context llama.cpp setup.
A custom harness layers a written skill and an orchestrator agent that dispatches tasks to five subagents, each starting from a clean context with hard test gates.
Not vibe coding: a custom harness on a patched llama.cpp build has shipped seven real KMP projects.
A NUC12 with a 16GB Intel Arc A770M handles a 262K-context Qwen build entirely in VRAM, coding in the background while the owner does something else.
