Every published setup that reports this model, with its machines, quantization, runtime and reported results. Use the directory filters below to narrow by quantization, capacity or runtime.
Observed across 19 published setups. Counts describe what contributors run, not what the model is “good for”.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
A Framework 13 with a Ryzen 7 7840U and 64GB of unified memory runs privacy-first coding and homelab work through llama.cpp and hermes, where the larger model is too slow to use interactively.
Two Radeon Instinct MI50 cards limited to 145W each are benchmarked with llama.cpp Vulkan across dense and MoE models, with MoE models far ahead of dense ones.
Personal life/project management agent with persistent memory, reminders, smart home duties (timers lights etc), computer use.
An experienced software engineer finds sub-30 tok/s local inference on a 128GB Strix Halo more than adequate for deep coding work.
A site reliability engineer builds custom apps and a theming engine inside Dynatrace with local Qwen, using a per-repo manifest so the model only reads the code it actually needs.
A garage server with two Radeon Pro AI R9700 cards supports coding, homelab maintenance and an evolving Cline/Open WebUI workflow.
A full personal-operations stack runs on one 128GB Strix Halo machine, with several named agents reachable through a single Telegram chat and each handling a different part of daily life.
A researcher runs Qwen 3.8 Flash Next and Gemma 4 31B on a 128GB Strix Halo, splitting strategy and summarisation across models and advising against 64GB machines.
A security professional runs uncensored Qwen models for client work on a 64GB MacBook and a 128GB Strix Halo, using a containerised OpenCode setup with ported code-review skills.
A 512GB M3 Ultra Mac Studio running models through oMLX handles most agentic coding work, with measured speeds across several models listed by the owner.
A contributor uses a quiet Qwen 3.5 9B assistant on an RTX 5060 laptop for planning, documentation, research and private questions, while a Radeon desktop handles heavier work.
Cron jobs and document review through Hermes, with files kept on a NAS behind a one-way mirror so a bad run can't take real data with it.
