Every published setup that reports this model, with its machines, quantization, runtime and reported results. Use the directory filters below to narrow by quantization, capacity or runtime.
Observed across 3 published setups. Counts describe what contributors run, not what the model is “good for”.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
Two Radeon Instinct MI50 cards limited to 145W each are benchmarked with llama.cpp Vulkan across dense and MoE models, with MoE models far ahead of dense ones.
A researcher runs Qwen 3.8 Flash Next and Gemma 4 31B on a 128GB Strix Halo, splitting strategy and summarisation across models and advising against 64GB machines.
Local models take over the reading and summarizing side of manual stock analysis, cutting a research routine from hours a day to a few hours a week.
