Every published setup that reports this model, with its machines, quantization, runtime and reported results. Use the directory filters below to narrow by quantization, capacity or runtime.
Observed across 1 published setup. Counts describe what contributors run, not what the model is “good for”.
Capacity is the reported total for this setup. Multi-GPU and unified-memory layouts can behave differently.
Release benchmark of an ExLlamaV3-based ROCm engine running two 300B-class MoE models, each on a single 128 GB Ryzen AI Max+ 395 mini PC.
