This setup is a Ryzen 9 5950X with 64GB of DDR4-3600 and two RTX 5060 Ti 16GB cards, running Qwen 3.8 27B fully locally at about 46 tok/s. The author uses a model card specifically trained for editing their books: it does none of the writing, only editing and detecting plot holes.
VERIFIABLE SOURCE
View source Reported anonymously by an r/LocalLLM contributor · score 1