For company automation — handling emails and user texts — this person runs Gemma 4 on a Radeon Pro AI R9700 with 32GB of VRAM, driven partly by a belief that uploading user data to a cloud model would actually be illegal for what they're doing, and partly for operational independence: nobody outside the company can silently change the model's behavior or take the service down by having their own issues. They separately keep an RTX 6000 Pro and an M4 Max MacBook Pro for coding, alongside a paid Claude Max plan for comparison.
VERIFIABLE SOURCE
View comment Reported anonymously by an r/LocalLLM contributor · score 2