Pushing back on the idea that local is too expensive to run, this person points out they spent about 30 cents on electricity for a full day of local machines running, arguing the real barrier to entry is money and orchestration knowledge, not power draw or compute access. To make the point, they mention an agent running well on an old Intel PC with a spinning hard drive and 16GB of RAM — no dedicated GPU at all — plus a 2015 MacBook, with their actual laptop used only as a remote terminal into that infrastructure.
Reported anonymously by an r/LocalLLM contributor · score 2