This contributor runs approximately 80% of their text work and scripting locally on a MacBook Pro M5 Max with 128GB of memory and 2TB of storage. They use local models for writing, review, summaries, and shell, Python, and YAML scripts, loading and unloading different models through Apple Shortcuts and shell scripts depending on the target. The workflow is described as working very well, although slower than cloud inference. Cloud AI remains useful for final script optimization, while research and investigation stay fully cloud-based.
Reported anonymously by an r/LocalLLM contributor · score 2