The main project here is a RAG pipeline that ingests documents and emails, analyzes them, and automatically creates follow-up todos. They also run a SaaS prototype locally, but are candid that once hardware and electricity are counted, it will never be cheaper than an API-based equivalent — they just happened to already own the hardware. The rest of their local use is about asking things they wouldn't want a cloud model retaining against their identity, from physics curiosity to general private questions.
Reported anonymously by an r/LocalLLM contributor · score 8