This person built a Python collector that pulls read-only configuration, firewall rules, update status, and network health from their homelab, hashes and curates it, and feeds a local RAG pipeline that refreshes daily. The result is an always-current technical advisor that can't actually modify anything, which they value given how easy it is to forget exactly what you've built or where something points. They run Qwen 3.8 27B at UD-Q6_K on a 5090 for primary use, with a second, lighter IQ4_XS quant on a smaller server that doubles as a Frigate, Immich, and game-server box.
VERIFIABLE SOURCE
View comment Reported anonymously by an r/LocalLLM contributor · score 2