A fully local OCR and RAG pipeline for a self-hosted document server

This person's philosophy is that local hardware is best spent on narrowly scoped, largely deterministic automations rather than open-ended chat, saving heavier reasoning for cloud models when it's actually needed. One piece of that is a fully local OCR and metadata-generation pipeline feeding RAG over their self-hosted Paperless document server. Day to day they lean on Gemma 4 12B for anything that needs to be fast, reserving Qwen 3.8 Flash Next for the few tasks — like planning database retrieval — that need more headroom, on a 12GB card they consider entirely sufficient for this.

Correct or remove this entry