This person splits legal work between a cloud planner and local execution. Claude builds the implementation plans and task DAGs; a local Qwen 3.8 27B on an RTX 5090 carries them out, reviews the work, and escalates back to Claude on churn or timeout. Their loop and triage commands run in batches.
On the local side they also anonymise documents with the same 27B model, run OCR on documents that resist standard extraction, fragment material for retrieval, and still use nomic embeddings for the RAG. The design keeps sensitive material on the local machine while using the cloud model only for planning and escalation.
VERIFIABLE SOURCE
View source Reported anonymously by an r/LocalLLM contributor · score 3