This person works in specialised aerospace where they are legally required to maintain control of the data. Needing to combine public documents with sensitive or proprietary material, they cannot upload either to a cloud model, so they have been building a local document parser and RAG around Qwen.
The test document was a single 785-page Federal Register regulation containing preamble, discussion, public comments, proposed regulations and final regulations. A stock Qwen 3.5 35B parsed it poorly: it inserted headers and footers into answers and confused proposed rules with final ones. Building a parser and retrieval setup tuned to the document's native structure has been very time-consuming. Their open question to the community is which special parsers, tools or RAG strategies others use for libraries of complex legal documents.
Reported anonymously by an r/LocalLLM contributor · score 3