Part of a hybrid RAG setup spanning a Mac Studio, a MacBook, GCP, and OpenRouter, with an unrestricted local model used specifically for questions frontier chat products decline to answer.
Personal assistant1 machineModels unspecifiedRuntime unspecified
ChangedTitleDescriptionCategoryHardwareModels
Compare with revision 1
TitlePreviousAn uncensored local model as an escape hatch from frontier guardrailsThis snapshotLocal to get past cloud filters and nannying
DescriptionPreviousThe main draw here is getting past content filters — this person is frustrated with cloud assistants declining topics or offering unsolicited advice on unrelated things. For that, they run a less-restricted Qwen 3.8 27B build. It's part of a broader, admittedly convoluted RAG setup split across an M2 Ultra Mac Studio and an M3 Max MacBook Pro, with parts of the pipeline also routed through GCP and OpenRouter.This snapshotFor this person, the point of local is getting past cloud filters and nannying: a cloud assistant repeatedly told them to sleep or take a break, up to blunt refusals to help when they said it was 8 AM and they had just woken up. They call it 'forced nap time'. A less-restricted local model is the workaround.
CategoryPreviousdocument-processingThis snapshotpersonal-assistant
ModelsPreviousQwen 3.8 27BThis snapshotNot specified
Archived published snapshot — kept for context and comparison.
Leave a comment