Rather than choosing between local and cloud, this person uses a local model as a screening step in front of frontier models: it makes a first-pass, high-confidence judgment about whether something — an email, for instance — is non-confidential enough to be safely handed off for external processing. Anything that doesn't clearly pass that bar stays local.
VERIFIABLE SOURCE
View comment Reported anonymously by an r/LocalLLM contributor · score 1