A high school teacher built a correction website, small educational games, and administrative automation, running entirely on a 3090 with 128GB of system RAM. For a recent mock exam sat by more than 500 students, the whole pipeline — generating answer sheets and running the correction algorithm — was handled locally. They note that anything smaller than roughly 27B parameters felt too limited for this kind of structured, high-stakes grading work.
VERIFIABLE SOURCE
View comment Reported anonymously by an r/LocalLLM contributor · score 58