This person uses local models for AI tagging and logging of media files, running entirely fine on an 8GB RTX 3070 Ti with Gemma 4 8B and an older Qwen model. After months of testing the best way to prompt and structure the process, they're now folding it into their own version of a digital asset management system — mainly as a learning exercise in building a core-plus-client/worker application, not because they expect it to ship publicly. They've since upgraded to a 16GB card but haven't bothered switching models, since the 8GB setup already did the job.
VERIFIABLE SOURCE
View comment Reported anonymously by an r/LocalLLM contributor · score 2