I just want to rent them for my life. I love being a modern serf.
Seriously though, go local or go home. Never paid a single cent for renting a LLM. Any PC that can play video games is fully sufficient to generate text with LLMs.
Any PC that can play video games is fully sufficient to generate text with LLMs.
I am all for local inference, but that is a super ignorant and uninformed take. I hope you are not running around complaining about the hallucinations and bad quality of LLM generated stuff, if your baseline are models that fit in 8 GB of VRAM or something. And no, 16 or even 24 GB wouldn’t bring you close to what the big models can do.
I just want to rent them for my life. I love being a modern serf.
Seriously though, go local or go home. Never paid a single cent for renting a LLM. Any PC that can play video games is fully sufficient to generate text with LLMs.
I am all for local inference, but that is a super ignorant and uninformed take. I hope you are not running around complaining about the hallucinations and bad quality of LLM generated stuff, if your baseline are models that fit in 8 GB of VRAM or something. And no, 16 or even 24 GB wouldn’t bring you close to what the big models can do.