not_IO@lemmy.blahaj.zone to Lemmy Shitpost@lemmy.worldEnglish · 2 days agousing ram is stealing!lemmy.blahaj.zoneimagemessage-square42linkfedilinkarrow-up1752arrow-down12
arrow-up1750arrow-down1imageusing ram is stealing!lemmy.blahaj.zonenot_IO@lemmy.blahaj.zone to Lemmy Shitpost@lemmy.worldEnglish · 2 days agomessage-square42linkfedilink
minus-squareW98BSoD@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up4·2 days agoI’d love to us a local LLM that runs fairly well on like an 10-12th gen i5 and 16 GB RAM. Any suggestions?
minus-squareLeftReddit2@lemmy.worldlinkfedilinkarrow-up2·2 days agoProbably a smaller model of Gemma like Gemma 3n. I use a model of Gemma for my router though I forget which one specifically.
I’d love to us a local LLM that runs fairly well on like an 10-12th gen i5 and 16 GB RAM.
Any suggestions?
Probably a smaller model of Gemma like Gemma 3n. I use a model of Gemma for my router though I forget which one specifically.