@Damarus - Pi4 Lemmy

Damarus@feddit.org

0 Posts
3 Comments

Joined 2 years ago

Cake day: September 30th, 2024

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

Damarus@feddit.orgtoNo Stupid Questions@lemmy.world•Is there anyway to use LLMs without supporting the billionaires/data centers but without also entirely upgrading your computer?
link
fedilink
arrow-up
1·
17 hours ago
Just use llama-server. I quickly found that all wrappers just make life harder and they made some great progress to improve usability with stuff like router-mode

link
fedilink

Damarus@feddit.orgtoNo Stupid Questions@lemmy.world•Is there anyway to use LLMs without supporting the billionaires/data centers but without also entirely upgrading your computer?
link
fedilink
arrow-up
7·
3 days ago
I’ll just leave this here. https://sleepingrobots.com/dreams/stop-using-ollama/

link
fedilink

Damarus@feddit.orgtoProgrammer Humor@programming.dev•OpenAI CEO Sam Altman says its “terrible to have everybody have a bunch of the world’s limited supply of DRAM” instead of shoving it all in datacentres
link
fedilink
arrow-up
13·
5 days ago
It’s terrible to have everybody have a bunch of the world’s limited supply of money instead of shoving it all into one guy’s pocket

link
fedilink