Ollama gained traction by being the first easy llama.cpp wrapper, then spent years dodging attribution, misleading users, and pivoting to cloud, all while riding VC money earned on someone else's engine. Here's the full history, and why the alternatives are better.
So far I’ve been using a wrapper for wrappers called ramalama which makes opinionated choices based on your hardware. My main machine is a 64 core Arm machine with an 8gb AMD card using Vulkan. I’m sure I could do better but it’s a lot of tweaking I don’t have time to learn about right now.
So far I’ve been using a wrapper for wrappers called ramalama which makes opinionated choices based on your hardware. My main machine is a 64 core Arm machine with an 8gb AMD card using Vulkan. I’m sure I could do better but it’s a lot of tweaking I don’t have time to learn about right now.