I suspect as medium to large companies increase their use of AI, this may become more common.
Been saying this since 2020: AI is going to follow the same pendulum that beats in the heart of IT since its inception. Some new tech starts out centralized, then slowly shifts to a distributed model. Examples:
- Mainframes to desktops.
- Unix servers with (X11) thin clients to desktops.
- Server-rendered web to client rendered (e.g. SPAs).
- PBX to soft phones and on-device audio DSP.
AI is moving even faster. Examples:
- Apple and Google have already moved inference to their phones to save central compute resources (hybrid approach).
- Companies are now moving from cloud AI providers to locally hosted options.
Before you know it, companies and consumers will have the necessary hardware to handle all their AI needs with edge hardware (e.g. right on their phones and desktops—no need to call out to any servers).
This week’s news had researchers demonstrating that ChatGPT Astra could natively modify and improve a tiny Qwen model. How long before we have models that have had all their internal knowledge (fact) checked and embedded into chips via Cerebras Systems method?
We could have the equivalent of PhD-level knowledge on zillions of topics built into our PCs and phones and these hardware models wouldn’t need to call out to the cloud at all except to receive patches/updates that get applied whenever they run.
They’d get refined and updated over time as flaws are found. People would regularly update these chips in their PCs or buy new phones so they’d have the latest knowledge and capabilities without having to wait for the software patches to do their thing.
Before you know it, companies and consumers will have the necessary hardware to handle all their AI needs with edge hardware (e.g. right on their phones and desktops—no need to call out to any servers).
i saw this too and it made me switch to graphene os because it and it makes me feel conflicted because i believe the anti-AI hysteria will fizzle out the same law the luddites did, but now i’m knee capping my own access wtih graphene. :P
We could have the equivalent of PhD-level knowledge on zillions of topics built into our PCs and phones and these hardware models wouldn’t need to call out to the cloud at all except to receive patches/updates that get applied whenever they run.
we’ve had access to this knowledge for the better part of the last 30 years and it’s lead to bigger echo chambers with better propaganda – the owners of these systems get to decided which pd-level knowledge they want you to have and all this asshattery will continue on as before as a result since it’s the same people making the decisions for us right now.
Their not british.
Why, because of their slavic names? Or because you get a Lithuanian IBAN?
The company is headquartered in the UK and both founders have lived there for a long time, even if born elsewhere.
The IBANs are Lithuanian because that’s where it was easier to get registered. Similar to how Wise got registered as a bank in Belgium despite being an UK business with Estonian founders and an office in Tallinn.
