Bring your own brain? Why local LLMs are taking off

Feature After a decade or two of the cloud, we're used to paying for our computing capability by the megabyte. As AI takes off, the whole cycle promises to repeat itself again, and while AI might seem relatively cheap now, it might not always be so.

Foundational AI model-as-a-service companies charge for insights by the token, and they're doing it at a loss. The profits will have to come eventually, whether that's direct from your pocket, or from your data, you might be interested in other ways to get the benefits of AI without being beholden to a corporation.

Increasingly, people are experimenting with running those models themselves. Thanks to developments in hardware and software, it's more realistic than you might think.

Think local

There's a cultural shift driving local LLM adoption, and part of it has to do with distrust of big tech. Pew ...