Tech »  Topic »  Tiiny AI Pocket Lab runs large models locally, avoiding cloud dependence

Tiiny AI Pocket Lab runs large models locally, avoiding cloud dependence


(Image credit: Tiiny)

Tiiny, an American startup, has released the AI Pocket Lab, a pocket-sized AI supercomputer capable of running large language models locally.

The device is a mini PC designed to execute advanced inference workloads without cloud access, external servers, or discrete accelerators.

The company states that all processing remains offline, which removes network latency and limits external data exposure.

This mini PC has 192GB of RAM, yes RAM, but that's not the most surprising fact about it - the Orange Pi AI Studio Pro uses a Huawei Ascend 310 that's, on paper, 7x more powerful than AMD's Ryzen AI Max+ 395NVIDIA RTX AI PCs pair with OpenAI’s open-weight gpt-oss-20b for a huge performance boostThis fishtank mini PC is the coolest design I've seen this year - shame you can't actually fill it with mineral oil

Built to run large models without the ...


Copyright of this story solely belongs to techradar.com . To see the full text click HERE