Want some AI with your Pi? Raspberry Pi 5 gets an LLM upgrade with new AI HAT+ 2 - but will it be powerful enough?

• Raspberry Pi AI HAT+ 2 allows Raspberry Pi 5 to run LLMs locally
• Hailo-10H accelerator delivers 40 TOPS of INT4 inference power
• PCIe interface enables high-bandwidth communication between the board and Raspberry Pi 5

Raspberry Pi has expanded its edge computing ambitions with the release of the AI HAT+ 2, an add-on board designed to bring generative AI workloads onto the Raspberry Pi 5.

Earlier AI HAT hardware focused almost entirely on computer vision acceleration, handling tasks such as object detection and scene segmentation.

The new board broadens that scope by supporting large language models and vision language models which run locally, without relying on cloud infrastructure or persistent network access.