Meta Arms itself to the teeth by signing for 'tens of millions' of AWS Graviton cores

Meta plans to deploy tens of millions of Amazon Web Services' Graviton 5 CPU cores as part of a multi-year collaboration that will make the social network among the largest-ever consumers of the cloud giant’s homegrown silicon.

This compute will support Meta's agentic AI deployments. While GPUs remain essential for training and running generative AI models, the software frameworks necessary to harness those models still run on CPUs.

Amazon's latest Graviton processors feature 192 of Arm's Neoverse V3 cores along with a substantially larger L3 cache and support for memory up to DDR5 8,800 MT/s. That combo deliver a 25 percent performance uplift compared to Graviton 4.

In a statement Santosh Janardhan, Meta's head of infrastructure, characterized the collaboration with AWS as an effort to diversify the social networking company’s compute fleet.

"As we scale the infrastructure behind Meta's AI ambitions ...