Faster GKE node pool auto-creation

We're excited to announce concurrency in Google Kubernetes Engine (GKE) node pool auto-creation, to significantly reduce provisioning latency and autoscaling performance. Internal benchmarks show up to an 85% improvement in provisioning speed, especially benefiting heterogeneous workloads, multi-tenant clusters, workloads that use multiple ComputeClass priorities, and large AI training workloads, by cutting deployment time and enhancing goodput. The improvements are already under the hood when you allow GKE to automatically create node pools for pending Pods.

The problem

GKE node pools take nodes with identical configurations and group them, unifying operations such as resizing and upgrading. A new empty node pool takes 30-45 seconds to create. GKE can automate node-pool creation based on Pod resource needs. 

Compare this to prior versions of GKE node auto-provisioning (NAP), which executed one operation at a time, leading to increased deployment and scaling latencies. This was particularly noticeable in clusters that needed multiple node ...