Cloud Composer 3 with Airflow 3.1 is available now in preview

In a world of fragmented data stacks, you need workflow orchestration that is innovative, portable, and extensible. Cloud Composer, our fully managed data and AI/ML workflow orchestration service, relies on Apache Airflow to provide a universal control plane. And today, we’re excited to share that Cloud Composer now supports Airflow 3.1 in preview.

Released in November, this update marks a significant milestone for the platform, and the first time a hyperscaler is offering Airflow 3.1.

Built on the foundation of Airflow 3

The new features in Airflow 3.1 are built on top of the revolutionary architecture introduced in Airflow 3.0:

• Decoupled architecture: Robust separation between the scheduler and execution layer for better scalability and security

• DAG versioning: Native support for automated DAG versioning, retaining the historical structure and run history even after you remove tasks or change logic

• Powerful managed backfills: A redesigned backfill ...