Google Cloud Composer

Cloud Composer is an Apache Airflow-based workflow orchestration solution that is completely managed

Google Cloud tools include BigQuery, Dataflow, Dataproc, Datastore, Cloud Storage, Pub/Sub, and AI Platform allow end-to-end pipeline orchestration

One orchestration tool can write, plan, and monitor workflows in Google Cloud, multiple clouds, or on-premises pipelines

To get a unified data environment, create workflows that link data, processing, and services across clouds

Python is used to easily configure Cloud Composer pipelines as directed acyclic graphs (DAGs), accessible to all users

You can take advantage of all the features of Apache Airflow without any installation or administrative work by switching to it from a local instance

Self-contained Airflow deployments built on Google Kubernetes Engine are known as Cloud Composer environments

Google Cloud services that power your workflows and every Airflow component are provisioned via Cloud Composer