Cloud Composer GCP

Cloud Composer, based on Apache Airflow, lets Google Cloud users author, schedule, and monitor pipelines

Self-contained Airflow deployments built on Google Kubernetes Engine are known as Cloud Composer GCP environments

The GKE cluster, Airflow web server, Airflow database, and Cloud Storage bucket are the essential elements of an environment

An object that represents a DAG instantiation at a specific moment in time is called a DAG run

Within your Airflow system, Google Cloud provides built-in features for alerting and logging

The preferred email notification solution for Cloud Composer GCP is SendGrid, an SMTP service provider

Since Airflow is open-source, you have options for other providers, like Slack or Pagerduty, who can manage alerts and notifications for you