Cloud Workflows
Cloud Workflows is an orchestration service that GCP introduced in 2020 and made generally available in 2021. Like other serverless offerings, this is also a fully managed solution with a pay-as-you-go model. Before Cloud Workflows, the managed workflow offering that GCP provided was called Cloud Composer – based on the open source Apache Airflow.
Cloud Workflows can orchestrate the interaction between several Google Cloud services. A workflow is a series of steps that specifies the tasks to be performed at each step, and how to move to the next step in the workflow based on the conditions or output of the previous job. These workflows are usually expressed either in YAML or JSON format.
Some of the key features of Workflows can be seen here:
- Reliability: The workflows are replicated across multiple zones in a region for redundancy. After the execution of each step, the workflow’s state is checkpointed so that in the case of outages, they...