Search code examples
google-cloud-platformairflowworkflowgoogle-cloud-composer

What is the difference between GCP cloud composer and workflow?


The cloud workflow doesn't come with a scheduling feature. Apart from that, what are all the differences between these two services in terms of features? In which use case should we prefer the workflow over composer or vice versa?


Solution

  • There are some key differences to consider when choosing between the two solutions :

    A Composer instance needs to be in a running state to trigger DAGs and you'll also need to size your Cloud Composer instance based on your usage, You do not need to do this in Cloud Workflows as it is a Serverless service and you pay for anytime a workflow is triggered

    Another key difference is that Cloud Composer is really convenient for writing and orchestrating data pipelines because of it's internal scheduler and also because of the provided Operators, You can interact with any Data services inside of GCP.
    However, Cloud Workflows interacts with Cloud Functions, wich is a task that Composer cannot do really well.