Search code examples
google-cloud-platformgoogle-cloud-rungoogle-workflows

Google Cloud Workflows fails with timeout error


Current setup/scenario: I have a google cloud workflow that triggers or runs a Cloud Run Job (not service). But the job runs for about an hour. So, the workflow, after 30 minutes, fails with a timeout error.

My questions:

  1. In the workflow YAML, how can I just trigger the Cloud Run Job and exit immediately without waiting?
  2. In the workflow YAML, how can I then keep on checking the status and sleep for a while until the triggered Cloud Run Job is complete (either successful or failed)?

Please help!


Solution

  • I have added the following in the yaml

                connector_params:
                    timeout: 5000
                    polling_policy:
                        initial_delay: 900
                        multiplier: 1
                        max_delay: 900
    

    This is as per the documentation available here. https://cloud.google.com/workflows/docs/reference/googleapis

    I am not sure whether this feature was available when I raised the question. Thanks everyone who tried to help me! I am grateful to you.