Search code examples
google-cloud-platformgoogle-cloud-dataflowdataflow

Dataflow Flex template job is Queued


I am trying to reproduce this tutorial to run a Flex Template on Dataflow.

When I submit the job, I can see it in the console but it's not started and marked as Queued. Does this mean that the job is submitted in a FlexRS mode ? How can I start directly the job after submitting it ?


Solution

  • This looks like a bug, where an upstream dependency (pyarrow?) started requiring git in order to build, but the base image does not currently include git. I have filed an issue here: https://issuetracker.google.com/issues/176570473