Search code examples
google-cloud-platformgoogle-cloud-datastoregoogle-cloud-dataflow

How to specify instance type in dataflow jobs?


We are using data flow jobs to delete the data store entries. We are using the below mentioned command.

gcloud dataflow jobs run del-data-8 --gcs-location gs://dataflow-templates/latest/Datastore_to_Datastore_Delete --parameters datastoreReadGqlQuery='select * from `ml-data`' --parameters datastoreReadProjectId=xxx --parameters datastoreDeleteProjectId=xxx

What parameter we should use to specify the instance type for the above data flow job?


Solution

  • You can specify the instance type with the flag --machine-type. For more information on the machine types you can choose, you can refer to this document.

    I hope that helps.