Search code examples
google-cloud-platformgoogle-bigquerygoogle-cloud-pubsub

GCP Pubsub Bigquery Subscriptions - can't create due to missing permissions

I get an error (in red, in picture below) whilst creating pubsub Bigquery subscription. Error shows up in subscription creation view:

enter image description here

First question - why is this error appears in the first place?

One of my attempts to solve this was to try to first create standard subscription, then add these missing permissions by assigning a role using such command: gcloud pubsub subscriptions add-iam-policy-binding EventIngestSubscription-4475d78 --member=serviceAccount:[email protected] --role="roles/roles/bigquery.dataEditor", but this produces ERROR: (gcloud.pubsub.subscriptions.add-iam-policy-binding) INVALID_ARGUMENT: Role roles/bigquery.dataEditor is not supported for this resource. error.

When I tried to set pubsub.subscriber roles instead of bigquery.admin - it worked.

Thanks a lot on any insights and suggestions on how to create a Bigquery Subscription. Am really stuck with this one...

Solution

  • The permission that needs to be set is not on the subscription, it is on the BigQuery table itself. Therefore, you are not going to be able to set the BigQuery permissions on the subscription. Instead, you need to ensure that the service account has roles/bigquery.dataEditor on the table you are using with the subscription. You can do this with the bq command-line tool:

    bq add-iam-policy-binding --member="serviceAccount:service-<project number>@gcp-sa-pubsub.iam.gserviceaccount.com" --role=roles/bigquery.dataEditor -t "<dataset>.<table>"

    This permission is needed so that Pub/Sub can write to BigQuery on your behalf.