Add Salesforce Data Cloud data in Bigquery in Python
I am trying to add Salesforce Data Cloud data in BigQuery. I am able to add the source through console as shown in the picture:
.
I was wondering if this can be done programmatically through Terraform or Python.
It appears that the solution to our puzzle lies in the use of Google Analytics Hub. It appears that the data you seek is exposed through that service. If correct, then the question subtly changes to "How do I interact with Google Analytics Hub in a programatic fashion". To create a subscription (create a link to a dataset), this appears to be the API we would want to use. There should be language bindings beyond the raw REST request. You mentioned Python, here are the docs for the Python bindings.
Let me suggest that you review those docs and associated programming guides for interacting with Analytics Hub. There appears to be a rich set of samples here. If after studying you run into new puzzles that can't be solved by research, post a new question and we'll jump in.
- Google BigQuery Delete Rows?
- Determine Easter Sunday BigQuery
- Does data compression actually do anything on Query->to_Arrow()?
- FIRST and LAST VALUE bringing conflicting row quantities in the same query. WHY?
- Parse Google BQ SQL queries and get all tables referenced
- Why does BigQuery return different random numbers in this CTE?
- Max number of partitions that can be created on bigquery table
- NOAA data in BigQuery not being updated?
- BigQuery - DELETE statement to remove duplicates
- Splitting a string column in BigQuery
- How to write a dataframe to BigQuery and overwrite partition instead of the table?
- Add Date column base on other columns in Bigquery
- How can I get the last element of an array? SQL Bigquery
- Google BigQuery: how to create a new column with SQL
- Is it possible to replicate across projects when doing "Cross-region dataset replication" in BigQuery?
- REGEXP replace with blank
- How to display Airflow DAG status in Big Query tables
- big query data transformation logic
- What is the correct fields in `time_partitioning` for GCSToBigQueryOperator in Airflow
- Set Spark configuration when running python in dbt for BigQuery
- Scheduling queries: Is there a way to bypass the minimum 15min interval?
- Add Salesforce Data Cloud data in Bigquery in Python
- In Google BigQuery, how to get storage size of a partition in time-partitioned table?
- How to get Day name in Google BigQuery
- Unable to connect from BigQuery job to Cloud SQL Postgres
- Bigquery: STRUCT (*) syntax
- Altering a table schema in Google Bigquery
- Storing JSON data in Bigquery as nested dictionary
- Trim a decimal to 2 places Bigquery
- How to pass use_legacy_sql=False to the SqlSensor in an Airflow DAG with a BigQuery connection?