Search code examples
google-cloud-platformgoogle-bigquerygoogle-cloud-billing

How to merge billing export tables in GCP BigQuery


I'm trying to merge two billing export tables in GCP BigQuery into a single table. Each table is partitioned by _PARTITIONTIME.

I attempted to perform a bulk data load from one table into the other using an LOAD query, but after a few minutes, the data disappears without any error or log indication.

Is there a reliable way to transfer data from the old table to the new one without the risk of it being deleted or overwritten? Ideally, I want to preserve both the existing data in the new table and the partitions from the old table.

I don't want to use 'UNION ALL'.

Any advice or best practices would be greatly appreciated!

I attempted to perform a bulk data load from one table into the other using an LOAD query, but after a few minutes, the data disappears without any error or log indication.

I expect to see the data inside the new table, and not be deleted after several min.


Solution

  • Unfortunately, based on the official documentation, this is not possible. Thank you, everyone, for your input!

    enter image description here