How can one compute delay between pub sub publish time and arrival to bigquery when using pub/sub to bigquery subscription (not through dataflow)?
I have publish_time from pub sub metadata.
And a field in BQ in the table where data flows that auto populates with CURRENT_TIMESTAMP
I was hoping to just check the timestamp difference but noticed that quite often current_timestamp is earlier than publish_time.
It's about 350 messages/s and BQ table is partitioned by _PARTITIONTIME / hour if this makes any difference.
Im also wondering what is expected delay?
Got an answer from Google Support that this is expected behaviour.