Search code examples
google-cloud-dataflowstackdrivergoogle-cloud-error-reporting

Error reporting for Dataflow


Is there a way to send notifications when an error happens in Dataflow ?

Is it possible to integrate it with something like Sentry ?

Or maybe with Stackdriver or Google Cloud's error reporting service ?


Solution

  • I believe it is possible through the following configuration:

    • Dataflow logs are streamed into Google Cloud Logging.
    • Create a custom log based metric in Google Cloud Logging.
    • Create an alert policy in Google Cloud Monitoring (Stackdriver) based on the custom log based metric.