Search code examples
dockerdbtgoogle-cloud-vertex-aikfp

Why does my dbt container hang in Vertex AI?

I am trying to follow this tutorial to run a dbt docker image as a Vertex AI component. When the pipeline runs the component just seems to sit there for ever. Is there any way of debugging the component?

Solution

  • You see the pipeline logs to get an idea regarding what is going on in the pipeline. From the doc

    After you define and build a pipeline, you can use Cloud Logging to create log entries to help you monitor events such as pipeline failures. You can create custom log-based metrics that send notifications when the rate of pipeline failures reaches a given threshold.

    You can also select a component inside Pipeline's runtime graph and then view detailed info and logs of that particular component. enter image description here

    Also you can hover your cursor on the component status area(green check or grey disabled icon) to check the current status of that component.