Why does my dbt container hang in Vertex AI?

Question

I am trying to follow this tutorial to run a dbt docker image as a Vertex AI component. When the pipeline runs the component just seems to sit there for ever. Is there any way of debugging the component?

Sayan Bhattacharya · Accepted Answer · 2022-07-07T06:31:56.073

1

You see the pipeline logs to get an idea regarding what is going on in the pipeline. From the doc

After you define and build a pipeline, you can use Cloud Logging to create log entries to help you monitor events such as pipeline failures. You can create custom log-based metrics that send notifications when the rate of pipeline failures reaches a given threshold.

You can also select a component inside Pipeline's runtime graph and then view detailed info and logs of that particular component.

Also you can hover your cursor on the component status area(green check or grey disabled icon) to check the current status of that component.

edited Jul 07 '22 at 06:31

answered Jul 07 '22 at 06:26

Sayan Bhattacharya

1,365
1
4
14

Thanks but when I look at logs, there aren't any. Do I have to create them? – schoon Jul 07 '22 at 08:22
That's odd when I change the severity level to something then back to default, the logs appeared! – schoon Jul 07 '22 at 08:26
@schoon Did you check by clicking the `refresh` button? You are right this should not be the case – Sayan Bhattacharya Jul 07 '22 at 08:28
Possibly not, will try that next time. Ta for your help! – schoon Jul 07 '22 at 08:32

Why does my dbt container hang in Vertex AI?

1 Answers1