Use DLT table from one pipeline in another pipeline

Question

If I have a DLT pipeline that creates a streaming live table called customers, how can I use that table in another pipeline?

So,

Pipeline A:

CREATE OR REFRESH STREAMING LIVE TABLE customers AS

Pipeline B:

CREATE OR REFRESH STREAMING LIVE TABLE sales AS
                  SELECT * FROM source a
                  INNER JOIN STREAM(LIVE.customers)

That does not work since it says it does not have access to the customers dataset.

Thanks in advance for the help.

score 0 · Answer 1 · answered Aug 30 '22 at 09:48

The LIVE keyword could be used only for references inside the same pipeline (doc). To refer a table from another pipeline you need to use it's full name as database.name.

For production usage it's better to define the name of the table as a configuration parameter (because database names could be different) - then you should be able to refer to it using the ${conf_name} syntax.

Use DLT table from one pipeline in another pipeline

1 Answers1