Getting data quality in Delta Live Table (bronze, gold, silver..)

Question

How to check if Delta Live Table is in bronze, gold or silver layer(zone) with python? I have notebook for creating Delta Live Table pipeline, and I need to know what is quality of data(silver, bronze, gold). How to get that information with python?

In SQL exist something like TBLPROPERTIES('BRONZE'), is there anything like that for python?

who adds these table properties? – Alex Ott May 29 '22 at 12:56 — Alex Ott, May 29 '22 at 12:56

score 1 · Answer 1 · answered Jul 12 '22 at 13:32

1

You can do something like this:

@dlt.table(
  comment="Bronze live streaming table for Test data",
  name="bronze_test_table",
  table_properties={
    "quality": "bronze"
  }
)

answered Jul 12 '22 at 13:32

drake

259
4
17

score 0 · Answer 2 · answered May 27 '22 at 12:45

0

If you have a sql solution run it directly with

spark.sql('''SHOW TBLPROPERTIES table_name'')

answered May 27 '22 at 12:45

gatear

946
2
10

Getting data quality in Delta Live Table (bronze, gold, silver..)

2 Answers2