I was following a tutorial (such as this one) and others have suggested that it is a private/temporary delta table. I am running my code in a Synapse workspace, obviously connected to a spark session, and it runs fine, with the write command being
df_by_node.write \
.mode('append') \
.format('delta') \
.option('mergeSchema', 'true') \
.partitionBy('__year', '__month', '__day', '__hour') \
.save("/tmp/delta/aggregated_features")
However, where can I find this /tmp/delta/aggregated_features? I don't see it in the "Data" tab under "Workspace" or "Linked". Where is it? How long does it last? It seems to last more than just the spark session, but I can't find anything else about it.