0

I was following a tutorial (such as this one) and others have suggested that it is a private/temporary delta table. I am running my code in a Synapse workspace, obviously connected to a spark session, and it runs fine, with the write command being

df_by_node.write \
  .mode('append') \
  .format('delta') \
  .option('mergeSchema', 'true') \
  .partitionBy('__year', '__month', '__day', '__hour') \
  .save("/tmp/delta/aggregated_features")

However, where can I find this /tmp/delta/aggregated_features? I don't see it in the "Data" tab under "Workspace" or "Linked". Where is it? How long does it last? It seems to last more than just the spark session, but I can't find anything else about it.

CHEEKATLAPRADEEP
  • 12,191
  • 1
  • 19
  • 42
etnie1031
  • 63
  • 7

0 Answers0