0

Want to get the last updated datetime for the file in datalake using Synapse notebook (pyspark). Do we have any out of the box options?

1 Answers1

-1

Can't you just assign the output to a dataframe and sort that?

df = mssparkutils.fs.ls(path)
sorted(df(sortcolumn))

https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.sql.DataFrame.sort.html

Maybe something like this? How do you get a directory listing sorted by creation date in python?

Le Poissons
  • 39
  • 1
  • 4