Questions tagged [mssparkutils]

I have a temp directory (tempfile.mkdtemp()) where I make edits to a db file using sqlite3 in an Azure Synapse notebook. When trying to copy the finished db file to mounted data lake storage like so: mssparkutils.fs.cp('file:' + dirpath +…

I used the following code to list the files in a directory but it is showing the entire path instead of just the file name: historical_logs_adls_path = ( f"abfss://{staging_container_name}@{staging_account_name}.dfs.core.windows.net/" …

Am in Synapse notebook, using pyspark to move file using msspark.fs.mv(src, dest, True) Link to ms doc:…