1

In databricls, I would like to export the jobs/stagesd logs that we see in the sparkui to a custom location for analysis. How can we do this?
enter image description here

Thanks.

SriramN
  • 432
  • 5
  • 19

1 Answers1

0

check for the following property in the configuration file.

spark.eventLog.dir

Access the location you will get logs.

sandeep rawat
  • 4,797
  • 1
  • 18
  • 36