I was working with Azure databricks clusters recently and noted that I needed both -
- AD passthrough authentication to read data from ADLS using Pyspark
- Use scala on the same cluster to perform different tasks
What cluster access mode should be used and what policy can enable this?
I enabled AD passthrough authentication and could only use Pyspark & SQL under "Shared" access mode but want to not restrict it for other developers to choose scala