0

Is it possible to set access controls for Apache spark such that we can control which users can submit jobs via spark-submit. Ideally this would integrate with active directory so permissions signs could be controlled by ad groups.

Alberto Bonsanto
  • 17,556
  • 10
  • 64
  • 93
d80tb7
  • 863
  • 2
  • 9
  • 20

1 Answers1

1

Spark uses Kerberos and that can be configured to work with Active Directory. Check: 

http://spark.apache.org/docs/latest/configuration.html
http://spark.apache.org/docs/latest/security.html
https://www.slideshare.net/cloudera/securing-your-apache-spark-applications

Some settings to consider: 

spark.acls.enable # true 
spark.admin.acls # set to admin users 
spark.modify.acls # user who can modify
Darrell Ulm
  • 132
  • 1
  • 2
  • 11