I am trying to run my pyspark script using spark-submit command , but tar file is not being considered . I have used below two commands:
1. spark-submit --archives sample-0.0.1.tar.gz#environment app.py
2. spark-submit --py-files sample-0.0.1.zip app.py
Above commands give no directory found for app.py Can anyone help me what is causing issue?