I am trying to install the dependency located at https://mvnrepository.com/artifact/com.crealytics/spark-excel on my job cluster so that I can read from excel file in my code.
Could you please help me how I can ensure that any dependency for my ETL pipeline is installed/imported when the cluster is Initialized?
I am currently using the !pip install -r requirements.txt
to install my pip imported libraries but unable to do so for the Maven package.