I'm using CDH 5.4, I wrote my fisrst scala program, I built a jar, and put my input file into Hdfs, but I didn't find yet how to run the application. Is it in Hue like running a map reduce Job, or by a spark submit in a shell ? I found that there is spark Igniter in Hue but the version that I'm using don't have this application.
Asked
Active
Viewed 483 times
0
-
No one have an idea :( – Cleo Jul 24 '15 at 14:25
-
About Hue, currently you would need the Notebook application and use a Jar snippet http://gethue.com/new-notebook-application-for-spark-sql/ or even simpler, use the new Spark Action of Oozie in Hue http://gethue.com/new-apache-oozie-workflow-coordinator-bundle-editors/. If the CLI is ok, spark-submit would be easy too. – Romain Jul 27 '15 at 22:26