I am migrating from Databricks to Amazon EMR and planning to use Zeppelin notebooks in place of Databricks notebooks. Currently, many of the Databricks notebooks are scheduled as jobs. Is there any way how I can create recurring jobs or add Zeppelin notebooks to run as recurring step in Amazon EMR. Any reference to documentation will also be helpful.
Asked
Active
Viewed 458 times
1 Answers
0
It sounds like Zeppelin's built-in cron support will meet your needs.
Alex Grounds
- 256
- 2
- 12
-
The problem here is that the cron scheduler will work in case of running clusters. If the cluster have to start everytime to run the job, what will be the ideal way. – Chandan392 Mar 14 '19 at 06:49