Questions tagged [azkaban]

Azkaban is a batch workflow job scheduler created at LinkedIn to run their Hadoop Jobs.

Often times there is a need to run a set of jobs and processes in a particular order within a workflow. Azkaban will resolve the ordering through job dependencies and provide an easy to use web user interface to maintain and track your workflows. Here are a few features:

  • Compatible with any version of Hadoop
  • Easy to use web UI
  • Simple web and http workflow uploads
  • Project workspaces
  • Scheduling of workflows
  • Modular and pluginable
  • Authentication and Authorisation
  • Tracking of user actions
  • Email alerts on failure and successes
  • SLA alerting and auto killing
  • Retrying of failed jobs

http://azkaban.github.io

64 questions
0
votes
1 answer

"Missing required property for hive.script" in azkaban

This is my .job file type=hive user.to.proxy=azkaban azk.hive.action=execute.query hive.query.01=SELECT * FROM TEST; The job fails with this error: Caused by: azkaban.utils.UndefinedPropertyException: Missing required property…
user3747508
0
votes
1 answer

How to schedule Hadoop jobs conditionally?

I am pretty new to Hadoop, and particularly to Hadoop Job Scheduling. Here is what I am trying to do. I have 2 flows, each having a Hadoop job. I have freedom to put these flows either in the same project or in different ones. I don't want the…
Bhushan
  • 18,329
  • 31
  • 104
  • 137
-1
votes
2 answers

Azkaban : Running Cluster of Azkaban Executor Servers

Is it possible for me to run Azkaban Executor Service in a cluster. If one node goes down, then can the other pick up and run the scheduled jobs? I haven't seen any documentation on this kind of set-up. All that I read somewhere was that we can run…
Kranthi
  • 109
  • 2
  • 7
-2
votes
0 answers

Getting java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration error while running azkaban web server

i am trying to start its webserver by executing the following commands . cd ~/azkaban/azkaban-web-server/build/install/azkaban-web-server ./bin/start-web.sh i am getting the mentioned error 2023/08/28 07:20:01.412 +0000 ERROR [StdOutErrRedirect]…
1 2 3 4
5