Stack Overflow
Stack Overflow

Questions tagged [job-scheduling]

A job scheduler is a computer application for controlling unattended background program execution (commonly called batch processing).

Today's job schedulers, often termed workload automation, typically provide a graphical user interface and a single point of control for definition and monitoring of background executions in a distributed network of computers. Increasingly, job schedulers are required to orchestrate the integration of real-time business activities with traditional background IT processing across different operating system platforms and business application environments.

1328 questions
17
votes
3 answers

How to check whether Quartz cron job is running?

How to check if scheduled Quartz cron job is running or not? Is there any API to do the checking?
kusumat
  • 319
  • 3
  • 9
  • 21
17
votes
1 answer

How jobs are assigned to executors in Spark Streaming?

Let's say I've got 2 or more executors in a Spark Streaming application. I've set the batch time of 10 seconds, so a job is started every 10 seconds reading input from my HDFS. If the every job lasts for more than 10 seconds, the new job that is…
gprivitera
  • 933
  • 1
  • 8
  • 22
16
votes
2 answers

Cancel or Delete Scheduled Job - HangFire

I have scheduled a Job via using Hangfire library. My scheduled Code like below. BackgroundJob.Schedule(() => MyRepository.SomeMethod(2),TimeSpan.FromDays(7)); public static bool DownGradeUserPlan(int userId) { //Write logic here …
Vijjendra
  • 24,223
  • 12
  • 60
  • 92
16
votes
3 answers

Design a generic job scheduler

I am trying to design a generic job scheduler to expand my architectural knowledge and ability to think about system design questions in interviews. So far, what I have come up with is below. Can you point out where I should work on to be…
stretchr
  • 615
  • 2
  • 9
  • 24
15
votes
1 answer

How to best run Apache Airflow tasks on a Kubernetes cluster?

What we want to achieve: We would like to use Airflow to manage our machine learning and data pipeline while using Kubernetes to manage the resources and schedule the jobs. What we would like to achieve is for Airflow to orchestrate the workflow…
Ricky Lui
  • 155
  • 1
  • 8
14
votes
2 answers

Meaning of pending machine in autosys

Many time I have seen some of our autosys jobs go into status: Pending Machine. What is the meaning of this status? And its generally the com job and not the box job that goes into this status (box is in running status). Any idea how can this issue…
dvai
  • 1,953
  • 3
  • 13
  • 15
13
votes
1 answer

What is a "MySQL event"?

What is a "MySQL event"? What is its purpose? How is it different from a "job scheduler"? Many posts on SO, and the MySQL documentation, describe how to implement MySQL events, but I am just interested in their purpose.
Don P
  • 60,113
  • 114
  • 300
  • 432
13
votes
1 answer

Android JobScheduler running way too often when using setPeriodic()

I noticed my scheduled JobScheduler is executing the job way too often. I have it set to execute daily and it requires to be idle, to be on wlan and to be charging, but when those conditions are met the job executes like every 10min or even more…
qwertz
  • 6,206
  • 9
  • 40
  • 62
13
votes
4 answers

GcmNetworkManager scheduling issues

I am using GcmNetworkManager in my application for periodic and one of task task execution. I am getting these 2 errors and unable to figure out the reason. Implementation is correct as i am unable to reproduce these issue on staging. Fatal…
user2662821
  • 225
  • 3
  • 12
13
votes
1 answer

Maximize profit in scheduling unit tasks with dependencies

Problem I have n jobs to schedule in P seconds on unlimited number of machines with dependencies between the jobs i.e . for every job there is a set of jobs which are to be scheduled only after this job is finished. The profit for scheduling the ith…
v78
  • 2,803
  • 21
  • 44
13
votes
1 answer

What is exactly mean by 'DisallowConcurrentExecution' in Quartz.net

I have a Quartz.net Job with the following definition. [PersistJobDataAfterExecution] [DisallowConcurrentExecution] public class AdItemsJob : IJob, IInterruptableJob { public void Execute(IJobExecutionContext context) …
Ishtiaq
  • 980
  • 2
  • 6
  • 21
13
votes
1 answer

Combining Quartz.Net with UI

I have been working on MVC3 project. I have just created Sample email sending job with Quartz.Net in my application. This time, I need to build a job scheduling system in my MVC3 project. The scenario is completely based on UI. It means, the users…
Dheyvendaran
  • 175
  • 1
  • 4
  • 12
13
votes
2 answers

when a quartz job fires, is it a new job class instance?

I am very new to Quartz and I have some doubts about the jobs lifecycle. Let's suppose I have a single job configured to do some stuff. The job fires and ends its work. When it fires again is it the same instance (maybe set to sleep and awaken by…
MaVVamaldo
  • 2,505
  • 7
  • 28
  • 50
12
votes
2 answers

How to tell Condor to dispatch jobs only to machines on the cluster, that have "numpy" installed on them?

I just figured out how to send jobs to be processed on machines on the cluster by using Condor. Since we have a lot of machines and not each of those machines are configured the same, I was wondering: Is it possible to tell condor only to dispatch…
Aufwind
  • 25,310
  • 38
  • 109
  • 154
12
votes
1 answer

What's best practice for HA gearman job servers

From gearman's main page, they mention running with multiple job servers so if a job server dies, the clients can pick up a new job server. Given the statement and diagram below, it seems that the job servers do not communicate with each other. Our…
Paul DelRe
  • 4,003
  • 1
  • 24
  • 26
1
2
3
…
88 89