Questions tagged [job-queue]

In system software, a job queue (sometimes batch queue), is a data structure maintained by job scheduler software containing jobs to run.

A job queue is a queue (that is, a First In First Out (FIFO) collection) of tasks to be carried out at an unspecified time in the future. Workers may take on the task at the head of the queue and carry it out, returning to take another when they are finished.

This is often applied to multi-threaded programming environments, in which there are fewer threads than available tasks so tasks must be queued until a thread is available to process them.

113 questions
0
votes
1 answer

Beanstalkd queue process per user

I'm having an application with a couple thousand users. Each user can have 10 - 100's of jobs in the queue. I wan't my workers (~10) to process 10 jobs of 10 different users instead of just 10 jobs (which could be from the same user). user1 …
Floris
  • 299
  • 3
  • 17
0
votes
1 answer

Is it better for a queued job to be queue-aware, or to use a service?

I'm using SlmQueue (or will be), and I'm trying to decide whether it's best to have the jobs re-schedule themselves, spawn new jobs, etc. (using QueueAwareInterface) or if it's better for each job to have a shared service as a dependency, and for…
glen-84
  • 1,778
  • 2
  • 18
  • 30
0
votes
1 answer

Designing a job queuing system where only one job per user can be processed by workers any given time

I've a single job queue with multiple workers watching this queue. (each job corresponds to a single user). There might be multiple jobs per user in the queue at any given time. I do not want my workers to process more than 1 job per user at any…
Nands
  • 1,541
  • 2
  • 20
  • 33
0
votes
3 answers

Distributed failsafe jobqeues for JVM

I need to implement a job queue for a distributed JVM application. The queue(s) must hold a group of jobs (i.e. Java runnables) that have to be executed in sequential order. There will be hundreds of those "job groups" or queues that should…
taffer
  • 407
  • 1
  • 5
  • 13
-1
votes
1 answer

Implementing sequential job queue using React

I am looking to implement a job queue that ensures the response from an API is returned in the order of input items entered even in spite of each API call taking a variable amount of time potentially. See codesandbox here…
LearnToImprove
  • 345
  • 5
  • 15
-1
votes
1 answer

can i create a web application to make an automatic data exchange between azure sql and sharepoint online?

i would like to create a web application to make an automatic data exchange between azure sql and sharepoint online,but I don’t know how ,have you an ideas guys ??
-1
votes
1 answer

Beanstalkd or other job/message queue : Send a file?

We were looking for a job/message queue technology. After comparing the main ones (RabbitMQ, ActiveMQ, Apollo, ZeroMQ..), we chose Beanstalkd because apparently, compared to RabbitMQ, "It gives 80% the functionality with 20% the weight and…
Bonswouar
  • 1,521
  • 2
  • 17
  • 37
1 2 3 4 5 6 7
8