Stack Overflow
Stack Overflow

Questions tagged [job-queue]

In system software, a job queue (sometimes batch queue), is a data structure maintained by job scheduler software containing jobs to run.

A job queue is a queue (that is, a First In First Out (FIFO) collection) of tasks to be carried out at an unspecified time in the future. Workers may take on the task at the head of the queue and carry it out, returning to take another when they are finished.

This is often applied to multi-threaded programming environments, in which there are fewer threads than available tasks so tasks must be queued until a thread is available to process them.

113 questions
5
votes
2 answers

Job queue in node.js

I'm looking for a job queue manager in node.js which can be invoked by php. This is for a web application which needs to send emails, create pdf files and so on which I'd like to perform asynchronous of the php process. Example of the process: User…
Jurian Sluiman
  • 13,498
  • 3
  • 67
  • 99
5
votes
2 answers

Bull queue: Ensure unique job within time period by using partial timestamp in jobId

I need to ensure the same job added to queue isn't duplicated within a certain period of time. Is it worth including partial timestamps (i.e. D/M/Y-HH:M) in my unique jobId strings, so it processes only if not in the same Minute? It would still…
alyx
  • 2,593
  • 6
  • 39
  • 64
5
votes
1 answer

How to abort a particular task in bull queue?

According to this package https://github.com/OptimalBits/bull is it possible, to abort a certain task in the "waiting queue"? My use-case is as follows: I have a mongodb collection "users" and a collection "friendship" where I store name and avatar…
BestPractice2Go
  • 285
  • 4
  • 16
5
votes
3 answers

iOS job queue similar to Path's android priority job queue

Does anyone have an iOS job queue similar to Path's Android Priority Job Queue that they don't mind sharing with the community? I am very new to iOS so I am not sure if the platform itself provides such a solution. On android no such thing exists so…
Katedral Pillon
  • 14,534
  • 25
  • 99
  • 199
4
votes
1 answer

Can multiple gearman servers share the same libdrizzle queue?

Can multiple gearman servers share the same gearman queue, via libdrizzle? I'm wondering if this will eliminate the gearman server as a single point of failure--if I have multiple web nodes, each talking to the same gearman server, then the site…
mjs
  • 63,493
  • 27
  • 91
  • 122
4
votes
2 answers

VolleyError: java.lang.IllegalArgumentException: timeout < 0

I am using [Jobqueue] library using sync request with Volley. Everything is ok, but after a long time or performing a lot of requests after an undetermined time, I am getting this error: Caused by: com.android.volley.VolleyError:…
José Carlos
  • 654
  • 6
  • 16
4
votes
1 answer

How to process scheduled, recurring jobs with Kue?

In my webapp, users can create recurring invoices that need to be generated and sent out at certain dates each month. For example, an invoice might need to be sent out on the 5th of every month. I am using Kue to process all my background jobs so I…
ragulka
  • 4,312
  • 7
  • 48
  • 73
3
votes
3 answers

Understanding async JS with promises, task and job queue

I was looking into async behaviour in JS and it was going well for the most part. I understand the synchronous way of executing code, the single thread of JS and how callbacks such as the one inside setTimeout will be timed by the Web browser API,…
Konstantinos Pascal
  • 33
  • 1
  • 6
3
votes
1 answer

Use NodeJS Bull Queue seperate processor

I'm trying to run the process in different processor file itsef as its in bull documentation, I've added the file as below. // -------- Queue.js ---------- formatQueue.process(__dirname + "/processors/format-worker.js"); // On Cmplete…
rakcode
  • 2,256
  • 4
  • 19
  • 44
3
votes
2 answers

Job processing microservices using bull

I would like to process scheduled jobs using node.js bull. Basically I have two processors that handle 2 types of jobs. There is one configurator that configures the jobs which will be added to the bull queue using cron. The scheduler will be in one…
Ganesh Kumar
  • 3,220
  • 1
  • 19
  • 27
3
votes
2 answers

Bull Queue is not getting completed

Am new to Bull.I have tried running bull based on their documentation code. The Process are starting but my job is not getting completed, or am not sure whether its triggering complete event or not? Am not sure where am making a mistake Attaching my…
Kannan T
  • 1,639
  • 5
  • 18
  • 29
3
votes
1 answer

What Constitutes a Retry in the Job Queue?

I originally posted this question over at the Zend Forums but figured it would also be wise to post here. What has to happen, exactly, for a job to retry? I've tried timeouts, 50x response codes, and setting the status to "FAILED". I have a simple…
allnightgrocery
  • 1,370
  • 1
  • 8
  • 15
3
votes
1 answer

Using RabbitMQ as Distributed broker - How to Serialize jobs per queue

Each Job in my system belongs to a specific userid and can be put in rabbitmq from multiple sources. My requirements: No more than 1 job should be running per user at any given time. Jobs for other users should not experience any delay because…
Nands
  • 1,541
  • 2
  • 20
  • 33
3
votes
7 answers

async execution of tasks for a web application

A web application I am developing needs to perform tasks that are too long to be executed during the http request/response cycle. Typically, the user will perform the request, the server will take this request and, among other things, run some…
Stefano Borini
  • 138,652
  • 96
  • 297
  • 431
2
votes
1 answer

gearman and retrying workers with unreliable external dependencies

I'm using gearman to queue a variety of different jobs, some which can always be serviced immediately, and some which can "fail", because they require an unreliable external service. (For example, sending email might require an SMTP server that's…
mjs
  • 63,493
  • 27
  • 91
  • 122
1
2
3 4 5 6 7 8