Questions tagged [kue]

Kue is a priority job queue backed by redis, built for node.js.

Kue is a feature-rich priority job queue for node.js backed by redis. A key feature of Kue is its clean user-interface for viewing and managing queued, active, failed, and completed jobs.
Kue provides an interactive GUI served by built-in expressjs to manipulate (remove, view, search) jobs from the browser. It also provides a RESTful API to interact with the queues and jobs in a programmatic way.

120 questions
1
vote
1 answer

Kue callback when job is completed

My main Node instance forks a worker process, which accepts messages over IPC (using the built-in Node process.send() and process.on('message'...) which are objects containing information about new jobs to add to Kue. It then processes those…
winduptoy
  • 5,366
  • 11
  • 49
  • 67
1
vote
0 answers

Are there any good alternatives to Kue for background process management in node?

I'm working on a project where the background processes are increasing exponentially. So I'm looking for a good priority background queue for node. While looking for it online I found Kue but I'm new to this so I'm not sure whether this is the best…
HariSad
  • 31
  • 3
0
votes
0 answers

Does kue-dashboard require additional steps to run via VSC on a windows machine?

I am trying to delay some email notification processes on my NodeJS server using Kue. Now, I have set up kue successfully. Here's the config file: const kue = require('kue'); const queue = kue.createQueue(); module.exports = queue; The queue is…
mach3
  • 117
  • 1
  • 1
  • 6
0
votes
1 answer

Giving a specific ID to a job created by Kue

I'm working with Kue and I'm creating Jobs to be added to Redis. The problem i have is that when i destroy and recreate the Redis DB the Ids of the job created starts from 1. so is there any way to create a job with Kue with a specific id so in…
0
votes
2 answers

How to push new request into the queue and send success message that it is done after it pushed to the queue

I have a microservices that process media and at a time I need to provide my microservices to process only one request at atime. So, I need to make a queue using Kue library and one by one pushed new request if it comes. Once 1st request is finished…
Rakesh
  • 178
  • 10
0
votes
1 answer

Process Redis KUE jobs within multiple kubernetes pods/instances

I'm using Sails.js for an API which I deploy from a Dockerfile in a Google Cloud kubernetes cluster and scale the workload with 3-5 pods. The API provides endpoints to upload single image files and bigger zip files which I directly extract on the…
0
votes
0 answers

Nodejs Background job strategy

I have already implemented kue to handle background jobs, in my application, I have a huge amount of background processes that cause the server crash, Now I want to find a better solution or alter way for this. One way I think is to have a separate…
jones
  • 1,423
  • 3
  • 35
  • 76
0
votes
1 answer

How to work on single job at a time while multiple docker containers consume from redis kue nodejs

I have multiple docker containers that consume jobs from the same queue of redis kue. The problem is that they work on the same jobs. My need is on of the containers work on a job and after it finish some other container work on the job after…
0
votes
1 answer

Kue JSON API doesn't return any data - KUE with AWS Redis

I am using kue to queue and process some python jobs using node express. The redis server i am using is not the default on localhost but AWS Redis. Problem Statement: Connection to AWS redis is successful, jobs are being created and processed,…
Aakash
  • 3,101
  • 8
  • 47
  • 78
0
votes
1 answer

Failed to integrate redis server with express node js app

I am new to Node.js and I have been trying to create a small app integrated with KUE library for task queuing. When I trying to run the app i.e. node app.js I get the following error: { ReplyError: ERR wrong number of arguments for 'set' command …
Nick Div
  • 5,338
  • 12
  • 65
  • 127
0
votes
1 answer

How much Redis memory usage (approximately) is required to run 50 jobs using Bull and Kue?

I am trying to do an estimation of redis memory usage for Job scheduling (mostly spark jobs) and Bull and Kue are two options we are looking at this moment.
unohuzdis
  • 87
  • 2
  • 8
0
votes
1 answer

NodeJS application with kue never stars from 0

I have a nodeJS api that uses kue to perform long running operations. Although, once I shutdown the application and restart it all the previous jobs are still there. Removing them will not reset the redis counter to 0. Removes them only from any…
0
votes
0 answers

Why is this Node Express code is causing memory leaks and spikes?

I am new to JS/Express/Node/Kue (using Forever to keep it running). I have taken on this code base, which is causing our EC2 instance to spike the CPU utilization to 100% every 6 hours. Usage grows steadily from 0% at 08UTC to 100% at 14UTC to 0% at…
jdog
  • 10,351
  • 29
  • 90
  • 165
0
votes
1 answer

Adding req object to Kue job

Been hunting the internet trying to find an answer to why the following doesn't work. I am trying to pass in the req object when I add the job so that I have access to it when the job is processed. But the process is never executed when the whole…
amwill04
  • 1,330
  • 1
  • 11
  • 18
0
votes
1 answer

How to manage TTL exceeded error in kue module of Redis in nodejs?

I am working on NodeJS application, in that application I used kue module of Redis to manage queuing to perform tasks. There is an error "TTL exceeded". Due to this error whole redis tasks queue has been stueyeck and it may not auto start queue as…
Dipak
  • 2,248
  • 4
  • 22
  • 55