Questions tagged [kue]

Kue is a priority job queue backed by redis, built for node.js.

Kue is a feature-rich priority job queue for node.js backed by redis. A key feature of Kue is its clean user-interface for viewing and managing queued, active, failed, and completed jobs.
Kue provides an interactive GUI served by built-in expressjs to manipulate (remove, view, search) jobs from the browser. It also provides a RESTful API to interact with the queues and jobs in a programmatic way.

120 questions
1
vote
1 answer

Can the same Redis instance be used manually alongside kue.js?

I am using kue.js, which is a redis-backed priority queue for node, for pretty straightforward job-queue stuff (sending mails, tasks for database workers). As part of the same application (albeit in a different service), I now want to use redis to…
srfc
  • 23
  • 4
1
vote
0 answers

kue/ how to restrict concurrent active jobs?

i have issue, i set by default concurrent(1) function execute(){ queue.create(title, { title : title + ' id(' + reportId + ')', options : options, criteria : criteria …
AxOn
  • 91
  • 1
  • 11
1
vote
0 answers

socket io based Application

I am Planning an implementation of a file processing web app . The idea is to have a queuing mechanism where user uploads file which can be queued and Worker Nodejs process can pick up unprocessed records from the queue. for the queue part I came…
Manotosh sil
  • 21
  • 1
  • 5
1
vote
1 answer

How to schedule a job with kue on parse-server?

I have a parse-server deployed with Heroku (from my GitHub repo) and hosted by mongoLab. I am attempting to send scheduled push notifications within my app and kue seems to be the most viable option. However, as I am very unfamiliar with it, I am…
Baylor Mitchell
  • 1,029
  • 1
  • 11
  • 19
1
vote
2 answers

What does it take to run background tasks in node?

If what i understand is correct, processing background tasks is a good way to free the main thread of cpu bound tasks. What i don't get is what is used by systems like bull or kue to run the tasks out of the main thread. Do they use threads ? Do…
Robert Brax
  • 6,508
  • 12
  • 40
  • 69
1
vote
1 answer

Send the response back to the requester when using a job queue (kue/node/express)

js/express . what i am doing is send a request to express server from a different server with some user details . add the request details to a job queue (kue) , then using workers (cluster) i process the jobs and send emails to users . and i want…
Kanishka Panamaldeniya
  • 17,302
  • 31
  • 123
  • 193
1
vote
2 answers

Can I persist data with kue / node.js

I am currently working with kue / node.js https://github.com/Automattic/kue After i create and save a job the data will be in my local redis server . var job = queue.create('new_job', { title: 'welcome email for tj' , to:…
Kanishka Panamaldeniya
  • 17,302
  • 31
  • 123
  • 193
1
vote
1 answer

Kue worker with with createClientFactory: only subscriber commands may be used

I'm working to get my kue workers set up and have discovered something strange. If I create my queue using the default kue redis connection everything works perfectly: var kue = require('kue') , redis = require('redis'); var q =…
Robert Moskal
  • 21,737
  • 8
  • 62
  • 86
1
vote
1 answer

Node.js Kue - Pause workers in app with multiple instances

When using kue in an app that has multiple instances (say multiple containers in docker) that all use the same redis database, if you pause a worker, do you need to pause that worker on all instances or is that handled at the redis level and hence…
CTC
  • 451
  • 1
  • 8
  • 20
1
vote
0 answers

Node Kue - Consume calculation on separate server

I need to perform some 'heavy' calculations based on input files uploaded to my node/express server by users and restrict the number of calculations run simultaneously. The calculations are done by a Fortran 90 program (30-90 min running time). I…
James Bund
  • 183
  • 2
  • 14
1
vote
1 answer

Number of inactive jobs in Kue

Is there any known API for getting number of jobs in Kue? For example, I want to get number of inactive jobs. Right now I have this portion of code that gets the JOBS. var kue = require('kue'), jobs = kue.createQueue(); kue.Job.rangeByType ('job',…
abdawoud
  • 219
  • 4
  • 16
1
vote
1 answer

execute callback after Kue job is completed

I have seen questions like this but they do not answer my question. I have a function var kue = require('kue'); var jobs = kue.createQueue(); var create_job = function(data, callback){ jobs.create('job', { stuff: data …
Loourr
  • 4,995
  • 10
  • 44
  • 68
1
vote
1 answer

Cluster with Express.js and Kue.js

I am currently working on a project for myself which required to process stuff in the background, however, i need to communicate between Express and Kue. But a bit more about the current setup: My Express.js forks itself over half the CPUs inside…
cschaeffler
  • 453
  • 3
  • 5
  • 17
1
vote
1 answer

Queued jobs disappear after redis restarts

When I put some jobs to kue and then I restart redis then queued jobs disappear. I assume that this is normal behavior but I was wondering if there is a way to keep queued jobs after redis restart? My app requires to have all jobs processed so I…
user606521
  • 14,486
  • 30
  • 113
  • 204
1
vote
1 answer

Nodejs: sharing session across meteor and express app running as separate instances

Basically, the user is logged in on the meteor app running on localhost:30000 using the accounts-ui package. Express app is running on localhost:34444. At some point, a user will need to use the express app (it's actually Kue), and I want to avoid…
KJW
  • 15,035
  • 47
  • 137
  • 243