Stack Overflow
Stack Overflow

Questions tagged [kue]

Kue is a priority job queue backed by redis, built for node.js.

Kue is a feature-rich priority job queue for node.js backed by redis. A key feature of Kue is its clean user-interface for viewing and managing queued, active, failed, and completed jobs.
Kue provides an interactive GUI served by built-in expressjs to manipulate (remove, view, search) jobs from the browser. It also provides a RESTful API to interact with the queues and jobs in a programmatic way.

120 questions
2
votes
0 answers

Identify node.js causing 100% cpu usage on process heavy data

My node.js processes heavy data around a foreach loop, doing read and write in mongo. It takes 100% cpu utilization and around 1 gb ram at it. Any suggestions how can I improve this? Please help thanks. Code: worker.process('bell', (job, done) => { …
Aditya Gupta
  • 21
  • 4
2
votes
1 answer

What's job id limit for kue?

My platform is nodejs and started using kue as the queue engine. It works perfectly so far and I'm just curious the max job id it allows, as I have billions of jobs per day to start with.
Rick Lee
  • 743
  • 2
  • 7
  • 19
2
votes
1 answer

Check if queue exists

I'm trying to use Kue to schedule jobs. But I'm trying to find a way to check if a queue with some name already exists. This is my code until now. The problem is that it keeps creating queues everytime I ran node. How can I check if a Queue name…
Filipe Ferminiano
  • 8,373
  • 25
  • 104
  • 174
2
votes
0 answers

docker-compose setup doesn't allow container to connect to redis

So I'm writing a node application, and my docker-compose.yml looks like: version: '2' services: redis: image: "redis:latest" web: build: . ports: - "3000:3000" volumes: - .:/app links: - redis emailworker: …
Greg
  • 6,453
  • 9
  • 45
  • 61
2
votes
2 answers

kue - Processing jobs in different file

I want my queue.process function to be in a separate file, but module.exports doesn't work. kue.js: var kue = require('kue'); module.exports = function() { var queue = kue.createQueue(); queue.process('test', function(job, done) { …
Chris Kraszewski
  • 681
  • 10
  • 19
2
votes
0 answers

Is this the correct structure i am using with - ( kue , cluster , node )

Hi i am working with kue , cluster , redis , node.js . here is a very simple example , later i will call the test function from outside. My purpose is to add some incoming jobs to a queue and process it using workers . In my case when a user…
Kanishka Panamaldeniya
  • 17,302
  • 31
  • 123
  • 193
2
votes
0 answers

multiple handling of scheduled jobs by kue in 'cluster' mode

I have set up kue to run with the Cluster module, which spawns a child process of kue for every CPU core available.. When the scheduler inserts the every keys to redis, everything seems to be in order - only a single keyset for every every…
BigFatBaby
  • 1,525
  • 9
  • 19
2
votes
1 answer

Node.js Kue autoprocessing jobs if queue is not empty

I'm new to Kue and have some questions. Hope you can help me :) I read all Kue's docs, but I saw only one way to process jobs in queue: call processing manually. I need to process jobs as soon as they get to queue if queue was empty and run rest…
BadVolt
  • 617
  • 1
  • 7
  • 19
2
votes
1 answer

Sinon stub chained methods

I have the following code in my SailsJs controller: Jobs.create('beginImport', { version: version }).save(function(err){ if(err) { return res.serverError(err); } res.ok({ info: "import started" }); }); And in my test I am…
user156888
2
votes
1 answer

When adding new jobs in kue, is there a way to avoid duplicates?

I have a process that creates a new batch of jobs at a fixed interval (every minute) and I want to send them to kue for processing by another process. Sometimes, the same job can be in different batches. What happens if a job that was sent in a…
Running Turtle
  • 12,360
  • 20
  • 55
  • 73
2
votes
1 answer

Can KUE execute external processes?

Is it possible to queue and execute scripts as jobs in KUE https://github.com/LearnBoost/kue ? Script like /usr/bin/myScript.sh -a 10 -b 20 -c 30 All the examples that I have seen suppose the job to be defined as Node.js function. If it is…
Antoan Milkov
  • 2,152
  • 17
  • 30
2
votes
1 answer

Possible to change a job's priority after creation in kue?

The requirement is simple, after creating a job in kue with a given priority, is it possible to change its priority (like renice in POSIX) before it's scheduled to run?
Ryan Li
  • 9,020
  • 7
  • 33
  • 62
2
votes
1 answer

Job not restarting

I setup a kue job as I usually do : var job = jobs.create('phase2', s); job.on('complete', function (){ console.log('Job'+job.id+' is done'); }).on('failed', function (){ console.log('Job'+job.id+'has failed'); }); …
xShirase
  • 11,975
  • 4
  • 53
  • 85
2
votes
1 answer

Node Kue and Child Process - get error from spawned process

I try to spawn a child process performing cpu intensive calculations through a job queue with Kue. My code at the moment looks like this: consumer.js var kue = require('kue'); var util = require('util'); var spawn =…
James Bund
  • 183
  • 2
  • 14
2
votes
1 answer

how to use sentry with node's kue?

I would like to connect sentry monitoring to my kue app. How should it be done? I see in docs how to do it for plain node.js: var client = new raven.Client(...); client.captureError(new Error('Uh oh!!')); But I would like to have the express…
misoK
  • 415
  • 1
  • 3
  • 15
1 2
3
4 5 6 7 8