Questions tagged [kue]

Kue is a priority job queue backed by redis, built for node.js.

Kue is a feature-rich priority job queue for node.js backed by redis. A key feature of Kue is its clean user-interface for viewing and managing queued, active, failed, and completed jobs.
Kue provides an interactive GUI served by built-in expressjs to manipulate (remove, view, search) jobs from the browser. It also provides a RESTful API to interact with the queues and jobs in a programmatic way.

120 questions
2
votes
1 answer

How do you create a queued job in with nodejs & kue and have it exit naturally?

Using nodejs and kue, I want to insert a long running job into a queue and forget about it. The worker will handle all details. Short example: (function(){ var kue = require('kue'); var jobs = kue.createQueue(); var job =…
mshiltonj
  • 316
  • 3
  • 14
2
votes
3 answers

'job complete' event isn't firing in Kue

I can't figure out what I'm doing wrong, perhaps somone can point it out. I'm trying to figure out why my 'job complete' event isn't firing. var kue = require('kue'), jobs = kue.createQueue(); var util= require('util'); var job =…
HariSad
  • 31
  • 3
2
votes
1 answer

Mongoose and Kue - Node.js - Object passed has no method save

I'm using mongoose and Kue for the Flow control. I pass an object retrieved from the database to Kue. When the job get processed, the object hasn't anymore some functions, like .save() & others. jobs.process('process', 5, function(job, done) { …
Unitech
  • 5,781
  • 5
  • 40
  • 47
1
vote
2 answers

Node.js - want 5 parallel calls to a method in a loop

I have 1000 files of information in MongoDB collection. I am writing a query to fetch 1000 records and in a loop, I am calling a function to download that file to local system. So, it's a sequential process to download all 1000 files. I want some…
Sudhakar Reddy
  • 153
  • 1
  • 11
1
vote
0 answers

Kue (node.js) job doesn't run on remote server but works in development env

I use https://github.com/Automattic/kue for creating jobs. Locally all works correctly. But when I run my application on remote server (Amazon, Ubuntu 18) the job is not run. Here is my local config: port 1234 daemonize yes dbfilename…
Alexey Kucherenko
  • 885
  • 1
  • 8
  • 11
1
vote
0 answers

Heavy API endpoint Heroku time out

I am building an application with a node/express backend. The endpoint has a really long response time due to heavy computation (take 1 - 2 mins). Heroku times me out at 30 seconds. I'm using Kue and redis in order to fulfill the computation in…
teamjustin
  • 121
  • 2
  • 11
1
vote
2 answers

logstash vs a task queue for nodejs application

I have a nodejs web server where there seem to be a couple of bottlenecks preventing it from fully functioning peak load. logging multiple events to our SQL server logging multiple events to our elastic cluster under heavy load , both SQL and…
Jayaram
  • 6,276
  • 12
  • 42
  • 78
1
vote
0 answers

kue invalid job makes nodejs dump

kue throwed the err: content: Error: job "121308" is invalid And nodejs app exited unexpected. I referenced to the code and had no idea with the reason. /** * Get job with `id` and callback `fn(err, job)`. * * @param {Number} id * @param…
jfunsir
  • 11
  • 3
1
vote
0 answers

Kue multiple queues for different user groups

Hi so i'm using the priority scheduler Kue https://github.com/Automattic/kue What I need is the scheduler to process one job at a time based on the project name. So the code should look something similar to jobs.create(item.project.name); //Adding…
Sam
  • 651
  • 5
  • 5
1
vote
1 answer

mongoose cursor slows down until it stops

I have a node.js application that uses kue jobs to go over large collections using mongoose cursors. kue job configuration: function childJob(cid, name, dataset, type, link, line, market, done) { var deferred = Q.defer(); …
1
vote
1 answer

kue job progress always 0

I am using kue for long running operations. And I want to be able to track the operations progress. var kue = require('kue'), queue = kue.createQueue(); var daJob = queue.create('da', { title: 'data analysis' , batchSize:…
1
vote
0 answers

Only move job into Active when condition is met - Kue node js

Is the following possible? I was wondering if its possible to hold the job in a queued state before putting it into active only when it meets a condition. Example: This is what the jobs look like = var job = queue.create('myQueue', { from:…
deeveeABC
  • 960
  • 3
  • 12
  • 34
1
vote
0 answers

Kue connect Redis at AWS EC2 fail, show `Caught exception: AbortError`

I use docker to run redis on AWS EC2 and I use kue to connect to it at my node server. But it shows error like below. How could I fix this? I use redis-cli to ping to IP and GUI tool to connect redis are woring fine. Caught exception: …
Rukeith
  • 665
  • 1
  • 8
  • 22
1
vote
1 answer

How to return a jobID in Kue?

I am using express, and want to create a job anytime someone posts to my route. I would like the response to contain the job.id. However, the job id only populates in the callback of my queue.createFunction, so I am not quite sure how to return the…
swagbag
  • 105
  • 1
  • 9
1
vote
0 answers

How to find latest Kue job

Does Kue have a mechanism to find the latest job for a given type or n latest jobs for a given type? Existing mechanisms only seem to provide querying by id ranges.
J O
  • 156
  • 4