Stack Overflow
Stack Overflow

Questions tagged [job-queue]

In system software, a job queue (sometimes batch queue), is a data structure maintained by job scheduler software containing jobs to run.

A job queue is a queue (that is, a First In First Out (FIFO) collection) of tasks to be carried out at an unspecified time in the future. Workers may take on the task at the head of the queue and carry it out, returning to take another when they are finished.

This is often applied to multi-threaded programming environments, in which there are fewer threads than available tasks so tasks must be queued until a thread is available to process them.

113 questions
0
votes
0 answers

Laravel Mail::queue and supervisor => Mails Delayed for the first time in a day

I have implemented laravel queue with supervisor on prod server. The problem i am facing is when i send mail for the first time in a day, the mail get delayed but the job is processed but after that first mail is received it works fine and there is…
Love Sharma
  • 1
0
votes
0 answers

Unreliable Termination of Worker Routines Producing Jobs

In an effort to learn more about Golang, I am attempting to fetch match data from an online 5v5 video game. Based on a given player, I'll request his matchlist and based on the gameIDs within this matchlist I am requesting the metadata for each of…
DwayneHart
  • 129
  • 1
  • 7
0
votes
0 answers

Cancel Jobs with JobManager

I'm currently working on a project where uses JobManager. I add the jobs in the background this way. jobManager.addJobInBackground(new GetMessageBoard(page, jobId)); I currently running into a problem the users jump from one tab to another before…
John De la cruz
  • 86
  • 5
0
votes
1 answer

Telegram bot: getting 'The following arguments have not been supplied' error

I am trying to add to a Telegram bot a timer which runs and sends a message every x time. Getting always the error: x argument have not been supplied from the callback function, even though I am putting those arguments in the context argument when…
Pedro Sanchez
  • 1
  • 1
0
votes
0 answers

Run repeating jon queue

def set_timer(update: Update, context: CallbackContext) -> None: """Add a job to the queue.""" chat_id = update.message.chat_id try: # args[0] should contain the time for the timer in seconds due = int(context.args[0]) …
Luiio01
  • 1
0
votes
1 answer

Elegantly wait until a job in redis queue is done, without busy wait?

I'm trying to implement a redis queue in the current system. The job will be sent to another module and it should wait until the job is done and returned the result, job.result, then move on: with Connection(redis_connection): job =…
Daniel Qiao
  • 121
  • 5
  • 15
0
votes
1 answer

How to install dask-jobqueue on a HPC

I am trying to use dask-jobqueue on a high performing computer (HPC). Following the documentation on dask-jobqueue here, I am trying to install dask-jobqueue on an instance of a Jupyter Notebook in the HPC with the following code: install…
Leockl
  • 1,906
  • 5
  • 18
  • 51
0
votes
1 answer

How to do infinite attempts in Bull Queue?

I am trying to send a user email after he registeres on my website My current code looks like this const data = { from: 'no-reply@test.com', to: req.user.email, subject: 'Please reset your Test Account Password', text: …
PirateApp
  • 5,433
  • 4
  • 57
  • 90
0
votes
1 answer

Segmentation fault inside range

#include #include #include #include // std::priority_queue using std::vector; using std::cin; using std::cout; struct fj{ int indexI=0; int freeT=0; }; struct DereferenceCompareNode :…
RajGM
  • 37
  • 6
0
votes
0 answers

JobQueue with at most 1 Job or "how to retry with up-to-date data"

I have an Observable that I want to send to a REST-Server. When the connection fails, I want to retry sending it forever. If in during the connection failure, the data changes, the new data should be sent instead. I thought I could implement this…
Salocin
  • 393
  • 6
  • 17
0
votes
1 answer

Moving long-delay queue from beanstalkd to AWS

I am now moving job queue from local beanstalkd server to Amazon SQS. But the problem is that SQS can only have short delay (15 min.) for a job. In my application, there are thousands of deals, and I use beanstalkd to expire the deals (i.e. call api…
Calvin W
  • 569
  • 1
  • 5
  • 8
0
votes
0 answers

How to keep a parallel-processed queue snappy when there's not much in it?

I have a queue for photos that people upload to my site, since at peak times there can be 10,000 or more photos uploaded in an hour. My php script is called via cron every minute, and picks photos from the database with the where clause…
Codemonkey
  • 4,455
  • 5
  • 44
  • 76
0
votes
1 answer

Submitting LSF job array using different arguments for each element of the array

I'm trying to avoid submitting separate jobs. I have so far have this at the start of my script: #!/bin/bash #BSUB -P account #BSUB -q queue #BSUB -W 48:00 #BSUB -n 2 #BSUB -R rusage[mem=40000] #BSUB -J jobname[1-22] #BSUB -a 000-176:1 #BSUB -eo…
joeblow
  • 13
  • 6
0
votes
0 answers

Job queue with concurrency control

I want to implement a job queue with concurrency control in JavaScript. I am not able to understand how to implement it. The use case for the job queue is that function will be pushed in the queue and queue has to execute them one at a time and…
Rishab Jain
  • 269
  • 4
  • 16
0
votes
1 answer

notify client using some form of Node.js based job queue after upload file , read , insert operations

is there a way by which i can update client side after below series of activities 1 upload file 2. read file 3. bulk insert 4. update client that job is completed. I am able to perform 1.upload file through through busboy. 2.read…
Rizwan Patel
  • 538
  • 2
  • 9
  • 27
1 2 3 4 5
6
7 8