Stack Overflow
Stack Overflow

Questions tagged [beanstalkd]

Beanstalkd is a simple, fast work queue.

Beanstalkd is a simple, fast work queue.

Its interface is generic, but was originally designed for reducing the latency of page views in high-volume web applications by running time-consuming tasks asynchronously.

401 questions
1
vote
3 answers

Running stalker (Ruby gem) as a daemon

Is it possible to run the Ruby gem stalker as a daemon? Something like as stalk jobs.rb -d. Should I just use stalk jobs.rb &?
Amit
  • 3,952
  • 7
  • 46
  • 80
1
vote
1 answer

beanstalkd has a limit on tubename?

I was trying to add this tubename to beanstalkd "video_convert_and_snap". it gives me an error that this is an invalid tubename. Any idea, why?
Amit
  • 3,952
  • 7
  • 46
  • 80
1
vote
1 answer

Php daemon process crashing frequently

We are using beanstalkd to run receiving jobs from client, with php and using pheanstalk as php agent. we running a worker as php system daemon and keep monitoring using monit. But it keeps restarting in a once in a day frequency. After observing…
Vivek Balachandran
  • 79
  • 7
1
vote
2 answers

Pheanstalk workers reserving same job multiple times when buried immediately

So I use beanstalk_console (https://github.com/ptrofimov/beanstalk_console) to monitor my beanstalkd queue and at times, I would get 1 or 2 jobs stuck in the buried state. This is due to how I have my worker code setup, where I immediately bury a…
georaldc
  • 1,880
  • 16
  • 24
1
vote
1 answer

Laravel pushing jobs into different queue with low priority

Right now I am using Beanstalkd and Laravel forge for my queues which I fire like this: dispatch(new ProcessPodcast($podcast)); But how do I push a queue into a different job that has a low priority? This will only push the queue into a different…
user2722667
  • 8,195
  • 14
  • 52
  • 100
1
vote
1 answer

Is it possible to run queues working synchronously with Laravel

I am trying to set up an API system that synchronously communicates with a number of workers in Laravel. I use Laravel 5.4 and, if possible, would like to use its functionality whenever possible without too many plugins. What I had in mind are two…
Ruben Colpaert
  • 91
  • 10
1
vote
1 answer

Start sending data to a different beanstalkd server

I have 2 servers with installed beanstalkd. First server have ip 10.1.0.61 Second server have ip 10.1.0.62 Now I want to send job data to worker I created the job on the first server(61) The worker is running only on the second server(62) To…
sanof
  • 349
  • 7
  • 18
1
vote
1 answer

Go queue processing with retry on failure

We have a bunch of files to be uploaded to remote blob store after processing. Currently, the frontend (PHP) creates a redis list of such files and gives it a unique ID, called JobID. It then passes the unique ID to a beanstalk tube, which is…
recrsn
  • 450
  • 5
  • 12
1
vote
1 answer

Pheanstalk queueng list reserve PHP

Hi All i am having trouble on my pheanstalk sorry this is my first time of using this. My project involves a one save of 5000 entries the php when i work on gets 502 because of the traffic request.So my solution to these is to use a pheanstalk on…
Jean Scuff
  • 11
  • 1
1
vote
1 answer

What is the reason to use AMQP instead of Beanstalkd?

Why use one or the other?
TIMEX
  • 259,804
  • 351
  • 777
  • 1,080
1
vote
0 answers

Delete current job in the Queue Laravel

So i have a system to send data through CURL according to some configurations set in the Database, i'm using Queues as i'm afraid of the load it might put on the server as i'm starting the service once every minute. This is done as the data must be…
João Serra
  • 243
  • 4
  • 14
1
vote
1 answer

Laravel valet with beanstalkd

I am trying to use Beanstalkd in Laravel valet but it wont work. I've installed Beanstalkd using brew and I start it up by typing beanstalkd. The only problem is that my queues never start. And queue:listen wont return anything and I don't see any…
user2722667
  • 8,195
  • 14
  • 52
  • 100
1
vote
0 answers

How to make a horizontally scalable collection of sequential job queues?

I have a collection of producers of jobs, and a (bigger) collection of workers that can process any job. Each job has a "reference", and jobs with the same reference MUST be processed sequentially, ie. only a single worker can ever be working on a…
Roel Harbers
  • 1,014
  • 1
  • 9
  • 18
1
vote
1 answer

Beanstalk setup with multiple queue worker: Jobs that spawns another jobs

Is it safe to spawn multiple jobs from a job so workers could start working on any vacant jobs? Currently my set up is like this. I have 20 workers waiting for any jobs to be pushed. One of the job is to send iOS push notification, the problem with…
Haunter
  • 39
  • 4
1
vote
2 answers

Use beanstalkd, for periodic tasks, how to always make a job replaced by its latest one?

I am trying to use beanstalk for queuing a large number of periodic tasks (for example, tasks need processed every N minutes), for each task, if the last queued job is not completed (not reserved, i mean) when current job to be added, the last…
peterwang
  • 1,159
  • 2
  • 11
  • 11
1 2 3
…
26 27