Questions tagged [beanstalkd]

Beanstalkd is a simple, fast work queue.

Beanstalkd is a simple, fast work queue.

Its interface is generic, but was originally designed for reducing the latency of page views in high-volume web applications by running time-consuming tasks asynchronously.

401 questions
3
votes
0 answers

Benefits of using Apache Kafka vs Beanstalkd

I am implementing data aggregation application framework. It should be consuming create, update and delete operations on MySQL databases which are sharded across multiple instances. These aggregations should be stored in a separate database and…
Vladimir Cvetic
  • 832
  • 3
  • 8
  • 23
3
votes
1 answer

Phalcon + Beanstalkd, how to link my controller?

I have a restful API powered by Phalcon that needs to background some tasks. In a MailController I have a method that fetches mails from Imap. As I need to put here some slow stuff, I want to process it through a job. My route calls a mailAction,…
Finkle
  • 53
  • 6
3
votes
2 answers

How to monitor Redis as a queue engine using cli similar to beanstalkd?

Background We used Laravel Queues on top of beanstalkd on two ec2 instances (behind a load balancer). As the system scaled we decided to use redis instead of beanstalkd, and host it on an AWS elastic cache instance (with a cluster of a master node…
abbood
  • 23,101
  • 16
  • 132
  • 246
3
votes
1 answer

zeroMQ vs node.js vs beanstalkd vs Twisted

I have the following requirements: Reliable messaging: ensured delivery, in-order, no-duplication Message filtering and routing based on customizable criteria Message multi-cast Message recipient list, send messages to only specified…
Liviu Mandras
  • 6,540
  • 2
  • 41
  • 65
3
votes
1 answer

beanstalkd storage backend

I would like to know if thers any db storage for beanstalkd queue system http://kr.github.com/beanstalkd/ My primany intention is to analyse the job status , completed or dumped or in process or done.
goutham
  • 848
  • 2
  • 13
  • 27
3
votes
1 answer

Beanstalkd stats show jobs but peek-ready is not found

I've got a Beanstalkd instance running and can put jobs on the queue without problems. I can see the jobs are there: $ echo -e "stats\r\n" | nc localhost 11300 | grep jobs current-jobs-urgent: 0 current-jobs-ready: 3 current-jobs-reserved:…
MHG
  • 1,410
  • 3
  • 19
  • 32
3
votes
1 answer

Beanstalk always have infinite loop php

I did something wrong with my Beanstalkd setup. I have created a producer, but it keeps loading, like an infinite loop. I also posted this issue to GitHub. I tried adding 2 tubes which have a simple array in them, but the other issue that I…
3
votes
1 answer

How get stats of specific Beanstalkd tube?

I want to get statistique of email tube This is my code : $queue = new Phalcon\Queue\Beanstalk(array('host' => 'xxx.xx.x.x','port' => '11300')); $queue->choose('email'); $queue->watch('email'); $statTube=statsTube('email'); I tried to remplace…
wxcvbn
  • 483
  • 2
  • 7
  • 20
3
votes
1 answer

Beanstalkd support for multiple servers and load balancing

I am using beanstalkd in a Laravel project to handle jobs on a queue. Beanstalkd is running locally. What I want to do is add one or more remote servers to handle some jobs when the queue gets bigger. I know that with Laravel I can send a job to a…
nteath
  • 250
  • 1
  • 13
3
votes
0 answers

Laravel Forge Beanstalk Queue Stuck

I created a Beanstalk queue with Laravel Forge with the following settings: 90 seconds max per job 10 rest seconds when empty 3 maximum tries production environment I ran a job from my Laravel 5.2 app that did not process correctly (a payment…
Joe Magaro
  • 213
  • 1
  • 14
3
votes
1 answer

Is laravel queue system suitable for big projects?

I needed to know if laravel 5 queue management system is suitable for big projects (having about 100.000 users). I want to do something like messaging (not spam :) ) users at once each day. Is redis good enough for this job (queuing)? Or it is…
Ali Farhoudi
  • 5,350
  • 7
  • 26
  • 44
3
votes
3 answers

Beanstalkd + supervisor + laravel : Queue processing with more than 10000 jobs an hour

I have a project in Larave 5.2 and I am using: Beanstalk Supervisor Laravel 5.2 Digital Ocean Hosting with 4GB RAM The project is mainly based on webhooks. Other website calls our webhook and i add those webhooks in a queue. Roughly, 10000 jobs an…
Nivesh Saharan
  • 365
  • 3
  • 11
3
votes
1 answer

Laravel Mail::queue not async

I have a problem with laravel 5.1 queues. I have beanstalkd already set up in my Homestead vm so all i did was to change the queue driver from the default one to beanstalkd in config/queue.php. I've tried the code below and neither one seem to be…
Dănuț Mihai Florian
  • 3,075
  • 3
  • 26
  • 44
3
votes
1 answer

beanstalkd weirdness, returns invalid jobs

beanstalkd is playing tricks on me. As you can see from the following series of commands, there are ready jobs, but I cant peek, delete, or do anything with them. watch ab_similar_sync_node WATCHING 1 stats-tube ab_similar_sync_node OK…
Ammar Ibrahim
  • 313
  • 3
  • 9
3
votes
2 answers

Laravel Unable to Queue Job

I repeatedly receive the following error when I try to push a job onto my Laravel Queue: Argument 1 passed to Illuminate\Queue\Jobs\Job::resolveAndFire() must be of the type array, null given, called in…
ExoticChimp
  • 1,884
  • 1
  • 19
  • 37