Questions tagged [beanstalkd]

Beanstalkd is a simple, fast work queue.

Beanstalkd is a simple, fast work queue.

Its interface is generic, but was originally designed for reducing the latency of page views in high-volume web applications by running time-consuming tasks asynchronously.

401 questions
2
votes
1 answer

Laravel + Beanstalkd: How to run "queue:listen" as a service

I'm using Beanstalkd as a work queue in my project. Now, my project is completed and I have to deploy it on VPS(production server). There is something that confusing me! should I ssh to production server and manually type php artisan queue:listen ?…
Hamed Kamrava
  • 12,359
  • 34
  • 87
  • 125
2
votes
1 answer

Transmitting Images (or large files) over Message Queues

What I am trying to accomplish is building the simplest system to process image uploading through message queues. Right now we are working with temporary files, we build one for each image that needs to be sent over Aws S3 and optimize/customize it…
GiamPy
  • 3,543
  • 3
  • 30
  • 51
2
votes
0 answers

Running tasks asynchronously that will never run simultaneously

I was wondering if there's a way running tasks asynchronously that will run in the background (Using Celery for example) which will never run simultaneously? Which means, each task can run by itself simultaneously with it self but not with another…
Drxxd
  • 1,860
  • 14
  • 34
2
votes
4 answers

How can I secure memcached/beanstalkd in a hostile cloud environment?

Here's how my servers (in Amazon EC2) would look like: Server 1 Server 2 Server 3 __________________________ _____________________ _______________ | Cloud Monitor Daemon | | Memcached…
dkulchenko
  • 640
  • 7
  • 12
2
votes
0 answers

How to use callbacks with beanstalkc and beanstalkd

I want to use call back went I put job in queue, when the job is reserve and when it's delete. How can I do this? This is my code in PHP: $queue->put(array('contracts' => $stateContract.$id_contract)); And this is in Python:…
wxcvbn
  • 483
  • 2
  • 7
  • 20
2
votes
4 answers

Change max-job size of beanstalkd

Does somebody how to change the max-job size of beanstalkd ? I have the problem that I get the message JOB_TOO_BIG and at Adding Job to beanstalkd, it says that the default size is 65k. Does somebody know how to change that ? EDIT: my beanstalkd…
user3097712
  • 1,565
  • 6
  • 27
  • 49
2
votes
1 answer

Beanstalkd to start when the system starts up or reboots , how to uncomment "START yes" on Centos

I'm using Beanstalkd for queue in Laravel on Centos 6 and I have seen that I need to uncomment the following START=yes for Beanstalkd to start when the system starts up or reboots When I run this command nano /etc/default/beanstalkd from root…
ikuchris
  • 1,162
  • 1
  • 15
  • 33
2
votes
1 answer

Laravel - Bug in sending email to wrong user

I'm using laravel 5.1. AWS EC2 service, ubuntu OS. I've created a command that sends emails to a number of users. Lets say I have this sample code: foreach($users as $user) { $data = $user->toArray(); $data['subject'] = "This is subject"; …
aceraven777
  • 4,358
  • 3
  • 31
  • 55
2
votes
1 answer

how to deal with race conditions among jobs with e.g. beanstalkd

I am wanting to set up a job queue with multiple workers. Right now I am looking at beanstalkd, but this is more of a conceptual problem, I believe: How can you ensure that jobs related to a single entity get handled in order? Let's say the workers…
2
votes
1 answer

How to correctly queue image manipulation in laravel with beanstalkd while uploading to Amazon S3?

I'm doing some tests with laravel by loading images to Amazon S3 and queuing image manipulation with beanstalkd. Please note that this is just testing. Here is my implementation: // routes.php Route::post('/', function() { $validator =…
funguy
  • 2,072
  • 7
  • 30
  • 41
2
votes
1 answer

beanstalkd: How workers can watch/prioritize tubes/queues in certain order?

The closest thing I can find already is this question and answer but it does not solve my problem: Do priorities work across queues/tubes in Beanstalkd? I'm thinking if I can tell my workers to watch tubes in a certain order or give priority too…
Ben
  • 35
  • 1
  • 4
2
votes
1 answer

what's the difference phalcon beanstalk queue's choose and watch methods

what's the difference between phalcon beanstalk queue's choose and watch methods. the comments of the two are same. namespace Phalcon\Queue { ... /** * Change the active tube. By default the tube is 'default' * …
user39544
  • 3,227
  • 2
  • 14
  • 8
2
votes
1 answer

Laravel 5 - Queued Commands throwing spl_autoload_call() error

UPDATE - This has been narrowed down to beanstalkd, sync works I am receiving the following error when attempting to run queued commands in my production environment: exception 'ErrorException' with message 'unserialize(): Function…
NightMICU
  • 9,000
  • 30
  • 89
  • 121
2
votes
2 answers

Calling Artisan Queue Retry from php

I am having issue about calling artisan queue from php. I want to make the list of fail jobs in Beanstalkd queue and make a button to retry. I want to call php artisan queue:retry{id} So, I put this code in the route.php Route::get('retry/{id}',…
2
votes
1 answer

Pheanstalk touch job to ask more time

How do I make my worker ask for more time to work on the job ? I am using the pheanstalk library. Work is a parsing of a file which depending on the file may take more than 60 secs, the default ttr. while( $job =…
ODelibalta
  • 2,194
  • 1
  • 18
  • 28