Questions tagged [beanstalkd]

Beanstalkd is a simple, fast work queue.

Beanstalkd is a simple, fast work queue.

Its interface is generic, but was originally designed for reducing the latency of page views in high-volume web applications by running time-consuming tasks asynchronously.

401 questions
5
votes
1 answer

Launch beanstalkd command at Ubuntu Boot

I am working on beanstalkd on Ubuntu (Very new for me), I want to know which is good way to start beanstalkd service on ubuntu boot. In short, I would like to execute, beanstalkd -b /path/to/binlog/directory -l 127.0.0.1 -p 11300 Using…
Sanjay Mohnani
  • 990
  • 7
  • 18
4
votes
1 answer

Pheanstalk Questions

I'm looking to run a persistent instance of a python interpreter that can be passed input. The entire system designed to do this will be written in PHP. I've noticed the Pheanstalk package for use over the beanstalkd work queue. Has anyone used…
paradox870
  • 2,152
  • 4
  • 20
  • 30
4
votes
1 answer

Laravel beanstalkd queue repeating jobs before retry time

I've configured a queuing on Laravel 5.4 using the "beanstalkd" queue driver ... I deployed it on CentOS 7 (cPanel) and installed Supervisor... but I've two main problems In the logs, I found this exception "local.ERROR: exception 'PDOException'…
Doaa Magdy
  • 518
  • 5
  • 20
4
votes
1 answer

Output from beanstalkd

I want to monitor what jobs are flowing through a beanstalkd queue. Is there a way I can do this through command line. On running beanstalkd on command line no output is displayed. Essentially I am looking for a debug or a verbose option.
randomuser
  • 1,858
  • 2
  • 17
  • 21
4
votes
1 answer

Laravel Queues - how to assign specific number of workers to different queues

I've set up Laravel (5.5) queuing with Beanstalkd, and I'm using Supervisor. Laravel docs mention the following: By pushing jobs to different queues, you may "categorize" your queued jobs and even prioritize how many workers you assign to various…
GTCrais
  • 2,039
  • 2
  • 26
  • 32
4
votes
2 answers

Rails: Can I run backgrounds jobs in a different server?

Is it possible to host the application in one server and queue jobs in another server? Possible examples: Two different EC2 instances, one with the main server and the second with the queueing service. Host the app in Heroku and use an EC2 instance…
donald
  • 23,587
  • 42
  • 142
  • 223
4
votes
1 answer

Is it possible to plain Beanstalkd task at some time?

I use Beantalkd and Yii2 framework. To add in queue I use something like this: Yii::$app->beanstalk ->putInTube('tube2', ['param' => 'val'], PheanstalkInterface::DEFAULT_PRIORITY, PheanstalkInterface::DEFAULT_DELAY); But now I…
sharp
  • 857
  • 1
  • 9
  • 21
4
votes
3 answers

Running asynchronous jobs in the background (laravel)

I know Laravel's queue drivers such as redis and beanstalkd and I read that you can increase the number of workers for beanstalkd etc. However I'm just not sure if these solutions are right for my scenario. Here's what I need; I listen to an XML…
Ilyas Serter
  • 810
  • 1
  • 8
  • 12
4
votes
1 answer

Laravel logs don't write when queued by beanstalkd daemon

If I fire the queue from the command line, my log lines write to the log along with any errors. However, if the queue fires from the beanstalkd queue run as a daemon then no errors or explicit Log calls are written. What could be blocking them when…
eComEvo
  • 11,669
  • 26
  • 89
  • 145
4
votes
1 answer

Beanstalkd in Symfony 2

I am in the process of integrating some sort of background service executor. I am thinking to use Beanstalkd for it. I Googled it everywhere but I could not find a decent bundle to do the job with nice documentation. Few I found…
nicholasnet
  • 2,117
  • 2
  • 24
  • 46
4
votes
2 answers

Change beanstalkd default TTR

I run beanstalkd as a service using the standard /etc/default/beanstalkd. Sometimes my code throws a NOT_FOUND error when I try to delete a job, because it got released due to exceeding the TTR. I would like to increase the TTR for all jobs that get…
TTT
  • 6,505
  • 10
  • 56
  • 82
4
votes
2 answers

How to handle a Beanstalkd job that has an error

When my Beanstalkd job has an error, like "exception 'ErrorException' with message 'Notice: Undefined index: id in /var/www/mysite/app/libraries/lib.php line 248' in /var/www/mysite/app/libraries/lib.php:248, how should Beanstalkd knows that an…
Nyxynyx
  • 61,411
  • 155
  • 482
  • 830
3
votes
2 answers

A queuing system which supports job batching (e.g. several jobs for 1 worker at once)

I'm looking for a queuing system that could support the following scenario: A client adds a job - to check how many Facebook likes a particular url (URL1) has; A client adds another job - to check the same information for URL2; [....] A worker…
Aurimas
  • 2,518
  • 18
  • 23
3
votes
1 answer

Pheanstalk (PHP client for beanstalk) - how do connections work?

I'd like some help understanding the use of pheanstalk (php beanstalk client). I have a PHP program that is executed on the server when form data is sent to it. The PHP program should then package the form data as a JSON structure and send it to a…
msgmash.com
  • 1,035
  • 5
  • 10
3
votes
4 answers

Problems on select module on Python 2.5

I have an application in Python 2.5 that listens to a beanstalk queue. It works fine on all machines I tested so far, except from my newly acquired MacBook Pro. On that computer, when I try to run it I get this error: Traceback (most recent call…
kolrie
  • 12,562
  • 14
  • 64
  • 98