Questions tagged [beanstalkd]

Beanstalkd is a simple, fast work queue.

Beanstalkd is a simple, fast work queue.

Its interface is generic, but was originally designed for reducing the latency of page views in high-volume web applications by running time-consuming tasks asynchronously.

401 questions
5
votes
1 answer

Php-worker keeps growing in memory when running supervisor queue's

When running supervisor queue's the memory of the php-worker container keeps rising. (As seen in docker stats) This number does not go down when the jobs are done. When the queue keeps processing jobs for a while the memory reaches 100% and…
5
votes
1 answer

How to run multiple beanstalk worker using php

As of now, I am running only one beanstalk worker thread for my project, which handles both cron based jobs and real time jobs. So, I want to separate it out into two workers. One worker is used to track the cron based jobs and one more to track the…
karuh24
  • 285
  • 1
  • 6
  • 14
5
votes
3 answers

Prevent similar queue job if job already in queue in laravel

I am using Beanstalkd with laravel for handling queue job. How can i prevent from adding same job if job is already in queue. I am using laravel 5.3 with Beanstalkd 3.1
5
votes
1 answer

What happens with the QueueWorker when TTR ran out?

This relates to laravel 5.3, beanstalk, ttr and timeout working with Queue's and QueueWorkers. TTR: https://github.com/kr/beanstalkd/wiki/faq If I understand correctly a job from the Queue gets the state reserved when a QueueWorker is picking it.…
MmynameStackflow
  • 1,251
  • 3
  • 19
  • 39
5
votes
2 answers

Supervisor won't automatically startup when Ubuntu Server is booted

I'm working on beantalkd and supervisord for my Laravel project with homestead vm. Everytime i vagrant up the homestead vm, the supervisord does not start. I have to manually type below for it to run: sudo service supervisor start The version i'm…
Kevin
  • 173
  • 6
5
votes
1 answer

Beanstalkd queue with AWS elastic beanstalk

I wan't to deploy my web app which is running inside docker containers to elastic beanstalk. When deploying your app to elastic beanstalk you have two environment options you can choose from: Web Server Environment Worker Environment Logically my…
Boedy
  • 6,647
  • 1
  • 21
  • 24
5
votes
2 answers

Laravel Mail Queue Infinite Loop on Exception

Hello fellow programmers, I wish everyone a good morning. The Situation Laravel is great. Laravel Mail queues and the beanstalkd integration is great. It took me almost no time to get everything working. The sun is shining and its not raining. Its…
Mythli
  • 5,995
  • 2
  • 24
  • 31
5
votes
1 answer

Why is Laravel or Beanstalkd skipping jobs?

I'm managing audio conversions with Laravel Queues and beanstalkd, monitored by supervisord. When a user upload an audio file, it goes to AudioController.php that triggers a Queue::push('AudioProcess'), that itself triggers an exec('sh…
ryancey
  • 1,037
  • 2
  • 11
  • 27
5
votes
4 answers

Class 'Pheanstalk_Pheanstalk' not found in Laravel 4 with Beanstalk

I'm trying to get beanstalk up and running and I'm getting the exception when trying to run Queue::push(): Class 'Pheanstalk_Pheanstalk' not found I've run composer require pda/pheanstalk, and even regenerated my auto-load file an extra time. It's…
Anthony
  • 5,275
  • 11
  • 50
  • 86
5
votes
1 answer

Do priorities work across queues/tubes in Beanstalkd?

I am a little confused as to whether priorities work at the job or queue/tube level. The reason I ask is that I am using a beanstalkd integration module in Drupal. This module enables one to define queues/tubes and assign a priority value to each…
Benjen
  • 2,835
  • 5
  • 28
  • 42
5
votes
3 answers

Laravel 4.1 mail queueing with beanstalkd driver - "Insufficient data for unserializing"

I'm working on my first Laravel app, and hit an odd problem when trying to queue up email sending using Mail::queue to send emails. I was originally using the sync driver and everything worked fine, however having now switched over to the beanstalkd…
Jonathan Ellis
  • 5,221
  • 2
  • 36
  • 53
5
votes
1 answer

Beanstalkd in docker

I'm building a Docker image with this Dockerfile FROM ubuntu:12.04 ENV DEBIAN_FRONTEND noninteractive ENV PATH /usr/local/rvm/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin # update apt RUN echo "deb…
Michal Holub
  • 730
  • 1
  • 7
  • 21
5
votes
2 answers

Limiting a queue over time

I'm using an API that is limited for usage, let's say: no more than 10 calls per second, and no more than 5000 calls per day. I am handling this calls in a beanstalkd queue process job. How can I limit the processing of this jobs, having in mind the…
catalinux
  • 1,462
  • 14
  • 26
5
votes
1 answer

Push to a different beanstalkd server

I have set my config to use my local beanstalkd server: 'beanstalkd' => array( 'driver' => 'beanstalkd', 'host' => 'localhost', 'queue' => 'default', ) How do I push jobs to another beanstalkd server? Queue::push(function($job) { …
Jürgen Paul
  • 14,299
  • 26
  • 93
  • 133
5
votes
2 answers

How to fire Laravel Queues with beanstalkd

I'm pretty new to the whole Queue'd jobs thing in Laravel 4. I have some process heavy tasks I need the site to run in the background after being fired by the user doing a particular action. When I was doing the local development for my site I was…
Tyrone
  • 63
  • 1
  • 6
1 2
3
26 27