Stack Overflow
Stack Overflow

Questions tagged [beanstalkc]

beanstalkc is a simple Python client library for beanstalkd, a work queue daemon.

14 questions
4
votes
2 answers

Change beanstalkd default TTR

I run beanstalkd as a service using the standard /etc/default/beanstalkd. Sometimes my code throws a NOT_FOUND error when I try to delete a job, because it got released due to exceeding the TTR. I would like to increase the TTR for all jobs that get…
TTT
  • 6,505
  • 10
  • 56
  • 82
2
votes
0 answers

How to use callbacks with beanstalkc and beanstalkd

I want to use call back went I put job in queue, when the job is reserve and when it's delete. How can I do this? This is my code in PHP: $queue->put(array('contracts' => $stateContract.$id_contract)); And this is in Python:…
wxcvbn
  • 483
  • 2
  • 7
  • 20
1
vote
1 answer

How to consume from beanstalk tube

I am using beanstalk to put messages in the tube and i want to consume it from the new EC2 instance that i will launch at runtime. I am able to put message in the tube but i am not able to consume it by any means. I performed the below steps to…
Rohan0980
  • 47
  • 5
1
vote
1 answer

Beanstalkc Timeout Question

I am using beanstalkc in Python for a queuing process for a program which has to parse a list of URLs. Hence I am using timeout in beanstalk for avoiding huge time consumption by any URL. But even after using it my process doesn't time out in the…
Srikanth
  • 21
  • 2
1
vote
1 answer

How to use beanstalkc in Python to queue URLs and perform jobs

I have a function named spider which takes seed as an argument. seed is the name of the URL I send to the spider function. Now my question is how do I use beanstalkc in Python to queue the URLs and perform the jobs.
Srikanth
  • 21
  • 2
1
vote
0 answers

When I use the 'reserve' operation in beanstalked, it is blocked for a long time

I need to use beanstalked in my project.So I download the 1.1 version. I use the beanstalkc for python client. A simple Producer-Consumer model. Producer: import beanstalkc beanstalk = beanstalkc.Connection('localhost') …
GeekDemo
  • 13
  • 3
1
vote
1 answer

Connection refused in Django_beanstalkd

I'm very stuck with this. I have an app in Django that uses beanstalkd to establish a connection with vlcserver. Vlcserver captures video from an rtsp stream of an IP camera, and after that, that video is transcoded to a h264 format. The problem…
DavidRguez
  • 1,070
  • 3
  • 12
  • 27
1
vote
0 answers

Reload beanstalkd configuration without restaring

Is there a way to reload the beanstalkd config without actually restarting beanstalkd? When I use sudo service beanstalkd restart or sudo service beanstalkd force-reload it clears all the queues. (Yes, in the future I will run it in persistent…
TTT
  • 6,505
  • 10
  • 56
  • 82
1
vote
1 answer

Check if all reserved jobs have been completed using beanstalkc

I want one of my scripts to know if all of the remaining queued jobs in beanstalkd have been completed. I'm currently planning to iterate through every job id and run peek() to see if anything is returned. Is there a more elegant way to do this?
jan
  • 2,263
  • 5
  • 19
  • 22
0
votes
2 answers

How to tell a beanstalkc receiver to wait X seconds before reserving a task?

I have 2 beanstalkc receivers watching the same tube "tubename". I would like one beanstalkc receiver to have priority over the other. In order to achieve this, I would like to tell the lowest-priority beanstalkc receiver to wait for task being X…
vvvvv
  • 25,404
  • 19
  • 49
  • 81
0
votes
1 answer

how to use callback in beanstalkd ？

There is 3 machines and one publisher, two consumers. I am using golang to publish order to some machine. And the machine is used python to be consumer. I want to know how can I get the result that the order is finished or failed in publisher. And…
haroldT
  • 153
  • 2
  • 11
0
votes
1 answer

Search in beanstalk queue

I have a use case which requires placing two different types of jobs in a beanstalk queue, say type a and type b. I put type a job whenever a new one arrives, but for type b I want that there should be a single job of type b in a queue at a time…
its me
  • 127
  • 2
  • 8
0
votes
1 answer

Non-Blocking WebSocketHandler while receiving jobs from a queue

Setup: Tornado HTTP/WebSocket Server. WebSocketHandler reacts on messages from the client (e.g. put them in the job-queue) A beanstalk job-queue which sends jobs to the different components Some other components communicating over beanstalk, but…
Beastcraft
  • 375
  • 1
  • 6
  • 16
0
votes
1 answer

Getting jobs from beanstalkd - timed out exception

I am using Python 2.7, beanstalkd server with beanstalkc as the client library. It takes about 500 to 1500 ms to process each job, depending on the size of the job. I have a cron job that will keep adding jobs to the beanstalkd queue and a "worker"…
Sagar Hatekar
  • 8,700
  • 14
  • 56
  • 72