RQ is a simple, lightweight, Python library for creating background jobs, and processing them.
RQ (Redis Queue) is a simple python library for queueing jobs and processing them in the background with workers. It is backed by redis and it is designed to have a low barrier to entry. It should be integrated in your web stack easily.
I have just started to use Fabric to automate our most basic python deployments, and a part of our stack is a jobs server that uses rq (http://python-rq.org/) as our queue solution on top of redis. For some reason that I can not explain, the…
A document that I am retrieving from a RethinkDB database has a timestamp in it (represented as a Python datetime.datetime object with a special tzinfo value of type rethinkdb.ast.RqlTzinfo.
When pushing it to an RQ task queue I am getting an…
I have written some code which takes a long time to execute (2-3 days) and i want to push it on the server to be executed there. The code is rich of classes and functions interacting with each other but in the end the whole code execution is done…
I have a class that does a complex calculation for me. The actual calculation does not take that long, but getting an instance of the class takes about a second. (It reads in a bunch of large-ish data files.)
Is there a way that I can create an…
I'm trying to figure out rq queuing with redis. I have simple test_job function which I want to use in queue.
def test_job():
return "OK"
And the script taken mainly from rq documentation:
#!/usr/bin/env python
import redis.client
from rq…
I'm developing a website using Django. I have about 50 functions. And it takes about 1 minute to get the result for all of them.
The problem is that I use heroku for my app. And heroku has a limit of 30 sec to get the request. I was suggested to use…