Stack Overflow
Stack Overflow

Questions tagged [rq]

RQ (Redis Queue) refers to Redis message queue and broker software. The tag can also refer to libraries implementing the Redis message queue.

RQ (Redis Queue) is a Redis message queue and broker software. The tag can also refer to libraries implementing the Redis message queue.

See also:

46 questions
0
votes
1 answer

How to pause and resume RQ task

I want to enqueue the RQ task, to complete a task, suppose it takes around 10 minutes, Now i want to pause any task if it continues for 5 minutes and start another task and after another 5 minutes and i want to pause the second task and start the…
NewbieProgrammer
  • 100
  • 7
0
votes
1 answer

TypeError: cannot pickle 'LockType' object

I am trying to create a flask application with rq redis which stores tasks that returns the data scraped by playwright library. What I am trying to do is to create a global browser instance of playwright variable, so when different users try to get…
NewbieProgrammer
  • 100
  • 7
0
votes
0 answers

Upgrading Redis to 7.0.11 results in TypeError at /login/ __init__() got an unexpected keyword argument 'ssl_cert_reqs'

We use redis with django-rq to manage queues on our project. Heroku has recently forced upgrades to Redis 7.0.11 and that requires TLS. Per their docs we need to set 'ssl_cert_reqs'=None in order to make sure redis is using TLS but not looking for a…
betsy_roth
  • 1
  • 1
0
votes
1 answer

Django race conditions between create() and get()

Since our last release a range of what seems can only DB race conditions have been happening.We use python 3.10, django-rq, Django 4 and Postgres. In one case: x = Model.objects.create() job.delay(x_id=x.id) In the job we call…
Henty
  • 603
  • 2
  • 7
0
votes
0 answers

Django RQ Worker job enqueue after video uploaded fully (chunk upload)

I want to give the signal after the video has fully uploaded, i tried with delays but the time varies conform the upload speed Here is the model: class Post(models.Model): author = models.ForeignKey(User, on_delete=models.CASCADE, null=True) title =…
MrLonely
  • 23
  • 1
  • 5
0
votes
1 answer

Django-RQ API_TOKEN configuration to access to stats endpoint

I'm trying to retrieve some statistics from the django-rq queues and I'm having some difficulties to access to the provided URL from the Django-Rq documentation These statistics are also available in JSON format via /django-rq/stats.json, which is…
afinkado
  • 21
  • 6
0
votes
0 answers

Multiple Background Jobs Redis Queue

I am trying to implement a fast API app in Heroku. A user has the option to send a keyword with the API endpoint. This triggers a background job (web scraping with the keyword). If there are multiple user triggering the job at a similar time I…
Marvin
  • 11
  • 1
0
votes
0 answers

Does my rq worker heroku dyno switch to new deployed code?

I noticed that my heroku worker dyno continued working while a new build was being done and succeeded. The worker is still running on the old code, correct? Or is there any process that moves the job to the new code? Thanks!
Iggee Xy
  • 83
  • 1
  • 8
0
votes
0 answers

Test email does not arrive in mail.outbox when sent by Django-RQ worker

I've set up a test within Django that sends an email, in the background, using Django-RQ. I call the code that enqueues the send_email task, then, I get the django-rq worker, and call .work(), with burst=True. In my console, I can see the django-rq…
Scratcha
  • 1,359
  • 1
  • 14
  • 22
0
votes
0 answers

Supervisord services healthcheck with eventlisteners

I am using redash where supervisord is used for process management of redash workers. It is using supervisord eventlistener for healthchecks. Source :…
SRJ
  • 2,092
  • 3
  • 17
  • 36
0
votes
0 answers

RQ with lightgbm

I ran into a problem when using rq and lightgbm. I have the following structure: flask - for receiving requests and folding them into redis redis - as a broker rq - for asynchronous request processing The server receives the data and the rq worker…
Darius1223
  • 1
0
votes
1 answer

How to run Python RQ jobs on a DigitalOcean application sever?

I have a FastAPI application deployed on DigitalOcean, it has multiple API endpoints and in some of them, I have to run a scraping function as a background job using the RQ package in order not to keep the user waiting for a server response. I've…
leftandright04
  • 13
  • 4
0
votes
1 answer

Flask and rq-scheduler: Working outside of application context

I want to start a background job that does a periodic sync when I start the flask application. This works well, but in the task function I want to access a logger that was defined outside. While this also works in the responsible class, the…
Hamilton
  • 11
  • 4
0
votes
1 answer

When trying to use a rq worker get rq.exceptions.DeserializationError

When trying to run django-rq worker I keep getting this error 15:35:26 Traceback (most recent call last): File "/home/john/PycharmProjects/api.to/venv/lib/python3.8/site-packages/rq/job.py", line 249, in _deserialize_data self._func_name,…
nadermx
  • 2,596
  • 7
  • 31
  • 66
0
votes
0 answers

Django RQ ModuleNotFoundError xxx is not a package

I'm using django rq for some long running task, which I would like to provide some feedback about its progress. I hence created a function which is enqueued as a new task and set some model's attribute and save them. Here is a simplified view: class…
daufinsyd
  • 41
  • 1
  • 5
1
2
3 4