How can you message a background process from mod_python?

Question

We're running a Linux server running Apache2 with mod_python. One mod_python script inserts an entry in a database logging table. The logging table is large can be a point of disk-write contention, or it can be temporarily unavailable during database maintenance. We would like to spin off the logging as an asynchronous background task, so that the user request can complete before the logging is done.

Ideally there would be a single background process. The web handler would pass its log request to the background process. The background process would write log entries to the database. The background process would queue up to a hundred requests and drop requests when its queue is full.

Which techniques are available in Python to facilitate communicating with a background process?

score 1 · Answer 1 · answered Oct 16 '14 at 13:08

1

you can use celery / redis task queue.

answered Oct 16 '14 at 13:08

forvaidya

3,041
3
26
33

Thanks. It looks like [redis](http://redis.io/) is a key-value store? How would you use that as a queue? – Andomar Oct 16 '14 at 14:26
please refer to http://www.celeryproject.org/. I have successfully used this in my projects. – forvaidya Oct 17 '14 at 07:41

How can you message a background process from mod_python?

1 Answers1