Preserve beanstalkd queue on restart or crash

Question

I'm using beanstalkd to managed queues. I just realised that if there are jobs in a queue and the beanstalkd process is restarted or crashes then the job is lost forever (or so I think).

Is there a way to preserve the jobs in the queue on beanstalkd failure or restart? If not, whats best practice to ensure jobs are never lost?

score 14 · Accepted Answer · answered May 27 '15 at 20:44

14

Beanstalkd can be started with the -b (binary log) option, and beanstalkd will write all jobs to a binlog. If the power goes out, you can restart beanstalkd with the same option and it will recover the contents of the log.

answered May 27 '15 at 20:44

Alister Bulman

34,482
9
71
110

Thank you very much kind sir! – Wasim May 27 '15 at 21:33
1

How does one add the `-b` option when `beanstalkd` is started as a service? – Robin van Baalen Sep 21 '16 at 04:07
2

Just add it to your `/etc/default/beanstalkd` like so: `DAEMON_OPTS="(your current options) -b /var/lib/beanstalkd"` – jmserra Sep 30 '16 at 10:27

Preserve beanstalkd queue on restart or crash

1 Answers1