Autoscaling workers for delayed_job in Rails 3

Question

I've been using collectiveidea's fork of delayed_job as a gem in my Rails 3 app, and it's working fine. I'm now looking for a solution to autoscale workers, specifically for Heroku. I've given pedro's fork a try but since it's written for Rails 2, using it throws lots of errors and warnings about deprecated methods and I haven't been able to get it to work successfully.

Is there a working solution for Rails 3 delayed_job with autoscaling workers?

score 3 · Accepted Answer · answered Dec 10 '10 at 05:39

3

You might want to take a look at workless, it's one of the only Rails3 worker autoscalers I've seen at this point.

answered Dec 10 '10 at 05:39

Scott

54
1

1

Good suggestion. I have been using workless for a bit in production, which I found after posting this question. I've had no problems with it scaling up and shutting down a worker. One caveat is that it will scale up only one worker for multiple jobs and process jobs sequentially rather than concurrently, but that's fine with me. – nmunson Dec 10 '10 at 15:19

score 2 · Answer 2 · answered Jul 01 '11 at 23:21

2

Specifically for heroku, check out "HireFire - The Heroku Worker Manager" and hirefireapp service:

https://github.com/meskyanichi/hirefire - open source
http://hirefireapp.com/ - service in public beta now

answered Jul 01 '11 at 23:21

wik

2,462
1
24
29

score 0 · Answer 3 · answered Dec 07 '10 at 08:07

I've started working on a gem called Komodo to perform that very same task for un upcoming project at work. However, since we've only just started on the project, the gem is still very, very early - and untested.

I should see some consistent updating over the next couple of weeks though - would certainly appreciate any feedback or contributions! :)

Autoscaling workers for delayed_job in Rails 3

3 Answers3

Linked