Stack Overflow
Stack Overflow

Questions tagged [sidekiq]

Sidekiq is a background processing framework for Ruby.

Sidekiq is a multi-threaded background job and message processing gem written by Mike Perham and is available on GitHub.

2372 questions
11
votes
3 answers

Background mailing through sidekiq and devise-async, queue fills up but mails aren't processed

I'm currently building a rails platform and I've used devise for authentication and now want to move the default devise emails into a background process using sidekiq. I'm using devise-async for this and have done the following: Added the…
Julius
  • 576
  • 5
  • 12
11
votes
1 answer

Starting Sidekiq with rails server in development environment

I am using Sidekiq for some of my background processes. Currently what I do is: start bundle exec rails s on one terminal and then start bundle exec sidekiq on a different terminal so that the sidekiq starts itself and look for jobs to…
AnkitG
  • 6,438
  • 7
  • 44
  • 72
10
votes
2 answers

heartbeat: Unsupported command argument type: FalseClass - Redis

I have rails application which is using sidekiq for background jobs. Recently upgraded ruby from 2.7.0 to 3.1.2 and respectively redis gem automatically updated to '5.0.5'. After this sidekiq(6.4.1) logs throws below error, if i revert to old redis…
Rashmi Balkur
  • 267
  • 4
  • 12
10
votes
2 answers

uninitialized constant sidekiq worker

New rails project. Rails 5.0.2 Sidekiq 4.2.10 I ran rails g sidekiq:worker deposit_collector and then filled out the code I needed inside the perform method. To test I logged into the rails console and typed: DepositCollector.perform_async and I get…
Deekor
  • 9,144
  • 16
  • 69
  • 121
10
votes
1 answer

Is it safe to rename a Sidekiq worker with jobs still in the queue?

Can I rename a Sidekiq worker and deploy it in one step without worrying about jobs getting orphaned looking for the previous name? Or do I need to do a 2-step deploy to make sure the original jobs have drained from the queue before deleting the…
Andrew Cox
  • 165
  • 1
  • 10
10
votes
3 answers

How to mark a sidekiq task/job for retry without raising an error?

I use a Sidekiq queue to process communications with an unreliable, 3rd party API. Since this API is often down for a couple minutes at a time and then back up again, Sidekiq has been handy. When a connection issue happens, an error is raised and…
YWCA Hello
  • 2,997
  • 4
  • 29
  • 40
10
votes
1 answer

Sidekiq VS RabbitMQ

We are in need of a queuing system in our Ruby On Rails 4 web application what are the differences and why would/wouldn't you pick Sidekiq over RabbitMQ?
amitben
  • 670
  • 10
  • 21
10
votes
1 answer

Rails how to tell if a sidekiq worker is done with perform_async

I'm working on extrapolating an extensive background task to a sidekiq worker (first time working with sidekiq). I've been able to get this to run correctly. But I'm not sure how to check on the progress of the sidekiq worker - what's the best way…
Tom Hammond
  • 5,842
  • 12
  • 52
  • 95
10
votes
3 answers

How to share worker among two different applications on heroku?

I have two separate applications running on heroku and pointing to same database, first one responsible for user interfaceand second one for admin interface, I am using sidekiq with redis for background job processing, I have added one worker and I…
Sachin Singh
  • 7,107
  • 6
  • 40
  • 80
10
votes
1 answer

Sidekiq without Rails doesn't load worker classes

I'm using Sidekiq 3.1.2 without Rails like this: $ sidekiq -vr sidekiq.rb sidekiq.rb looks like this: ($LOAD_PATH << '.' << 'lib' << 'lib/workers').uniq! require 'lookup_worker' lib/workers/lookup_worker.rb looks like this: require…
PJSCopeland
  • 2,818
  • 1
  • 26
  • 40
10
votes
3 answers

How to check if sidekiq is started?

I am using the Sidekiq Gem with Rails 3. Is there a way to see if the sidekiq workers are ready to process jobs? We want to make sure that stuff is not just getting enqueued and sitting there. I tried something like this... stats =…
HelloWorld
  • 4,251
  • 8
  • 36
  • 60
10
votes
2 answers

Quickly adding multiple items (1000/sec) to a sidekiq queue?

I realize there is a push_bulk option for sidekiq but I'm currently being limited by latency to redis, so passing multiple items via push_bulk still isn't going quickly enough (only about 50/s). I've tried to increase the number of redis connections…
Geesu
  • 5,928
  • 11
  • 43
  • 72
10
votes
2 answers

Configuring Unicorn & Sidekiq correctly on Heroku

I was getting ActiveRecord::StatementInvalid (PG::Error: SSL error: decryption failed or bad record mac errors so I followed this guide about deploying Unicorn to Heroku and it seems to have fixed it. However under caveats it shows how to configure…
mind.blank
  • 4,820
  • 3
  • 22
  • 49
10
votes
1 answer

Sidekiq worker is leaking memory

Using the sidekiq gem - I have sidekiq worker that runs a process (git-tf clone of big repository) using IO.popen and tracks the stdout to check the progress of the clone. When I am running the worker, I see that sidekiq memory is getting larger…
Yosi
  • 2,936
  • 7
  • 39
  • 64
9
votes
1 answer

Sidekiq does not release memory after job is processed

I have a ruby on rails app, where we validate records from huge excel files(200k records) in background via sidekiq. We also use docker and hence a separate container for sidekiq. When the sidekiq is up, memory used is approx 120Mb, but as the…
Vivek Tripathy
  • 171
  • 2
  • 6
1 2 3
…
99 100