0

I am using celery to scrap some URLs , and pushing the scrap data to an API but because of quick calls on this API i need to use Django Signals if it Sync

Ahmed Elemam
  • 396
  • 3
  • 12

1 Answers1

0

you can use periodic tasks in celery can you give more specific details what you want to exactly do

jackquin
  • 534
  • 1
  • 7
  • 19
  • I am scrap URLs ok i am running 40 Concurrency for one worker each scrap details once it scrapped it moved to Shopify API , so this make load and exceed 2 call per second for Shopify API , so i thinking if i make scrapper just scrap and store into database and once record created in database Django signal call the API , if the Django Signal is Snyc i think it will be go smooth – Ahmed Elemam Jan 13 '18 at 09:56
  • I am scrap URLs ok i am running 40 Concurrency for one worker each scrap details once it scrapped it moved to Shopify API , so this make load and exceed 2 call per second for Shopify API , so i thinking if i make scrapper just scrap and store into database and once record created in database Django signal call the API , if the Django Signal is Snyc i think it will be go smooth – Ahmed Elemam Jan 13 '18 at 09:56