scrapyd pool_intervel to scheduler a spider

Question

I want to make my spider start every three hours.

I have a scrapy confinguration file located in c:/scrapyd folder.

I changed the poll_interval to 100

the spider works, but it didn't repeat each 100 seconds.

how to do that please?

Did you manage to figure that out? – Luka Bradeško Dec 31 '15 at 08:34 — Luka Bradeško, Dec 31 '15 at 08:34

score 1 · Answer 1 · answered Jul 09 '14 at 17:03

1

Maybe you should do a cron job that executes every three hours and performs a curl call to Scrapyd to schedule the job.

answered Jul 09 '14 at 17:03

Bernardo Botella

1 Answers1