I have several projects running in scrapyd and all uses the same pipeline, so How can I add this pipeline to every scheduled spider as default with out adding anything to the curl request, only having a flag in default_scrapyd.conf file?
Asked
Active
Viewed 70 times
1
Jgaldos
- 540
- 1
- 5
- 9
-
I'm afraid there are only two options and you already rejected one of them. The other options is to add the pipeline in `ITEM_PIPELINES` in each of the projects' `settings.py` and re-deploy projects. – Tomáš Linhart Aug 09 '17 at 05:44
-
one question, the other options is call the pipeline in the ``curl`` request right? but I must add the pipeline in each project anyways? – Jgaldos Aug 09 '17 at 14:40
-
Yeah, the other option is to override `ITEM_PIPELINES` setting on curl command line. – Tomáš Linhart Aug 09 '17 at 14:55