Is it possible to run scrapy on heroku?

Question

I want to use Scrapy to get some data off a website, but I don't want to use my laptop to do it.

Would it be possible to run it as a heroku app? What other options do I have for running a scrapy spider on a remote server?

Thankss

score 4 · Accepted Answer · edited May 23 '17 at 10:33

4

It is possible to use Scrapy on Heroku. Other options include setting up Scrapyd on a remote server, or using Scrapy Cloud.

edited May 23 '17 at 10:33

Community

answered Nov 12 '12 at 10:03

Shane Evans

score 2 · Answer 2 · edited Jun 20 '20 at 09:12

2

You can use scrapy-heroku to run a Scrapyd server on heroku! No problem.

edited Jun 20 '20 at 09:12

Community

answered Nov 15 '14 at 08:13

Arctelix

2 Answers2