0

I am new to Scrapy framework. And I am just learning Python language. I need to scrape data from the online shop. But there is pagination with ajax on some pages. I have watched some tutorials about how to add pagination in a scrapy spider, but it's not clear for me. I know that I need to reproduce requests. I found out these requests in Dev tools---Network tab(please see the photo).

Link to the shop

photo

I don't know which (Scrapy framework) methods or requests I can use. Could you help me to solve this issue please?

Judgin
  • 3
  • 4
  • Have a look at this https://stackoverflow.com/questions/12847965/scrapy-parsing-items-that-are-paginated AND https://www.youtube.com/watch?v=G9Nni6G-iOc . Hope you will get a clue. – Prasad Wargad Feb 20 '20 at 11:58
  • https://docs.scrapy.org/en/latest/topics/dynamic-content.html – Gallaecio Apr 17 '20 at 17:11

0 Answers0