I tried to use scrapy to scrap one website but kept receiving the error "Connection to the other side was lost in a non-clean fashion."
Tried to set the user agent and headers but it won't work. The following is the completed log. Any idea will be apprieciated.