1

Is there a way to use the Newspaper3k library to scrape behind paywalls if you have a subscription?

As we don't have direct access to the URL request method, I'm not sure how we can, for example, pass in a session cookie. Is there any way, maybe better, to do this?

Gummy bears
  • 176
  • 6
  • Yes, you should be able to log in to the subscription service using selenium and query the site with newspaper. If you still need help please let me know the target site and I will put together some code. – Life is complex Feb 22 '21 at 20:52

0 Answers0