2

I am building a web scraper that once you enter a URL it grabs the necessary data. I am manually entering my network credentials and my proxy settings. Is there a way around this as this is not a graceful solution? Is there a way to take my default network credentials to authorise the proxy so that I don't get a 407 error?

username = 'username'
password = 'password'
proxies = {'http': 'http://...., 'https': 'https://....}
page = requests.get(URL, proxies=proxies)
Calvin P
  • 109
  • 1
  • 6
  • Not really sure what you mean. You can configure your proxy to allow connections from specific IP's without requesting authentication (for example https://botproxy.net allows this) or configure alternative methods of authentication on proxy. – mylh Sep 19 '17 at 16:43

0 Answers0