Getting wrong html content when trying to download a webpage using python requests

Asked Jan 09 '20 at 11:15

Active Jan 09 '20 at 20:50

Viewed 51 times

I am trying to download a URL something like "https://some.com/ATS/cgi-bin/view.pl?axm_f_qtr_ins_chk_bd_sds%20status%20P01".

I think that is because of the %20. Can you please help me with this encoding issue? The garbage webpage which gets downloaded is as attached. Also, I cannot use beautifulsoup. I am restricted only to requests package. Thanks!

edited Jan 09 '20 at 20:50

theduck

2,589
13
17
23

asked Jan 09 '20 at 11:15

user2381346

you need [urllib.parse.unquote](https://docs.python.org/3/library/urllib.parse.html#urllib.parse.unquote) – tushortz Jan 09 '20 at 12:13
Thanks Tushortz, but that did not help, still getting the same error – user2381346 Jan 09 '20 at 12:56
1

Check this: https://stackoverflow.com/questions/33747174/how-to-specify-parameters-on-a-request-using-scrapy – Nestor Jan 09 '20 at 13:32
Share the code you are using to issue the request. – Gallaecio Jan 10 '20 at 11:35

Getting wrong html content when trying to download a webpage using python requests

0 Answers0