Retrieve the source code of a url using pycurl and a port number?

Question

Is there any way to retrieve the url source code and store it in a string ,provided that a particular port is defined in pycurl module so that it works for a proxy network. platform - ubuntu or any other linux distro

show us what you have tried so far? – Vaibhav Mule May 23 '15 at 09:46 — Vaibhav Mule, May 23 '15 at 09:46
For most proxies, you need a proxy host name *and* a port. – tripleee May 23 '15 at 10:27 — tripleee, May 23 '15 at 10:27

score 0 · Accepted Answer · answered May 23 '15 at 09:55

Use this code to get source of url

from StringIO import StringIO    
import pycurl

url = 'http://www.google.com/'

storage = StringIO()
c = pycurl.Curl()
c.setopt(c.URL, url)
c.setopt(c.WRITEFUNCTION, storage.write)
c.perform()
c.close()
content = storage.getvalue()
print content

Retrieve the source code of a url using pycurl and a port number?

1 Answers1