0

I'm trying to use urllib2 to open a web page using personal digital certificate.

Actually by command line mode, using "curl -k", is possible to open this resource.

So my question is:

1) Is possible to open this web page using urllib2 bypassing the use of personal digital certificate?

2) If the option (1) is not possible, how can access this resource using urllib2 and "personal digital certificate".

P.S. the code I'm trying to use in order to access this resource is the following:


class HTTPSClientAuthHandler(urllib2.HTTPSHandler):
    def init(self, key, cert):
        urllib2.HTTPSHandler.init(self)
        self.key = key
        self.cert = cert


def https_open(self, req):
    return self.do_open(self.getConnection, req)

def getConnection(self, host, timeout=300):
    return httplib.HTTPSConnection(host, key_file=self.key, cert_file=self.cert)




opener = urllib2.build_opener(HTTPSClientAuthHandler('/Users/antonio/.globus/userkey.pem','/Users/antonio/.globus/usercert.pem') )
response = opener.open("https://........")
print response.read()

The error I got is: 


Traceback (most recent call last):
  File "HTTPSClientAuthHandler.py", line 18, in 
    response = opener.open("https://cmsweb.cern.ch/tier0/express_config")
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib2.py", line 389, in open
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib2.py", line 502, in http_response
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib2.py", line 427, in error
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib2.py", line 361, in _call_chain
  File "/System/Library/Frameworks/Python.framework/Versions/2.6/lib/python2.6/urllib2.py", line 510, in http_error_default
urllib2.HTTPError: HTTP Error 500: Internal Server Error
antonjs
  • 14,060
  • 14
  • 65
  • 91
  • Dude, it's urllib2 not urlib2 ;) – plaes Apr 11 '11 at 07:31
  • This looks like the http server is failing, somehow. Do you have access to the server logs? –  Apr 11 '11 at 07:32
  • Actually I don't have access to server logs. By the way, using a web browser with a valid personal digital certificate, I can access it using Firefox 4. – antonjs Apr 11 '11 at 09:41
  • As Thouis said, there is a problem with http server and the code I'm using to access the server resource is right. By the way, it will be great to have this command "curl -k " converted into PyCurl. Any ideas? – antonjs Apr 11 '11 at 14:19

3 Answers3

1

finally I solved the problem.

I did access https service bypassing the use of personal digital certificate simply in this way:

txdata = None
txheaders = {
    'Accept': 'text/html'
}
req = urllib2.Request(url, txdata, txheaders)

Any ideas why the headers 'Accept': 'text/html' allows connections to SSL sites without certs?

Maybe it depends by the server settings.

antonjs
  • 14,060
  • 14
  • 65
  • 91
0

What you have worked fine for me with one exception. The init must have the double __ before and after since it is a special function that initializes the class. This will always be the same function in every class:

class HTTPSClientAuthHandler(urllib2.HTTPSHandler): def _init_(self, key, cert): urllib2.HTTPSHandler._init_(self) self.key = key self.cert = cert

Iceburge
  • 1
0

I'm not familiar with pycurl, but here are some links that might help:

problem sending an HTTPGET with PyCurl (note in particular the suggestion to use --libcurl example.c to get the libcurl implementation)

http://code.google.com/p/friendlycurl/

http://www.phpfreaks.com/forums/index.php?topic=270222.0

Community
  • 1
  • 1