Downloading web image w/ urlopen/shutil : error exit

Question

I'm trying to download images with shutil/urlopen because of deprecated? I'm not sure if its deprecation, but urlretrieve doesn't download the file, it just creates folder of the image name instead. After looking at other question I saw one that provides this code, but I get an error on this one too.

from urllib2 import urlopen
from shutil import copyfileobj


url = 'http://www.watchcartoononline.com/thumbs/South-Park-Season-14-Episode-11-Coon-2-Hindsight.jpg'
path = 'image.jpg'

with urlopen(url) as in_stream, open(path, 'wb') as out_file:
    copyfileobj(in_stream, out_file)

output

with urlopen(url) as in_stream, open(path, 'wb') as out_file:
AttributeError: addinfourl instance has no attribute '__exit__

Stefano Sanfilippo · Answer 1 · 2013-05-15T20:14:18.520

2

urlopen does not implement a context manager, so you cannot use it in a with block. Here is the bug report.

You could use contextlib.closing to wrap it, although the bug report above mentions some issues with that too.

NOTE: this applies only to Python < 3.2

edited May 15 '13 at 20:14

answered May 15 '13 at 20:07

Stefano Sanfilippo

32,265
7
79
80

score 2 · Accepted Answer · answered May 15 '13 at 20:07

2

Try this:

import urllib
urllib.urlretrieve("http://url/img.jpg", "img.jpg")

answered May 15 '13 at 20:07

elyase

39,479
12
112
119

as I said in the question, urlretrieve won't work because the site im downloading from has its images deprecated – Brandon Nadeau May 15 '13 at 20:10
@Crispy: Are you sure deprecated is the word you're looking for? – Blender May 15 '13 at 20:11
I'm probably wrong with the term, as my terminology in programming isn't very good. – Brandon Nadeau May 15 '13 at 20:16
@Crispy if you need to download the file, use this solution. I'm uncertain on what you mean by deprecated, but `urlretrieve` is almost equivalent to what you are doing there. – Stefano Sanfilippo May 15 '13 at 20:17
Yes, I was trying to use urlretrieve, it works now. I was making a directory of my image name on accident – Brandon Nadeau May 15 '13 at 20:24

score 1 · Answer 3 · answered May 15 '13 at 20:09

urlopen isn't a context manager in Python 2 (I don't know about 3). You have to manually open and close it:

in_stream = urlopen(url)

with open(path, 'wb') as out_file:
    copyfileobj(in_stream, out_file)

in_stream.close()

You can also just use urllib.urlretrieve:

import urllib

urllib.urlretrieve(url, path)

It reads/writes in chunks, which lets you download large files cleanly.

Downloading web image w/ urlopen/shutil : error __exit__

3 Answers3

Downloading web image w/ urlopen/shutil : error exit