Website downloader library

Question

I need to put a little project together for myself, and I need some functionality to download a page for offline viewing. Is there a library that will download a given page and its embedded images, and edit the img tags to reflect the local locations of the images.

I know there are a lot of website downloaders out there, but I cant find something that i can use directly in my code.

I have some basic scripts done in python, so Python is very welcome. but pretty much any language will do.

score 1 · Answer 1 · answered Mar 15 '10 at 14:54

1

You're looking for BeautifulSoup.

answered Mar 15 '10 at 14:54

SLaks

868,454
176
1,908
1,964

score 1 · Answer 2 · answered Mar 15 '10 at 14:59

1

How about python web crawler? http://code.google.com/p/pywebcrawler/

OR, Anemone (ruby)? http://anemone.rubyforge.org/

answered Mar 15 '10 at 14:59

geffchang

3,279
2
32
58

score 1 · Accepted Answer · answered Mar 15 '10 at 15:08

1

Yes, BeautifulSoup + python urllib module

answered Mar 15 '10 at 15:08

Dingo

2,656
1
19
16

score 0 · Answer 4 · answered Dec 01 '11 at 04:03

0

simplest solution I can think of.

wget -p example.com

answered Dec 01 '11 at 04:03

EricR

1,487
2
21
42

Website downloader library

4 Answers4