Parsing several Internet pages simultaneously

Question

There is a list of (unrelated) Internet pages I'd like to load simultaneously. I wouldn't mind parsing the information itself page after page, but I thought to myself, that if my browser can load two and more pages simultaneously, why shouldn't Perl do that?

I'm afraid I couldn't find anything like that on the Internet, so I am asking you.

Thank you in advance.

Thank you, I will see if something interesting was posted there. Sorry for the duplicate. — Rick, Jul 31 '11 at 20:09

score 0 · Accepted Answer · answered Jul 31 '11 at 19:10

0

Parallel::ForkManager is your friend. Tell it how many you want to do simultaneously and loop through your list.

answered Jul 31 '11 at 19:10

ysth

96,171
6
121
214

That seems to be the solution. I'll have a look. Thank you! – Rick Jul 31 '11 at 20:09

Parsing several Internet pages simultaneously

1 Answers1