0

I have a list of the top 1000 websites. I want to access each website in a browser (render all images, execute all javascript, etc.) and log the load time.

Any suggestions as to the best way of doing this?

I thought about using a headless browser, but not sure if this is the best way.

I know Firebug has load times, but I have 1,000 websites and this process would be very tedious. Also, I have a couple of parameters to tweak so need to go through the 1,000 websites a couple of times.

tshepang
  • 12,111
  • 21
  • 91
  • 136
Eamorr
  • 9,872
  • 34
  • 125
  • 209

1 Answers1

2

If I were doing this I'd write a short perl script using WWW::Mechanize::Firefox module to request the pages, logging the page load times to a file.

http://metacpan.org/pod/WWW::Mechanize::Firefox

szabgab
  • 6,202
  • 11
  • 50
  • 64
Raoul
  • 3,849
  • 3
  • 24
  • 30
  • Great! Never came across that one. I even searched CPAN! I'd much prefer to use Perl than use HtmlUnit (in Java). – Eamorr Jul 04 '11 at 09:23
  • Everything's working now. Only took me about 30 minutes to get script up-and-running... – Eamorr Jul 04 '11 at 10:39
  • @Raoul - Can you share the script, if that is not too much to ask for while I go through the link in your answer ? – arka.b Sep 21 '15 at 10:06