PERL WWW::Scripter not work, not return content

Question

Usualy I make scrapers in Ruby, but decide to do in Perl. And when I run my script I see number of url which opens very very very slow. And I thank, maybe its redirect problem? Or maybe its JS urls thats why problem. And I decide to use some module which can open JS web sites. So I look to cpan doc, take code and try to run it. Nothing no content. What I do wrong? Please correct me. Or maybe advice me smth. I try to use Selenium but have problems with installation, see error when I try to run selenium in Linux console.

use WWW::Scripter;

  $w = new WWW::Scripter;  
  $w->use_plugin('JavaScript');

   open(FH, "<links.csv");
   while (<FH>) {
    $url =  $_;

    if ( $url !~ /http(s)/ ) {
        $url = "http://".$url;
    }

    $w->get(url);
    $html = $w->content;

    print "=======\n";
    print Dupmper $w->content;
    print "=======\n";
}

Answer 1

$w->get(url);

It's not url, it's $url. Use strict and warnings.

Answer 2

Firstly, you should always use strict and use warnings in your Perl programs. They would have picked up your typo.

Secondly, you should have checked the return code from get() as that would have shown you there was something wrong.

Thirdly, there are few outdated Perl programming practices in your code.

# Always use these
use strict;
use warnings;

use WWW::Scripter;
# Added this
use Data::Dumper;

# Don't use indirect object notation.
# Declare variable
my $w = WWW::Scripter->new;
$w->use_plugin('JavaScript');

# Three-arg version of open()
# Lexical filehandle
# Check result of open() and die on failure
open(my $in_fh, '<', 'links.csv') or die $!;

while (<$in_fh>) {
  # Fixed regex.
  # 1/ Anchored at start of string
  # 2/ Made 's' optional (and non-captured)
  if ( ! /^https?/ ) {
    # Use string interpolation
    $url = "http://$url";
  }

  # Capture HTTP response
  # Use '$url', not 'url'
  my $resp = $w->get($url);

  # Check request is successful
  unless ($resp->is_success) {
    # If not, warn and die
    warn $resp->status_line;
    next;
  }

  print "=======\n";
  print Dumper $w->content;
  print "=======\n";
}