Stack Overflow
Stack Overflow

Questions tagged [www-mechanize]

WWW::Mechanize is a Perl module for programmatic web browsing, used for automating interaction with websites.

Features include:

  • All HTTP methods
  • High-level hyperlink and HTML form support, without having to parse HTML yourself
  • SSL support
  • Automatic cookies
  • Custom HTTP headers
  • Automatic handling of redirections
  • Proxies
  • HTTP authentication

Mech supports performing a sequence of page fetches including following links and submitting forms. Each fetched page is parsed and its links and forms are extracted. A link or a form can be selected, form fields can be filled and the next page can be fetched. Mech also stores a history of the URLs you've visited, which can be queried and revisited.

See the home page for complete details.

366 questions
0
votes
2 answers

Filling out a basic form perl WWW::Mechanize

Im trying to fill out the 'form' on the twitter search home page (link in the code defined as $url) its very basic a box for what you want to search and a search button. But its giving me a lot of difficulty, I cant seem to get it to work. Here is…
Brett
  • 65
  • 5
0
votes
1 answer

Fill encrypted login/password field ID with Perl's WWW::Mechanize

I would like to view my account balance (online banking) with a Perl script using WWW::Mechanize. The site is Sparkasse Duerenen (online banking) However, the field IDs seem to have a special encryption mechanism. On each new page load the id is…
user3606329
  • 2,405
  • 1
  • 16
  • 28
0
votes
1 answer

How to replace '?' delimiting with white space delimiting in string

I am working with a set of links from WWW::Mechanize and would like to simply print a list of the link names and url's that were retrieved from a page. Oddly, the names, pulled up with $link->name(), are coming back with '?' characters where spaces…
user3396385
  • 186
  • 1
  • 11
0
votes
0 answers

Login Forms for Hotmail Website using Mechanize/Python

I'm learning Mechanize/BeautifulSoup by following the instruction on this site: http://stockrt.github.io/p/handling-html-forms-with-python-mechanize-and-BeautifulSoup/ Instead of writing a login and check mail for Gmail, I want to do the same for…
Kiddo
  • 1,910
  • 8
  • 30
  • 54
0
votes
1 answer

cant locate MozRepl.pm in @INC

I have a Perl script which uses WWW::Mechanize::Firefox which works well before its been converted into Executable file by using PAR::Packager. it shows an error as Can't locate MozRepl.pm in @INC Need some suggestion to solve this issue, Thank…
Balakumar
  • 650
  • 1
  • 12
  • 29
0
votes
1 answer

Perl WWW::Mechanize exits on 503 Service Unavailable

I am using Perl's WWW::Mechanize to send HTTP traffic to a site. It returns 503 Service Unavailable error as a result of the HTTP request sent to the site. The problem is that the script dies after receiving this error. I do not want that to happen…
Neon Flash
  • 3,113
  • 12
  • 58
  • 96
0
votes
2 answers

Downloads in Firefox using Perl WWW::Mechanize::Firefox

I have a list of URLs of pdf files that i want to download, from different sites. In my firefox i have chosen the option to save PDF files directly to a particular folder. My plan was to use WWW::Mechanize::Firefox in perl to download each file (in…
Pawan Samdani
  • 1,594
  • 1
  • 10
  • 11
0
votes
3 answers

Saving groups of commands for later use in perl script

I'm working on my first Perl script here and trying to be as efficient as possible by re-using code instead of having the same code over and over. I've tried a couple different things already to no avail. I'm also trying to avoid having to just…
Brandon
  • 125
  • 1
  • 11
0
votes
1 answer

Cancel Download using WWW::Mechanize in Perl

I have written a Perl script which would check a list of URLs and connect to them by sending a GET request. Now, let's say that one of these URLs has a file which is very big in size, for instance, has a size > 100 MB. When a request is sent to…
Neon Flash
  • 3,113
  • 12
  • 58
  • 96
0
votes
1 answer

WWW::Mechanize follow link can't find link

I have a set of HTML files which are used as an interface for accessing some files on a server. There's a main page which links to various report pages which then have links to files. I'm trying to get the linked files on each page and determine if…
Alex A.
  • 5,466
  • 4
  • 26
  • 56
0
votes
0 answers

perl login and submit with WWW::Mechanize

I have a standard form which logs my users into a separate site.
user3106150
  • 1
  • 4
0
votes
1 answer

Perl WWW::Mechanize - parsing HTML into a basic report

I have a script that downlaods a web page and then parses that down to a list of URLs like this 26165
capser
  • 2,442
  • 5
  • 42
  • 74
0
votes
1 answer

Don't understand how to use WWW::Mechanize with LWP::Protocol::AnyEvent::http

So I've been having a difficult time with my foray into event driven programming. Most of it due to still thinking sequentially but I'm having a hard time understanding how anyone synchronizes their code when using LWP::Protocol::AnyEvent::http and…
mikew
  • 912
  • 2
  • 11
  • 22
0
votes
3 answers

What is returned if find_link can't find the link?

In perl, I use WWW::Mechanize->find_link(text=>'my_text'); My question is what is returned if the link is not found. My purpose is to check whether a link exist then Mechanize::follow_link();; Many thanks.
novo
  • 356
  • 1
  • 6
  • 17
0
votes
1 answer

Is the only way to disconnect WWW::Mechanize::Firefox from mozrepl destruction of the objects?

As the title says I'm trying to make a perl daemon which, being long-running I want to be sane on resource usage. All the examples / documentation I've seen doesn't seem to mention a way to disconnect a session. The best documentation on the topic I…
pacifist
  • 712
  • 4
  • 13
1 2 3
…
24 25