Questions tagged [twill]

twill is an open source language written in Python that allows browsing the Web from a command line interface. twill supports most standard Web features (like forms and cookies) and automated Web testing. With its latest release in 2007, twill is considered outdated today.

Twill is a web browsing language for automating web browsing from a command line interface.

The latest release of twill is twill 0.9, released Thursday, December 27th, 2007.

The tool is outdated. There are several alternatives, like selenium or mechanize.

83 questions
3
votes
0 answers

Recording Foscam IP camera video using Python (Now Trying to fill in password at IP address using twill)

I am currently trying to record video from a Foscam 8910W IP Camera using Python. I started by consulting with threads like these: How to parse mjpeg http stream from ip camera? and I got through the first few commands Then I realized that since…
user2708060
  • 439
  • 4
  • 6
3
votes
2 answers

Using Regular Expression with Twill

I'm currently using urllib2 and BeautifulSoup to open and parse html data. However I've ran into a problem with a site that uses javascript to load the images after the page has been rendered (I'm trying to find the image source for a certain image…
rolling stone
  • 12,668
  • 9
  • 45
  • 63
2
votes
2 answers

How to view current url using twill?

I intend to use twill to fill out a form on one page, hit the submit button, and then use BeautifulSoup to parse the resulting page. How can I feed BeautifulSoup the HTML page? I assume I have to read the current url, but I do not know how to…
purpleladydragons
  • 1,305
  • 3
  • 12
  • 28
2
votes
2 answers

Python module "twill"--HTML flood during variable assignment

I'm making a simple command line program for gathering and parsing information from websites (pretty generic) using the Twill module in Python. I want to assign the HTML output to a variable using Twill's show() command to run the page through my…
2
votes
1 answer

Twill CMS (Laravel): How to set up Repeater blocks? Repeaters display at wrong place

I wanted to use the repeater blocks of twill for my new project, set it up like in the documentation but it displays outside the section area just right beneath it in the body. Can´t edit it in the cms. How do I declare the right variable in the…
Mitchelito
  • 41
  • 3
2
votes
2 answers

retrieve application/json document with twill/mechanize in authenticated session

I need to retrieve a document with MIME type "application/json". I'm using twill to log in to a site and when I attempt to go to the URL pointing to the JSON document and show it, I get this message: 'The HTTP header field "Accept" with value…
Tyler
  • 4,679
  • 12
  • 41
  • 60
2
votes
1 answer

Twill - how do choose multiple selects with same name

I am using twill and python to write a web crawler. showforms() returns Form name=customRatesForm (#1) ## ## __Name__________________ __Type___ __ID________ __Value__________________ 10 originState hidden originState TN 11 …
Chris
  • 2,619
  • 6
  • 27
  • 34
2
votes
1 answer

Why does Python (with twill) not want to log me in to a Yahoo mail box here?

Can anyone, please, explain to me what's going on here. It seems that Python refuses to work (with twill) when I am trying to log in to my mailbox on Yahoo: Python 2.5.4 (r254:67916, Dec 23 2008, 15:10:54) [MSC v.1310 32 bit (Intel)] on win32 Type…
brilliant
  • 2,805
  • 11
  • 39
  • 57
2
votes
1 answer

django-nose testrunner doesn't use --with-django option

When running nosetests, django-nose runner doesn't supply --with-django option to nosetests, so my nose + Twill tests fail when trying to access URLs: ./manage.py test ... raise BrowserStateError("cannot go to '%s'" % (url,)) BrowserStateError:…
Dmitry Gladkov
  • 1,325
  • 1
  • 12
  • 24
2
votes
0 answers

Twill : requests.exceptions.MissingSchema

I'm working on a simple web scraper for a page which requires users to be logged in to see its content. from twill.commands import * go("https://website.com/user") fv("1","edit-name","NICKNAME") fv("1","edit-pass","NICKNAME") submit('0') That is my…
2
votes
1 answer

Using Twill's submit function when website's submit button is localized(Python)

I am trying to pull information from a website, and doing so requires me to log into it. All goes well until I reach the submit button: MissingSchema: Invalid URL u'/index.php?r=site/login': No schema supplied. Perhaps you meant…
Ben Morris
  • 606
  • 5
  • 24
2
votes
1 answer

Parse Error when using showforms() command with Twill

My idea for this program is to have a simple (supposedly) script that monitors what time it is, and when it's in a certain time range (for example 6am to 7pm) it navigates to opendns.com and blocks certain websites using the web content filtering…
2
votes
1 answer

Python 2.7 using twill, saving downloaded file properly

import twill twill.commands.agent("Mozilla/5.0 (Windows NT 6.2; WOW64; rv:15.0) Gecko/20120910144328 Firefox/15.0.2") twill.commands.go('loginpage...') twill.commands.fv("1", "txtUserName", "username") twill.commands.fv("1", "txtPassword",…
iarp
  • 546
  • 1
  • 9
  • 20
1
vote
2 answers

How to configure the python Twill/Mechanize library to acces Facebook

I'm trying to run some automated functional tests using python and Twill. The tests verify that my application's OAuth login and connection endpoints work properly. Luckily Twitter doesn't mind that Twill/Mechanize is accessing twitter.com.…
Matt W
  • 6,078
  • 3
  • 32
  • 40
1
vote
0 answers

Why do I get "No connection adapters were found for 'value'" in Python Twill

I'm trying to automate a process for my classmates, with a python script that downloads from my university servers the marks that we get through the download of a PDF. Unfortunately, it turns out that I get an error when running this code : from…
Roux
  • 69
  • 1
  • 8