Spynner is a stateful programmatic web browser module for Python with Javascript/AJAX support based upon the QtWebKit framework.
Homepage: https://github.com/makinacorpus/spynner
Questions tagged [spynner]
70 questions
1
vote
0 answers
if i visit a url with mechanize then why its not counting the ip?
This is my code:
import mechanize
br = Browser()
br.set_handle_robots(False)
br.addheaders = [('User-agent', 'Firefox')]
br.open("http://arn48.5gbfree.com/index.php")
print br.title()
time.sleep(7)
br.close()
I have used all most every possible…
arn48
- 310
- 4
- 12
1
vote
2 answers
Saving Files from a Loop Without Overwrite
Currently my python script (which uses 'Spynner') has a loop which contains:
browser.load(url)
time.sleep(5)
browser.snapshot().save('example.png')
...but the problem is that every time the loop cycles it overwrites the previously stored image with…
Studiumcirclus
- 69
- 4
- 11
1
vote
2 answers
Spynner wrong encoding
I'm trying to download this page - https://itunes.apple.com/ru/app/farm-story/id367107953?mt=8 (looks like this for me in Russia - http://screencloud.net/v/6a7o) via spynner in python - it uses some javascript checking so one does not simply…
scythargon
- 3,363
- 3
- 32
- 62
1
vote
1 answer
some buttons aren't reacting to clicks
I'm having an issue clicking buttons in spynner. This is what I have so far to load the page:
import spynner
browser = spynner.Browser()
browser.load("http://www.google.com")
browser.show()
The links like Advanced Search work fine, but I can't use…
Connor Pearson
- 63,902
- 28
- 145
- 142
1
vote
1 answer
python code not seeing a class variable iniialized in the __init__() function
I am running into a weird error with spynner, though the question is a generic one. Spynner is the stateful web-browser module for python. It works fine when it works but I almost with every run I get a failure saying this --
Traceback (most recent…
user220201
- 4,514
- 6
- 49
- 69
1
vote
0 answers
Python: Simple log-in and filling form
Hi.
I usually don't ask, because I find or solve everything myself. But in this trouble I'm tormented for many hours, even if that is really easy task.
In Python, I need to log in to some social network, add new post, copy link of that new post and…
user32967
- 141
- 1
- 1
- 4
1
vote
0 answers
Spynner or ghost - How to press a javascript generated button with no id or name (Python)
How do I get ghost or spynner to press a button without a name or an ID? I have been playing around with ghost and spynner the last couple of days and I just cant get it to work with these two specific…
user1995290
- 63
- 2
- 6
1
vote
0 answers
How add proxy to Spynner
This code not change browser ip. 2ip.ru show my real ip.
import spynner
def main():
b = spynner.Browser(user_agent='Opera/9.80 (Windows NT 6.1; U; ru) Presto/2.8.131 Version/11.10')
b.set_proxy("91.208.__.__:8080")
…
user1088259
- 345
- 13
- 34
1
vote
3 answers
Add ID to Button in Javascript
I'm currently trying to find a way to add an ID to an html button using a javascript injection. The html is simple and looks like this:
Now, as you can see, it…
Dustin
- 6,207
- 19
- 61
- 93
1
vote
3 answers
download file over https query with python headless browser
I try to do web scraping in python on a website (using spynner and BeautifulSoup).
At some point I want to test a zip file download, triggered by the following html query:
https://mywebsite.com/download?from=2011&to=2012
If explicitly used in a…
RockridgeKid
- 145
- 3
- 11
1
vote
2 answers
Segfault using nativeClickAt() method in spynner module
I'm not sure how to use nativeClickAt() method to click at an arbitrar location.
In the spynner class, the doc said :
"""Click on an arbitrar location of the browser.
@param where: where to click (QPoint)
@param real: if not true coordinates are…
Gilles Quénot
- 173,512
- 41
- 224
- 223
1
vote
1 answer
Javascript and Spynner (Python)
I'm trying to scrape a website and do I need to use Javascript. I am using Python 2.7 and Spynner. This is the script:
RoverDar
- 441
- 2
- 12
- 32
1
vote
2 answers
jQuery/Python - Disable Dialog Boxes
I have a webpage that whenever I leave the page, a dialog box comes up asking if I'd "Really like to leave the page", with a 'Leave' or 'Stay options. This box is created by javascript.
I'm currently using Spynner for Python as the browser tool…
Dustin
- 6,207
- 19
- 61
- 93
1
vote
1 answer
Browser() initialization
So I installed this module according to these steps:
git clone https://github.com/makinacorpus/spynner.git
cd spynner
python setup.py install
And I get this kind of error, and I don't have any clues what could be wrong.
import spynner
browser1 =…
DTailor
- 158
- 1
- 5
1
vote
1 answer
Installing Spynner on Python on Windows XP
I have Python 2.7 running on Windows XP. I am trying to install Spynner as an alternative to Mechanize that supports Javascript. When I run easy_install spynner, I get an error while installing lxml:
Make sure the development packages of libxml2 and…
user1137778
- 1,111
- 3
- 14
- 26