Stack Overflow
Stack Overflow

Questions tagged [ghost.py]

Ghost is a webkit client written in Python, it provides people making a Python based application to access web applications.

Ghost

Ghost is a webkit client coded in and written by jeanphix,

usage

from ghost import Ghost
ghost = Ghost()
page, extra_resources = ghost.open("http://jeanphi.fr")

Resources

68 questions
1
vote
1 answer

Screen scraping dynamic webpage in python with Ghost.py

ghost = Ghost() page, rcs = ghost.open(https://soundcloud.com/passionpit/sets/favorites) page, rcs = ghost.wait_for_page_loaded() songs = ghost.evaluate("document.getElementsByClassName('soundTitle__title');") print songs I am attempting to use the…
walshie4
  • 1,396
  • 2
  • 11
  • 16
1
vote
1 answer

Not able to install Ghost.py

I want to try Ghost.py. its documentation says that installation require PyQt or PySide. I have installed pyqt4-dev-tools using command apt-get install pyqt4-dev-tools on my Kubuntu 13.10. I am getting error root@alok:~# pip install Ghost.py …
Alok
  • 7,734
  • 8
  • 55
  • 100
1
vote
0 answers

How to get the response time when open a dynamic web page by using python (Cannot use selenium)

right now I am working on one project "get the response time when open a dynamic web page by using python". The requirement is that I cannot use selenium. The web page I open has lots of javascripts and AJAX calls. So right now I use ghost.py to…
user3381397
  • 11
  • 1
1
vote
4 answers

Ghost.py and proxy

Is anyone able to explain how to make Ghost.py work with a proxy? I've checked out the code but it's not there.
iChux
  • 2,266
  • 22
  • 37
1
vote
1 answer

Error using ghost.py to scrape a page

I'm trying to use ghost.py to scrape a website using a script that works on my local machine: import pdb from ghost import Ghost from urlparse import urlparse import urllib2 ... def scrape(self, request): pdb.set_trace() page_url =…
YPCrumble
  • 26,610
  • 23
  • 107
  • 172
1
vote
0 answers

Spynner or ghost - How to press a javascript generated button with no id or name (Python)

How do I get ghost or spynner to press a button without a name or an ID? I have been playing around with ghost and spynner the last couple of days and I just cant get it to work with these two specific…
user1995290
  • 63
  • 2
  • 6
1
vote
0 answers

Crawling web by Simulating click using Ghost.py

The website i want to crawl have multiple pages which are dynamically loaded and i want to simulate click (without opening browsers as selenium does) and so i m using Ghost.py. Here is the simple program from ghost import Ghost import time ghost =…
Vindhya G
  • 1,339
  • 2
  • 21
  • 46
1
vote
1 answer

Accessing content of the web page after simulating click using ghost.py

I am simulating click of a button using Ghost.py.But unable to figure out how to get the content which is loaded after clicking the button. from ghost import Ghost ghost = Ghost(wait_timeout=40) page, extra_resources =…
Vindhya G
  • 1,339
  • 2
  • 21
  • 46
1
vote
4 answers

screen scraping using Ghost.py

Here is the simple program which does not work from ghost import Ghost ghost = Ghost(wait_timeout=40) page, extra_resources =…
Vindhya G
  • 1,339
  • 2
  • 21
  • 46
1
vote
1 answer

Using ghost.py to change the value of a select dropdown and retrieve values after update

Default action for the webpage is to list results by relevance but has a dropdown box that can be used to change the results table sort order. I would like to use Ghost.py to mimic the action of changing the dropdown box from relevance to post…
user1347648
  • 65
  • 2
  • 12
1
vote
1 answer

How do I open a Ghost local html file in which I want to run javascript?

How do I open a Ghost local html file in which I want to run javascript? I only know how to do it from a tutorial from the internet. from ghost import Ghost ghost = Ghost() page, extra_resources = ghost.open(url)
agrynchuk
  • 4,597
  • 3
  • 17
  • 17
0
votes
0 answers

Cannot install Pyside or PyQt4 to use ghost.py

I am trying to use ghost.py which requires PySide or PyQt4. I tried to install PySide with pip. PySide Installation Error Then when I try to install PyQt4 instead, I get this result: PyQt4 Installation Error I checked other questions on…
Ert51
  • 19
  • 5
0
votes
1 answer

Web-scraping a password protected website using Ghost.py

I'm trying to get the HTML content of a password protected site using Ghost.py. The web server I have to access, has the following HTML code (I cut it just to the important parts): URL: http://192.168.1.60/PAGE.htm
Ñhosko
  • 723
  • 2
  • 8
  • 25
0
votes
1 answer

Use python variables inside Ghost.py script

I'm trying to fill a form several times with Ghost.py, the values I need to input to the form are inside a list, the program looks like this: inputData = ["input1", "input2", "andSoOn"] ghost = Ghost() with ghost.start(): session =…
user3530429
  • 3
  • 1
0
votes
1 answer

Make ghost.py's QWebView react to user actions (attach an event loop thread?)

I'm opening a web page in ghost.py in IPython interactive console and showing its window to see the effect of my actions: import ghost s=ghost.Ghost().start() s.open('https://google.com') s.show() The window shows the page's content but doesn't do…
ivan_pozdeev
  • 33,874
  • 19
  • 107
  • 152
1 2
3
4 5