Stack Overflow
Stack Overflow

Questions tagged [scrubyt]

11 questions
1
vote
1 answer

Ruby 1.9.2 with scrubyt on Windows

Using scrubyt with Ruby 1.9.2 on Windows, and get the following error when calling Scrubyt::Extractor.define do C:/Ruby192/lib/ruby/gems/1.9.1/gems/activesupport-3.0.9/lib/active_support/dependencies.rb:479:in load_missing_constant':…
tugge
  • 21
  • 2
1
vote
1 answer

How to export scrubyt extractor?

I've written a scrubyt extractor based on the 'learning' technique - that is, specifying the current text on the page and getting it to work out the XPath expressions itself. However, I now want to export the extractor so that it can be used even…
robintw
  • 27,571
  • 51
  • 138
  • 205
1
vote
0 answers

ruby web-scraping tool scrubyt error:- kernel_require.rb:112:in `require': cannot load such file -- jcode (LoadError)

I am running a web scraping script using scrubyt web scraping too. When I run then script I get above error. Below is the full trace:- vishnu-suman@vishnusuman:~/ror$ ruby…
vshnusuman
  • 11
  • 3
1
vote
4 answers

Scrubyt gives 404 Error when clicking link using _details method

This might be a similar problem to my earlier two questions - see here and here but I'm trying to use the _detail command to automatically click the link so I can scrape the details page for each individual event. The code I'm using is: require…
robintw
  • 27,571
  • 51
  • 138
  • 205
1
vote
4 answers

Transitioning from Scrubyt to Nokogiri- Write to XML or Hash?

I'm trying to transition this bit of code from scrubyt to nokogiri, and am stuck trying to write my results to either a hash or xml. In scrubyt it looks like the following: require 'rubygems' require 'scrubyt' result_data =…
ryan
  • 175
  • 3
  • 13
0
votes
1 answer

uninitialized constant Scrubyt::Navigation::Mechanize::WWW (NameError)

I am using the Scrubyt gem, and when I use it, I get this error: /home/bitnami/.rvm/gems/ruby-1.8.7-p352/gems/scrubyt-0.4.06/lib/scrubyt/core/navigation/agents/mechanize.rb:17:in `included': uninitialized constant Scrubyt::Navigation::Mechanize::WWW…
Hanxue
  • 12,243
  • 18
  • 88
  • 130
0
votes
1 answer

Scrubyt wont work with windows

I am running Windows XP. I just installed the latest version of Ruby(1.9) - Hpricot, Mechanize and Scrubyt installed without any issues. I have tried to work with the simplest examples I could find to get scrubyt working. example : require…
DMin
  • 10,049
  • 10
  • 45
  • 65
0
votes
1 answer

How to use Scrubty properly to grab URL from the XML outputted content

I am by no means a master with Ruby and am quite new to Scrubyt. I was just trying out some examples found on there wiki page. The example i was working on was getting the search results returned by Google when you search for 'ruby' and I had the…
Fizz
  • 3,427
  • 4
  • 27
  • 43
0
votes
1 answer

Scrubyt: Using big5 strings in query_field for fill_textfield

Does anyone know of a way to get fill_textfield to accept a big5-encoded string in the query_field? I keep getting an "unterminated string meets end of file" error with this: require 'rubygems' require 'scrubyt' search_data =…
user344615
  • 1
0
votes
3 answers

Scraping hidden HTML (when visible = false) using Hpricot (Ruby on Rails)

I've come across an issue which unfortunately I can't seem to surpass, I'm also just a newborn to Ruby on rails unfortunately hence the number of questions I am attempting to scrape a webpage such as the…
Erika
  • 2,045
  • 7
  • 25
  • 31
0
votes
1 answer

How to get 'Next Page' link with Scrubyt

I'm trying to use Scrubyt to get the details from this page http://www.nuffieldtheatre.co.uk/cn/events/event_listings.php?section=events. I've managed to get the titles and detail URLs from the list, but I can't use next_page to get the scraper to…
robintw
  • 27,571
  • 51
  • 138
  • 205