Stack Overflow
Stack Overflow

Questions tagged [node.io]

18 questions
6
votes
1 answer

Getting Node.io to work through a proxy

I'm trying to use node.io (web scraping module) through a proxy. I know it has untested support for proxies built in, but I cannot get it to work. Does anyone know how to get it working? Thanks,
rvanrooy
  • 91
  • 4
3
votes
1 answer

Issues with implementing async.parallel in node.io

The code as listed here will give partial output and then an error (self.htmlparser.parseChunk). When using async.series instead of async.parallel, this example works as expected the ping webservice will wait 2 seconds and then output "pong", in…
willortega10
  • 33
  • 3
2
votes
1 answer

node.io issues with built in modules

So I can run a js file like $ node file.js with node.io inside the file doing things. but if i go to the command line and try to type in a built in module like it shows at https://www.npmjs.org/package/node.io $ node.io query…
user1888959
  • 329
  • 2
  • 11
2
votes
1 answer

Node.io not throwing error?

I notice that node.io wasn't throwing any error compare to nodejs, if there's typo. Not sure why. For example: Running this script contains typo of 'Util2' with node. var Util =…
TonyTakeshi
  • 5,869
  • 10
  • 51
  • 72
2
votes
1 answer

Node.io, JSDOM or PhantomJs ? or, YQL- data.html.cssselect?

I need to crawl a particular website to dig out some relevant information. Looks like first I have to search the site to get corresponding URLs which when crawled will give me the detailed information. Let's assume, the search url is…
user644745
  • 5,673
  • 9
  • 54
  • 80
2
votes
1 answer

Using node.io with a web server

I have started this web scraping project backwards by beginning with node.io. I have it working such that: node.io myjob arg1 arg2 Will emit the results in JSON format: { 1 : 'apple', 2 : 'orange', 3 : 'banana' } My goal is to be able…
Allen Liu
  • 3,948
  • 8
  • 35
  • 47
2
votes
1 answer

node.io : when the job is done, do it again

I'm building a scraper with node.io. The page I want to scrape has new content every minute. I would like to run my job again and again every minute. (Ok I could do that with a bash script, but I would like to stay in javascript) This is a basic job…
Laurent Debricon
  • 4,307
  • 2
  • 24
  • 26
1
vote
1 answer

JS/Node:- Selecting a tag using node.io

I am a beginner, and doing an assignment to scrape the content of this page using node.io http://www.nycourts.gov/reporter/3dseries/2013/2013_06966.htm. I want to save the text content which are under < P > tags as a string in a variable. My code…
Akshat
  • 479
  • 4
  • 9
1
vote
3 answers

How to add proxy like Tor when scraping using node.io?

I am using node.io to build a web scraper but during the time to find the way to do it, I've requested so much and this site has blocked me. I don't know how to add a proxy like using Tor to make request to this site.
giaosudau
  • 2,211
  • 6
  • 33
  • 64
0
votes
0 answers

Node Js mysql multiple query issues

I am working on IO project and I am having issue, when I am trying to do multiple mysql queries under one funtionality. When match win Calculations are happening Mysql selects just does not happen and error is being thrown that winner object is…
user3801263
  • 51
  • 6
0
votes
1 answer

How to use node.io for HTML parsing from node.js?

I am trying to use node.io on node.js to parse a HTML page which i have as a string in a variable. I am facing trouble with passing the HTML string to my node.io job as an argument. This is an excerpt of my code at my node file nodeiotest.js: var…
Surender Thakran
  • 3,958
  • 11
  • 47
  • 81
0
votes
0 answers

How do run multiple asynchronous functions in this node code?

I'm pulling text from N urls. First I get the N urls in linksOnPage and then i run a doOnPage function to get the text from each url. When i run code only 1 of the N urls gets processed through the function. I assume it's because the processing…
algorithmicCoder
  • 6,595
  • 20
  • 68
  • 117
0
votes
1 answer

error on running node.io via commandline on windows server 2008

Am getting the following error on running node.io via command line
user2129794
  • 2,388
  • 8
  • 33
  • 51
0
votes
2 answers

Calling .each on one element

I'm using node.io to scrape websites. Currently I'm going through the scraping tutorial. I'm using each with a selector $('selector').each( ... , function () { ... } ); However when the selector selects only one element, I am receiving this…
JuanPablo
  • 23,792
  • 39
  • 118
  • 164
0
votes
1 answer

How to call custom asnyc code to initialize a Node.io Job once (before successive calls to input())?

Just discovered Node.io, gone though the docs, api, etc. and it looks great. However, building my first job exports.job = new nodeio.Job(..), with methods like input, run,output, reduce, complete I'm in need of some kind of initialize() method which…
Geert-Jan
  • 18,623
  • 16
  • 75
  • 137
1
2