web scraping using cheerio in nodejs?

Question

I am trying web Scraping using cheerio and http in node js

part of html code:

<tr>
    <td id="priceblock_saleprice_lbl" class="a-color-price a-size-base a-text-right a-nowrap">Sale:</td>

    <td class="a-span12">
    <span id="priceblock_saleprice" class="a-size-medium a-color-price"><span class="currencyINR">&nbsp;&nbsp;</span> 585.00</span>

    </td>
</tr>

nodejs code :

var sale_price = '#priceblock_saleprice';
            scraper(sale_price).filter(function(){
            var data_price = scraper(this);
            console.log(data_price.text());
            scraped = scraped + data_price.text()+';';
          });

 this code is giving 585 as output.

but in same:

part of html page:

<tr id="priceblock_ourprice_row">
    <td id="priceblock_ourprice_lbl" class="a-color-secondary a-size-base a-text-right a-nowrap">Price:</td>
    <td class="a-span12">
        <span id="priceblock_ourprice" class="a-size-medium a-color-price"><span class="currencyINR">&nbsp;&nbsp;</span> 329.00</span>
    </td>
</tr>

nodejs code:

var mrp  = '#priceblock_ourprice_lbl';
scraper(mrp).filter(function(){
            var data_mrp = scraper(this);
            console.log(data_mrp.text());
            scraped = scraped + data_mrp.text()+';';
          });

It is not giving an output.

score 0 · Answer 1 · answered Jan 23 '16 at 06:50

0

you are using wrong id... It should be priceblock_ourprice

var mrp  = '#priceblock_ourprice';
scraper(mrp).filter(function(){
   var data_mrp = scraper(this);
   console.log(data_mrp.text());
   scraped = scraped + data_mrp.text()+';';
});

answered Jan 23 '16 at 06:50

Vicky Gonsalves

11,593
2
37
58

score 0 · Answer 2 · edited Jan 27 '16 at 20:24

0

The id used in the 2nd code snippet is pointing to the 1st <td> element , but you need to target the 2nd <td> element, so use "#priceblock_ourprice"

edited Jan 27 '16 at 20:24

Mr Lister

45,515
15
108
150

answered Jan 23 '16 at 06:51

Sourab Reddy

353
2
14

because in the first one the id is correct, it indicates the span which points to your price, also if replacing the id doesn't work try with the id and get its children – Sourab Reddy Jan 23 '16 at 07:11
can you refer some tutorial where i find how to use children and next etc – Shubham Batra Jan 23 '16 at 07:20
did you accomplish the task , or still need assistance ? – Sourab Reddy Jan 26 '16 at 08:51
here is my mail sourab.reddy2k14@gmail.com , add me on hangouts – Sourab Reddy Jan 26 '16 at 11:40

web scraping using cheerio in nodejs?

2 Answers2