How do I grab elements having different classes using cheerio?

Question

I am scraping bing search results using node and cheerio. I need to grab all the href values from two lists that have different IDs.

How can I grab all the tags from both these lists in one statement? I tried but it didn't work.
From the first list, I do not want the li tags with the class "b_pag". How can I write a selector for it? Like a Not condition or something.

$("a", ["#b_content", "#b_context"]).each((index, element) => { const href = $(element).attr("href"); links.push(href); });

Refer to the attached screenshot for the html.html

Update2 : I was wanting to ignore the whole <li class="b_pag"> tag, but the solutions I found here and elsewhere ignored just that tag. Any other <li> tag under it, which has any other or no class, does not get ignored.

I found a way around it. I could grab the <li> tags that have other class names. Check out the html here. I am thinking of using four different selectors for the first four classes. Like $(.b_algo) or $(.b_ans). But how can I grab the other two <li> tags that have multiple classes associated with it? I could not get a clear idea from the cheerio docs. Hope I am clear enough for you guys! Something like $(.b_ans b_mop) didn't work. Nor did $("li[class=b_ans b_mop").

does all the li hold a tag? check out my work around. https://jsfiddle.net/apmnky0b/ — Zaza, Feb 27 '19 at 06:07
I saw your code. It gets all the a tags under ol with b_content as class. I want to ignore the li tag that has "b_pag" as class. See the last li in the screenshot. That is what I want to ignore. All the other li tags are needed. — Rohit, Feb 27 '19 at 06:28

Dipesh Lohani · Answer 1 · 2019-02-27T06:29:34.140

3

Try this,

$("#b_content", "#b_context").each(function(i, elem) {
        array[i] = {
             a: $(this).find("a").attr("href")
         };
      });`

To select "li" except class "b_pag" use, li:not( .b_pag )

edited Feb 27 '19 at 06:29

answered Feb 27 '19 at 06:24

Dipesh Lohani

306
3
11

$("#b_content", "b_context") will find b_content under b_context, which doesn't exist, so I get an empty result. the "li:not(.b_pag)" is what I was looking for. Could you tell me where exactly would you write it in the code? I can grab the
– Rohit Feb 27 '19 at 06:40
1

Here you go, $("#b_results").find("li:not(.b_pag)").each((i, el) => { // something }); – Dipesh Lohani Feb 27 '19 at 10:48
I found a way around that problem. I have another doubt though. how can I grab an element like this -
? does this mean that this element is associated with 3 classes (a, b and c)?

Rohit

Mar 05 '19 at 05:59

1

Yes ! Similar to some bootstrap classes .. – Dipesh Lohani Mar 05 '19 at 10:01

if there is a

and another

and I do something like `$(".a")`, then it grabs both these elements. is there a way to pass multiple classes in one selector? so that I can grab only the second

using something like `$("a b") maybe.

– Rohit Mar 05 '19 at 11:16

score 1 · Answer 2 · answered Feb 27 '19 at 06:56

1

Try this one

$(".b_content li[class!='b_pag']").find("a").each((index, element) => { const href = $(element).attr("href"); console.log(href); });

if you want to ignore the class use the attribute selector with respective tag like this li[class!='b_pag']

answered Feb 27 '19 at 06:56

Zaza

406
9
18

The != does work and the li:not() as Dipesh Lohani said above also ignores the
and
tags under
. They are not being ignored by this statement. Is there any way to ignore the entire
tag even if there are other
tags under it with some other class? for example - `

Rohit

Feb 28 '19 at 06:00

score 1 · Answer 3 · answered Mar 01 '19 at 08:59

1

Try using Bing Web Search API instead: https://azure.microsoft.com/en-us/services/cognitive-services/bing-web-search-api/

It is the legal and better way to get Bing Search Results. You can sign up for free tier of this API, if you do not have lot of searches to do. You can also use the Azure free credit, that you receive when you join Azure.

answered Mar 01 '19 at 08:59

saurabh shrivastava

64
6

Thanks bro. I will surely check it out :) – Rohit Mar 01 '19 at 09:59

How do I grab elements having different classes using cheerio?

3 Answers3