How to find div inside another div using HtmlUnit?

Question

I am working on some project where in i need scrap some information from different website.I am using HtmlUnit for this purpose,But problem is i am unable to traverse through the elements on one page.

Example:

  <div id="some_id">

      <div>

        <div>

           <div>

              ......
                       many divs in between
              ......

               <div id="my_target_div"> some information </div>

                ........

                ........

                 </div>

Now how get div with id my_target_div and information inside that div

what have you already tried? – achudars Aug 07 '13 at 12:12 — achudars, Aug 07 '13 at 12:12

score 5 · Answer 1 · answered Aug 07 '13 at 12:18

5

Use getHtmlElementById.

Check documentation.

An example:

@Test
public void getElements() throws Exception {
    final WebClient webClient = new WebClient();

    final HtmlPage page = webClient.getPage("http://some_url");
    final HtmlDivision div = page.getHtmlElementById("my_target_div");

    webClient.closeAllWindows();
}

Source.

answered Aug 07 '13 at 12:18

achudars

1,486
15
25

Thanks for the answer but, i have already solved it myself. Anyway i am up voting you for spending your quality time in answering this question, which may help others who have similar problem. – Kishan_KP Aug 07 '13 at 12:36

score 2 · Answer 2 · answered Nov 16 '16 at 06:46

2

WebClient webClient = new WebClient();
        HtmlPage page;
  HtmlElement div= (HtmlElement) page2.getFirstByXPath("//div[@id='my_target_div']");

This will solve your problem.

answered Nov 16 '16 at 06:46

Hemin

712
1
14
29

How to find div inside another div using HtmlUnit?

2 Answers2