Getting content from web page, that is populated through a javascript

Question

I'm trying to parse a web page using Html Agility Pack, what I have understod from my attempts is that the web page is "populated" using a javascript. When I load the page using

HtmlDocument doc = web.Load(linkToPage);

I get an empty page. The page is a sub page so to say, and I'm using the original page to scrap the links to these sub pages (it works for the main page since this one does not used javascript to populate the page, I assume).

Is there a way to parse a web page that populates through javascript, or is there a better tool for this?

related question : [Html-Agility-Pack not loading the page with full content?](http://stackoverflow.com/questions/18955793/html-agility-pack-not-loading-the-page-with-full-content) — har07, Aug 10 '14 at 13:13
Yes it is related but there has got to be another way than using a tool used, intentionally, for testing? — erikduvet, Aug 10 '14 at 15:19

score -1 · Answer 1 · answered Aug 10 '14 at 12:35

-1

See this if you wish to use JAVA, I worked with FTL and also JSrender, both were pretty cool

answered Aug 10 '14 at 12:35

Jayanth

329
4
15

Thanks but the intention is to use .net. – erikduvet Aug 10 '14 at 15:16

Getting content from web page, that is populated through a javascript

1 Answers1