Possible ways to get page source to get ID or Tag Name

Question

I've been using WebBrowser.Document to get certain element such id, tag, or div...but seem WebBrowser seems too slow to processing many URL address...Any idea?

Answer 1

You could try to include some opensource browsers and include them in the code

http://duckwebbrowser.codeplex.com/

http://xplora.codeplex.com/

Answer 2

I've been using WebBrowser.Document to get certain element such id, tag, or div.

From your question's title and content its not clear from this statement that you need to use a Control which gets, parses and renders HTML.

Is sounds like you just to get and parse your HTML. If this is true you should probably use Html Agility Pack. HAP can get the HTML from a URL and it then parse it. You can then use linq or XPath or the traversal methods to get your tags and divs.

There are plenty of articles on how to use hap like this one How to use HTML Agility pack which includes examples and links.

One of the links includes this example by Farooq Kaiser which gets all the links in a document and add it to `List'

HtmlDocument doc = new HtmlDocument();
doc.Load(url);
HtmlNode root = doc.DocumentNode;

List<string> anchorTags = new List<string>();

foreach (HtmlNode link in root.SelectNodes("//a"))
{
    string att = link.OuterHtml;
    anchorTags.Add(att);
}