What is may be reason for charles(http snoffer) does not catch htmlUnit requests?

Question

I have test in which I get page (with help of the htmlUnit) and I may print content of that page, i.e. htmlUnit works correct and fine load my page, but I need to see how that page load all resources (css, js and other resources).

My HTTP sniff(charles) does not catch loading of page. What may be wrong in this case?

Answer 1

My http sniff(charles) does not catch loading of page. What is may be wrong in this case?

This may happen when you're trying to sniff on local traffic. See Localhost traffic doesn't appear in Charles for workarounds.

Answer 2

This is desicion final WebClient webClient = new WebClient(BrowserVersion.FIREFOX_10, "myproxyserver", myProxyPort);

Answer 3

HtmlUnit requires his own proxy setup.

1. When using Charles the proxy configuration of reals browsers (IE, FF) will be adapted automatically from Charles. But Charles does not offer this convenience for HtmlUnit.
2. Keep in mind that HtmlUnit does not use the java proxy settings. You have to configure this when starting your WebClient; e.g. new WebClient(BrowserVersion.FIREFOX_31, "localhost", 8888);
3. Like real browsers, you have additional options to configure hosts to bypass. For doing this you can create a new ProxyConfig; addHostsToProxBypass and than us webClient.getOptions.setProxyConfig to activate your new ProxyConfig.
4. And finally there is another option. HtmlUnit internally uses HttpClient. This implies, that you can enable HttpClient wire log (via 'org.apache.http.wire') to see all transferred info in your log.