Handling 301 and checking if Final URL Exists

Asked Jan 22 '18 at 07:52

Active Jan 22 '18 at 07:52

Viewed 224 times

I'm using the following code to check if a URL is Valid.This works as intended for Most URLs but produces False Positive Results in cases of HTTP 301 Responses.For example the URL http://www.amazon.com has 301 redirect in place. When using this online tool http://www.urlitor.com it shows HTTP Status (final destination) as 200.

I have set request.AllowAutoRedirect = true; in my code.But it does not seem to work as intended.Please advice.

try
            {
                var request = WebRequest.Create(url) as HttpWebRequest;
                request.UserAgent = "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.95 Safari/537.36";
                request.AllowAutoRedirect = true;
                using (var response = request.GetResponse())
                    return (response as HttpWebResponse).StatusCode == HttpStatusCode.OK;
            }
            catch (Exception)
            {
                return false;
            }

asked Jan 22 '18 at 07:52

techno

6,100
16
86
192

1

I tried your code and get 200 for amazon.com – Ray Krungkaew Jan 22 '18 at 07:58
@RawitasKrungkaew Dont know why this happens ... The online service i used also reports 301 – techno Jan 22 '18 at 08:37
can you try to get more info from "tracert"? – Ray Krungkaew Jan 22 '18 at 08:38
@RawitasKrungkaew Yes, I'm currently outside ... I will post it when I get back.Thanks – techno Jan 22 '18 at 08:39
@VanPeer hmm... – techno Jan 22 '18 at 08:39
because it's redirecting http to https! – Van Peer Jan 22 '18 at 08:41
@VanPeer In that case my program would report the link as invalid.How to fix this issue ? – techno Jan 22 '18 at 08:57
@techno for redirects 301/302, write a different logic perhaps before the return – Van Peer Jan 22 '18 at 10:09
@VanPeer What kind of logic... How to find the redirect URL and check again if it's valid ... – techno Jan 22 '18 at 10:24
Let us [continue this discussion in chat](http://chat.stackoverflow.com/rooms/163629/discussion-between-van-peer-and-techno). – Van Peer Jan 22 '18 at 10:29

Handling 301 and checking if Final URL Exists

0 Answers0