0

I am trying to find out the httpstatus of a bunch of urls via ruby Net::Http, but the problem is even the blank pages as well as the parked domains return a status of 200 OK. Is there anyway I can weed out these type of urls?

Abdullah
  • 2,015
  • 2
  • 20
  • 29
krishna sai
  • 185
  • 8

1 Answers1

1

To clarify few points:

  1. HTTP Status will not help to identify if a domain is or not parked. They exist to tell if everything went ok or not.
  2. To track down parked domains, you will need to develop your own approach as a park domain page is just an HTML page...

Few things you can try:

  • Look for css, js or even text in the page with the "park domain" mention. Some keywords you may want to look for: domain available / parked / renewable / etc.
  • test couple of different prefixes for a given domain (domain.com, asds.domain.com, fgffg.domain.com). If they redirect to the same page, it's likely to be a parked domain
  • Identify the structure of parked domain pages for the main registrars. All site having a landing page matching this structure will be parked domains
  • Build a list of DNS used for parked domains. If the domain is managed by one of the DNS in your list, then it is parked.
  • Use a list of parked domain providers (see for some examples, some links may be broken)

sources:

Method to detect a parked page?

Some key phrased for parked domains by Gary Sieling

Stephane Paquet
  • 2,315
  • 27
  • 31