Massive bulk whois query

Question

We're making a tool for bulk checking the whois records of domains. Is there any possibility to query as much as 1 million of domains per day without be concerned about the quota? All whois servers seem to have a limit of approximately 100 per day.

I know of two ways: use hundreds of IP addresses or use a paid API.

Is there any other way that you know of?

What is the reason for the bulk querying? Depending on the use (watching dropping domains, doing availability checks, etc.) and the TLDs involved, registries can provide specific tools, sometimes public sometimes reserved to registrars of the relevant registry. — Patrick Mevzek, Jan 03 '18 at 16:19

score 2 · Accepted Answer · answered Jan 23 '14 at 16:04

The short answer is no. Easy to believe, otherwise it would not be such hard business to deal with.

And even with hundreds of IPs, you are not safe. Another route is to get ICANN accredited and then ask for accreditation for every TLDs you want to use. That will give you a large access to the whois details for the TLD zones.

score 0 · Answer 2 · edited Jun 20 '20 at 09:12

An alternative to get "unrestricted" WHOIS data access is to be prepared to pay a lot of money to individual registrars. As ICANN rules dictate:

3.3.6.2 Registrar may charge an annual fee, not to exceed US$10,000, for such bulk access to the data.

3.3.6.1 Registrar shall make a complete electronic copy of the data available at least one (1) time per week for download by third parties who have entered into a bulk access agreement with Registrar.

So to query GoDaddy and the like without restriction, you may well need a hefty sum of cash.

Note that the ICANN rules place (the usual kind of) restrictions of the use of this data so a careful reading is recommended.

And this apply only to registrars under contract with ICANN, so basically in the gTLDs. The OP did not specify the TLDs he is interested with, but it is always good to remember that there is a life outside of `.COM` — Patrick Mevzek, Jan 03 '18 at 16:20

Massive bulk whois query

2 Answers2