Url filtering

Question

I'm looking for way to verify whether a site is categorized in any url filtering databases. Does somebody know such database with free API?

possible duplicate of [Programmatic Link Scanning](http://stackoverflow.com/questions/381747/programmatic-link-scanning) — Joshua, May 11 '12 at 19:17

score 3 · Accepted Answer · answered May 19 '09 at 20:15

3

Check out the Google Safe Browsing API. It allows you to check URLs against Google's blacklists of suspected phishing and malware pages. Here is the developer guide.

answered May 19 '09 at 20:15

Ayman Hourieh

132,184
23
144
116

score 2 · Answer 2 · answered Sep 28 '09 at 22:14

BrightCloud just released an API for URL classification that is more comprehensive than the Google Safe Browsing API - it does cost money but it's cheap. In addition to categories like "Adult" and "Gambling" it also has security oriented categories like phishing, malware, and spam.

The full list of categories is here: http://brightcloud.com/masterdburllist.asp

score 1 · Answer 3 · answered May 16 '13 at 14:39

Checkout the SimilarWeb API. The API will perform domain level classification and is based on SimilarSite’s content analysis and machine learning.

Link to the API: https://developer.similarweb.com/

Disclosure, I’m affiliated with SimilarGroup, the creator of SimilarWeb.

Url filtering

3 Answers3