URL Database

In addition to our real-time, full-path URL classification service, we also provide an offline URL database, which contains millions of domains that we have already classified. For sample free url categorization database, we provide you with a small sample of domains that we categorized here:

Sample of categorized domains (click to download)

This sample includes top 500 most popular domains worldwide.

Limited time offer for our website category databases

Our current database includes categorization (IAB Tier 1 and Tier 2) of 3.5 million most popular domains. You can purchase our offline database here, its price is 999 USD.

When purchasing the database, you also obtain free updates to main database for 6 months.

In addition to this offline database of domains categorized with IAB classifiers, we also offer another offline database of 1.1 million Shopify domains, which were classified using Ecommerce classifier (two tiers). You can find the full list of Tier 1 Ecommerce categories here and Tier 2 Ecommerce categories here.

Use cases of our URL categorization database

Offline database is ideal for those clients that need to have low latency in obtaining categorization of websites and/or want to integrate this data directly to their own applications.

Some of use cases for our url database integration is clients platforms, products and services:
  • an internal system for web content filtering, which prevents employees to use social media, shopping or other non-work related websites.
  • cybersecurity, for blocking access to sensitive categories websites.
  • website directories, for enabling categorizing, filtering and searching of websites by categories.
  • Saas applications/platforms that need categorizations of millions of domains to improve their apps/platforms.

Lists of categories for our URL classification data set

URLs in our IAB offline database are classified using machine learning model that is based on IAB taxonomy. Each domain is classified according to IAB Tier 1 and IAB Tier 2 category. You can find the full list of Tier 1 categories here and Tier 2 categories here.

URLs in our Ecommerce offline database are classified using machine learning model that is based on Ecommerce taxonomy. Each domain is classified according to Ecommerce Tier 1, 2 and 3 category. You can find the full list of Tier 3 categories here.

For informational purposes, we are adding below the chart of Tier 1 categories distribution for a sample of around 800,000 domains from our database:

Chart of Tier 2 categories distribution (showing only top 50) for a sample of domains from our database:

Frequently asked questions (FAQ)

Which payment options are available?

We accept payments with PayPal. Our prices are listed in USD.

What is considered a request?

Any HTTP request to one of our endpoints, either using API or dashboard, counts as a request.

What occurs if I exceed my monthly quota?

If you exceed your monthly quota, the API (or Dashboard) will respond with notification "You have exceeded your usage limit". In this case, you can upgrade your plan or contact us for options on paying additional API credits.

Can I change my plan after sign up?

Yes, you can upgrade or downgrade your plan at any time.

What is your refund policy?

We will refund you for your payments, if you have not used the dashboard yet and have made refund request within 12 hours of your purchase.

Do you classify URLs by domain or actual URL paths?

We do not restrict ourselves to classification by domain only. We classify URLs by actual URL paths.

What languages do you support?

We support all major languages (20+) and can add support for other ones, on request.

Do you offer datasets of categorized websites?

Yes, we offer data sets of categorized websites, including 1+ million Shopify domains categorized in 1000+ e-commerce categories (with email, phone, social media contacts information). Contact us at [email protected]websitecategorizationapi.com for more information.