Bulk index checker

A bulk index checker that asks Google directly

Check thousands of your URLs against Google’s own URL Inspection API. See which pages are indexed, which are stuck, and why, grouped by page type.

Explore the live demo →

5 days free · no card needed · ends on its own

Updated

How most index checkers work, and why that falls short

Most free bulk index checkers run a site: or info: style search for each URL and report whether something came back. That works for a quick spot check on a few URLs, including ones on sites you do not own. It is also a guess: search results are not a complete list of the index, they vary by location and data center, and large runs get rate-limited or blocked.

Google has an official answer for your own pages: the URL Inspection API in Search Console. For each URL it returns the same verdict you see in Search Console’s URL Inspection tool: whether the page is indexed, its coverage state, when Google last crawled it, the canonical Google chose next to the one you declared, the sitemaps that list it and the pages that link to it. DirectoryLens runs that API in bulk.

What you get for each URL

ResultWhat it means
IndexedGoogle has the page in its index and can show it.
Discovered, not indexedGoogle knows the URL but has not crawled it yet. Usually crawl priority or weak internal links. Guide.
Crawled, not indexedGoogle read the page and chose not to index it. Usually thin or near-duplicate content. Guide.
Unknown to GoogleGoogle has no record of the URL: no link or sitemap has led it there.
Other not indexedNoindex, redirect, 404, blocked by robots.txt, or a canonical pointing elsewhere.

Each URL also gets flags that explain why it might be stuck: Google picked another canonical, Weak internal links (two or fewer pages link to it), Not in a sitemap, and Not crawled in 60 days.

Check thousands of URLs, grouped the way your site is built

Start a run from a pasted list of URLs (up to 5,000), a whole page type, a sitemap, every URL whose last result was not indexed, or every URL not checked in a given number of days. Runs work in the background, skip URLs checked in the last 24 hours unless you say otherwise, and pick up the next day when the daily quota runs out.

Every day DirectoryLens also inspects a sample of each page type on its own, so you see an estimate of how much of each template Google has indexed, with a confidence range, without checking every URL. Pages you mark as priority, and paid or featured listings on a directory, are checked daily and raise an alert when they stay out of the index too long.

Google indexing summary for a sample directory: estimated share indexed for listing, guide, city and category pages, with coverage states, then priority URLs not indexed with the days each has been out.
Index estimates by page type, then priority pages that are not indexed and for how long. Sample directory from the live demo.

Know which pages to request first

Google’s API can check indexing but cannot request it, and the Request indexing button in Search Console allows only about 10 to 12 requests a day. So the order matters. DirectoryLens ranks every not-indexed URL by how much its page type is worth and how stuck it is, links each one straight to Search Console, and when you mark a URL as requested it tracks how many days Google takes to index it.

Request indexing queue: not-indexed URLs ranked best first with their state, referring URLs, flags such as weak internal links, and an Open in Search Console button.
The request queue: best URLs first, why each is stuck, and a direct link into Search Console.

Limits, honestly

Index checker comparison

Search-result checkersDirectoryLens
SourceGoogle search results, scrapedGoogle’s URL Inspection API
Works onAny URLSites you verified in Search Console
Tells you whyNoCoverage state, canonical, last crawl, internal links, sitemaps
VolumeVaries; limited by blockingUp to 1,800 a day per site, runs of up to 5,000
Over timeOne-offDaily sample per page type, history per URL, alerts

Questions

How do I check if many pages are indexed by Google?

For your own site, use Google’s URL Inspection API through Search Console, which reports the real index status per URL. DirectoryLens runs it in bulk: paste up to 5,000 URLs, pick a page type or a sitemap, and it checks them within Google’s daily quota.

How many URLs can I check per day?

Google allows 2,000 URL inspections per site per day. DirectoryLens uses up to 1,800, so larger runs continue the next day automatically.

Can I check URLs on a site I don’t own?

No. The URL Inspection API only answers for sites you have verified in Search Console. To spot-check someone else’s pages, a site: search is the only option.

Does DirectoryLens request indexing for me?

No. Google’s API cannot request indexing for normal pages. DirectoryLens ranks which pages to request first and links each one to Search Console, where you click Request indexing.

Is Google’s site: search accurate for checking indexing?

It is a rough guide. Search results are not a full list of the index and change by location and over time. The URL Inspection API gives Google’s actual verdict for each URL.

How much does it cost?

Index checking is part of every DirectoryLens plan, from $29.99 a month, with a free 5-day trial (no card needed). See pricing.

Find out which of your pages Google really has.

Connect Search Console and start a run on your biggest page type. Results come in within minutes.

Explore the live demo →

5 days free · no card needed · ends on its own