Index bloat and zombie pages

Index bloat and zombie pages: find them, then decide

Pages Google crawls but never shows waste crawling and drag down a template. How to find them in your own Search Console data, and what to do with each kind.

Explore the live demo →

5 days free · no card needed · ends on its own

Updated

Index bloat is when a large share of the pages Google crawls and indexes on your site are pages nobody finds in search: thin, duplicate, empty or out-of-date URLs. Zombie pages are those individual pages, indexed or crawlable but with no impressions or clicks for months. To fix it, find them in Search Console grouped by page type, then improve, merge, noindex or remove each group, starting with the templates that produce the most.

Neither term comes from Google. Google’s documentation talks about the same things in its own words: managing your URL inventory, duplicate content, soft 404s and low-value pages. This guide uses Google’s terms where they apply and links to its docs.

What counts as a zombie page

A zombie page is a URL that exists, can be crawled and often is indexed, but earns nothing: no impressions in Search Console over three to six months, no clicks, often no visits from anywhere. Common types:

Why it matters, and when it doesn’t

Google’s crawl budget guide for large sites tells owners to “manage your URL inventory”: consolidate duplicates, return 404 or 410 for removed pages, and fix soft 404s, because those pages “will continue to be crawled, and waste your budget.” On a site with tens of thousands of URLs, every useless URL crawled is a useful one crawled later.

There’s also the site as a whole. Google’s core updates guidance asks owners to check whether “your site overall (not just individual pages)” is helpful. Thousands of thin pages from one template say something about the site.

When it doesn’t matter: a page with zero impressions is not harmful by itself, and there is no index bloat penalty. Most listings on a directory get few or no impressions because visitors reach them through city and category pages. A small site with a few dead pages has nothing to fix. Worry about bloat when one page type is mostly zombies, or when good pages are stuck out of the index.

How to find zombie pages with data

Crawling tools find thin pages; only Search Console tells you which pages Google never shows. The method:

  1. Get the full list of URLs per page type. From your sitemaps, CMS or a crawl. Search Console’s Performance report only lists pages that were shown at least once, so the zero-impression pages are exactly the ones missing from it. You need your own list to see them.
  2. Group URLs into page types with rules. Listings, category-in-city pages, tag pages, parameter URLs, page 2 and later of lists. A regex per type is enough, for example ^/listing/ or [?&]page=\d+.
  3. Pull 90 and 180 days of page data. Performance report, Pages tab. On a large site the table and export are capped, so use the Search Console API or the bulk data export for the full list.
  4. Join and count per page type: URLs, URLs with zero impressions in 90 days, and in 180 days. A page type where most URLs had zero impressions over 90 days is the place to look.
  5. Check indexing for a sample of each type. Run the URL Inspection tool on 20 or 30 URLs per type, or read the Page indexing report’s examples. The share stuck as “Crawled - currently not indexed” tells you how much of the template Google already declined.
  6. Take out pages that are too new or not indexed yet. A page published two months ago, or one Google has only discovered, has zero impressions because Google hasn’t shown it, not because nobody searches for it. Judge those later.

Indexed vs valuable

Put every page type into one of four boxes. Only one of them is bloat.

Shown in GoogleNever shown in 90+ days
IndexedWorking. Keep it.Zombie pages. Improve, merge, noindex or remove.
Not indexedRare; usually a duplicate URL whose canonical is shown insteadIf the page should rank, it’s an indexing problem: see crawled, not indexed. If not, Google already agrees with you.

Improve, merge, noindex or remove: the decision table

ActionUse it whenHowWatch out for
ImproveThe page targets a real search and could answer it: a city page people search for, a listing for an active businessAdd what only that page can have: listings, local details, photos, reviews, a real descriptionRewriting the intro alone rarely changes Google’s mind
MergeTwo pages target the same search, such as two city pages for one place301 redirect the weaker URL to the stronger one and move the useful contentRedirect to a closely related page, not the home page
NoindexVisitors need the page but searchers don’t: thin places awaiting listings, filtered views<meta name="robots" content="noindex"> and remove it from the sitemapGoogle still crawls noindexed pages; the crawl budget guide says noindex doesn’t save crawling
404 or 410The thing is gone: a closed business, a removed listing, a dead tagReturn 404 or 410 and remove internal links to itGoogle treats all 4xx codes except 429 the same way (HTTP status docs); 410 isn’t a faster delete
Block crawlingEndless URL variants you never want crawled: sorts, session IDs, search resultsrobots.txt Disallow rulesOnly after those URLs have dropped out of the index; Google can’t read a noindex on a blocked page. Blocked by robots.txt
Leave itNew pages, pages not indexed yet, page 2+ of lists, listings reached through other pagesNothingZero impressions is the normal state for many useful pages

Noindex has a cost worth knowing: Google keeps requesting those pages. Google’s crawl budget guide says “Don’t use noindex, as Google will still request, but then drop the page” when the goal is saving crawl. For saving crawl, remove the URLs or stop linking to them; for keeping a page out of search while visitors still use it, noindex is right. Excluded by noindex tag covers checking where a noindex comes from.

Index bloat on directory websites

Directories produce bloat by design: every category, place, filter and listing is a template, and templates multiply. The usual sources, and what to do with each:

Empty and thin category-in-city pages

A page for every category in every city, including /plumbers/smallville-tx with no plumbers on it. Set a minimum number of listings (three is a common choice) and noindex or don’t publish pages below it. When the listings arrive, the page goes back in. For filter combinations with no results, Google’s faceted navigation docs say to “return an HTTP 404 status code”.

Expired and closed listings

A business that closed should return 404 or 410. If it was replaced by a similar listing, or most of its searches were for the category in that city, a 301 to the category-in-city page is reasonable. Redirecting hundreds of dead listings to the home page tends to be read as a soft 404.

Tag and attribute pages

“Wheelchair accessible”, “open late”, “family owned”: useful filters, rarely searched pages. Most belong as filters on the category-in-city page, not as indexable pages of their own.

Paginated pages

Page 2, 3 and onward of a city list usually get no impressions, and that’s fine: they exist so Google can reach the listings on them. Keep them crawlable with a canonical to themselves. Pagination SEO covers the details.

Parameter URLs

Sort orders, map views and search results with ?sort=rating or ?q=. Canonical to the clean URL or noindex them, wait until they leave the index, then block the patterns in robots.txt.

Unclaimed listings copied from public data

Thousands of name-address-phone pages are the classic directory zombie, and at scale they match Google’s scaled content abuse policy. Enrich them, noindex them until claimed, or don’t publish them.

Content pruning without losing traffic

Content pruning is the cleanup itself: removing, merging or noindexing pages that don’t earn their place. Done in a hurry it removes pages that were quietly earning. Done carefully:

  1. Export the list per page type with impressions over 90 and 180 days, clicks, and inbound links. Never prune a page with outside links without redirecting it.
  2. Start with one page type, and with the clearest cases: errors, empty pages, exact duplicates.
  3. Write down the date of each change and which URLs it touched, so you can measure it later.
  4. Compare the four weeks before with the weeks after. Expect slow movement; Google has to recrawl the pages first.
  5. Then the next batch.

Google’s core update guidance calls deleting content “a last resort”, for content that can’t be salvaged. Improve first where the page has a reason to exist. Pages slowly losing traffic are a different problem: see content decay. To measure a cleanup the same way you’d measure an update, see core update recovery.

How DirectoryLens finds them

The Thin and unused pages report (under Advanced) does the method above every day, for every page type:

The Quality signals report puts the same problems side by side per page type: pages never shown, thin pages, near-duplicate text, titles that all follow one pattern, and the indexed share. DirectoryLens only recommends; it never changes your site.

Quality signals by page type: pages never shown, thin pages, near-duplicate text, repeated titles and indexed share, each marked Fine, Worth a look or Needs attention.
Quality signals per page type. Here listing pages have a near-duplicate problem and city + category pages are thin. Sample directory from the live demo.

Questions

What is index bloat in SEO?

Index bloat is when many of the pages Google crawls and indexes on a site are thin, duplicate, empty or outdated pages that never appear in search. It wastes crawling on large sites and can weaken how a template or the whole site is judged.

What are zombie pages?

Pages that exist and can be indexed but get no impressions or clicks for months, such as empty category pages, expired listings, tag pages and near-duplicates.

What are zombie sites?

Usually sites, or large sections, that are still online but no longer updated or visited, so most of their pages are zombie pages. The same clean-up applies, at a larger scale.

Is thin content a Google penalty?

Not by itself. Thin pages are usually just not indexed or not shown. A manual action is a separate thing that appears in Search Console’s Manual actions report.

Should I delete pages with no traffic?

Not automatically. Check that the page is old enough and indexed first; new and unindexed pages haven’t had a chance. Then improve, merge, noindex or remove based on whether the page serves a real search.

Noindex or 404: which is better for zombie pages?

Noindex when visitors still need the page but searchers don’t. Return 404 or 410 when the page has no reason to exist; Google treats all 4xx codes except 429 the same way.

Does index bloat affect crawl budget?

On large sites, yes. Google’s crawl budget guide tells large sites to manage their URL inventory because duplicate and soft 404 pages keep getting crawled. Small sites rarely need to worry about it.

Find the zombie pages on your site.

Connect Search Console and see, per page type, which pages Google never shows and what to do with each.

Explore the live demo →

5 days free · no card needed · ends on its own