Programmatic SEO

Programmatic SEO: templates at scale that Google keeps

What makes thousands of generated pages worth indexing, with real examples, the data and tools behind them, and how to measure and roll them out by template.

Explore the live demo →

5 days free · no card needed · ends on its own

Updated

Programmatic SEO is publishing many pages from one template and a dataset, each page targeting a search pattern such as “[category] in [city]” or “[app] + [app] integration”. It works when every page carries data that is unique and useful for that search, and fails, sometimes breaking Google’s scaled content abuse policy, when the template is the only thing on the page.

A directory is programmatic SEO by design: listing, category, city and category × city pages are all templates filled from a database of businesses. This guide covers programmatic SEO from that practitioner’s side: what makes a template worth indexing, where the data comes from, how to link and measure thousands of pages, and how to roll them out without flooding Google with pages it won’t index.

Short version: start from data, not from a keyword list. Publish a page only when it has enough rows of real data to answer the search. Measure every template as a group, roll out in batches, and noindex or remove the pages Google never shows.

How programmatic SEO works

  1. A search pattern. A head term plus modifiers: “plumbers in {city}”, “{app} {app} integration”, “{currency} to {currency}”. Many searches share one shape.
  2. A dataset with one row per page and enough fields to make each page different: businesses, apps, places, prices.
  3. A template that turns each row into a page answering that search.
  4. A URL pattern and internal links that let people and Google browse the pages as a hierarchy.
  5. Measurement by template, because no one can review 20,000 pages one at a time.

Programmatic SEO examples

SiteTemplateWhat is unique on each page
ZapierApp integration pages, zapier.com/apps/google-sheets/integrations/trelloThe actual workflows the two apps support together
TripadvisorRestaurant lists such as “Best Italian Restaurants in Sydney”The restaurants in that place, with their reviews and ratings
Nomad ListCity pagesCost of living, internet speed, weather and safety data for that city
YelpBusiness pages and category-in-city listsThe business’s details, photos and reviews
Any local directory/plumbers/austin-txThe plumbers in Austin and what their listings say

Zapier describes its own app pages, Tripadvisor and Nomad List in its programmatic SEO guide.

The common thread: each page would be useful even if search engines didn’t exist. The template is the delivery mechanism; the data is the product.

A directory is programmatic SEO

TemplateExampleWorth indexing when
Listing/listing/joes-plumbingThe business is real and open, with details beyond name, address and phone
Category × city/plumbers/austin-txIt lists at least your minimum number of businesses located there
City/texas/austinIt links to categories that have listings in that city
Category/plumbersIt helps people pick a place and explains the category
State/texasIt organizes cities that have listings
Guides/guides/hiring-a-plumberWritten for people, not generated

The category × city template is where directories win most of their search traffic and where they get into trouble: multiply 200 categories by 1,000 cities and you have 200,000 possible pages, most of them empty. The number of pages you publish should come from your listings, not from the multiplication. See doorway pages for the test each page should pass, and location pages SEO for what a city page needs.

What makes a template worth indexing

Google’s helpful content guidance frames the same test as a question of who the page is for: people, or search engines. Programmatic pages built to catch keyword variants fail it; pages built to present data people want pass it.

Where the data comes from

SourceGood forWatch out for
Your own listings (submitted or claimed)Listing and category × city pagesThin profiles; keep a minimum of fields
Public data (government licensing lists, Census place names and populations)Seeding listings, city names, verifying businessesOthers have the same data; add to it
Reviews and ratings you collectRanking businesses, unique text per pageMust be real reviews of real customers
Aggregates you computeCounts, price ranges, “open late” and similar facts per pageOnly meaningful with enough rows
Scraped content from other sitesRarely a good idea“Scraping feeds, search results, or other content” is an example in Google’s scaled content abuse policy

Programmatic SEO tools

Programmatic SEO needs three kinds of tool, and no single product does all three well:

Internal linking for thousands of pages

Measure by template

A page-type scorecard is the core report for programmatic SEO: one row per template with its known URLs, the share Google showed at least once in 90 days, clicks, impressions, click rate, average position and estimated indexed share, each compared with the previous period. A template whose indexed share falls or whose never-shown share climbs is the first sign of a quality problem, usually weeks before clicks drop.

Page types report in the DirectoryLens demo: listing pages and city + category pages each with known URLs, share shown in Google in 90 days, visits, times shown, click rate, average position and estimated indexed share.
One row per template: how many pages exist, how many Google shows, and how many it has indexed. Demo directory.

To improve a template, test the change on half of its pages and compare with the other half rather than changing all of them and hoping. See SEO A/B testing.

When to noindex, merge or delete generated pages

PageDo thisWhy
Below your minimum, but you are adding data thereNoindex, keep out of the sitemapIt can be indexed once it fills
Duplicates a sibling (same rows, variant keyword)Merge with a 301 into the page you keepOne strong page beats two weak ones
No data and no prospect of anyDelete; return 404 or 410It will never be useful
Real data, never shown, newer than about 4 monthsWaitNew pages often take months to earn impressions
Real data, Google hasn’t crawled itLink to it from indexed pagesZero impressions says nothing about demand yet

More on cleaning up generated pages in index bloat and zombie pages.

Roll out in batches

  1. Start with one slice: one state, one category, or the pages with the most data. Publishing every generated page on day one gives Google far more to crawl than a site of your size usually gets.
  2. Check each batch before it goes live: enough rows per page, no duplicate pages, a real search or browsing reason.
  3. Watch how fast Google indexes the batch and how many pages it shows at least once. If most of the batch is indexed and shown, publish the next one.
  4. If it stalls, fix the template before publishing more. Adding pages to a template Google is passing on makes the problem bigger.

How DirectoryLens helps

The directory analytics guide covers the rest of what to track. You can see every report on the live demo.

Questions

What is programmatic SEO?

Publishing many pages from one template and a dataset, each targeting a search pattern such as “plumbers in [city]”. Directories, marketplaces and integration pages are common examples.

Does programmatic SEO still work?

Yes, when every page has unique, useful data for its search. Pages whose only unique content is the keyword tend not to be indexed and can fall under Google’s scaled content abuse policy.

Is programmatic SEO spam?

Not in itself. Google’s policy targets pages generated mainly to manipulate rankings without helping users, however they are made. Templates presenting real data are how large sites work.

What are examples of programmatic SEO?

Zapier’s app integration pages, Tripadvisor’s restaurant lists by city and cuisine, Nomad List’s city pages, and every directory’s category-in-city pages.

What tools do you need for programmatic SEO?

A data store (a database or spreadsheet), a page generator (a CMS or framework that builds pages from rows), and a way to measure results by template rather than by single URL.

How many programmatic pages should I publish at once?

Start with a slice you can measure, such as one state or one category, and publish more once Google has indexed and shown most of it. If the batch stalls, fix the template first.

Measure your templates, not just your URLs.

Connect Search Console, and DirectoryLens reports every page type: shown, indexed, clicked, and where to build next.

Explore the live demo →

5 days free · no card needed · ends on its own