WordPress And Search Engine Indexing Patterns

Search engines don't index all pages they discover. The selection process produces patterns worth understanding for SEO decisions.

The discovery phase

Search engines discover URLs via: sitemap submissions, internal links, external links, manual submissions in Search Console.

Discovery doesn't guarantee indexing. Discovered URLs may be crawled or not, indexed or not.

The crawl decision

After discovery, the search engine decides whether to crawl. Factors:

The site's overall authority and crawl budget.

The URL's apparent importance (linked from many pages vs few).

Previous crawl experience (errors, value of content).

Sites with strong authority get more pages crawled; weaker sites get fewer.

The index decision

After crawling, the search engine decides whether to index. Factors:

Content quality and uniqueness.

Whether the page provides value beyond what's already indexed.

Technical factors (noindex tag, canonical signals).

Even crawled pages may be excluded from the index if quality signals are low.

The rank decision

For queries the page might rank for, the search engine decides position. Factors: relevance signals, authority signals, user behavior signals, technical signals.

The ranking decisions happen per query per ranking event. The same page may rank differently for different queries.

The "discovered, not indexed" pattern

Search Console shows URLs in this category. The search engine knows the URLs exist but chose not to index them.

Common causes: low content quality, thin pages, near-duplicate content, low priority compared to other URLs on the site.

The fix usually isn't technical. The fix is content quality improvement.

The "crawled, not indexed" pattern

The search engine crawled but didn't index. Similar to above; quality signals weren't enough.

The honest framing

Understanding the indexing process helps interpret Search Console reports. URLs that aren't indexed often have specific reasons identifiable in the reports.

For sites with significant unindexed content, the audit identifies whether the issue is quality, technical, or other. The fix depends on the cause.