First, confirm what is waiting and for how long
Export the "Discovered - currently not indexed" examples from the page indexing report in Search Console (GSCGoogle's search performance and indexing tool.) and group them by URL pattern. The shape of the list matters more than its size. A list made mostly of parameter combinations, internal search results or calendar pages tells a different story from a list of new product or article URLs that the business actually wants found.
Next, open the crawl stats report under settings. It shows how many requests Google made, the average response time, and the breakdown of responses by status and by purpose (discovery or refresh). A rising response time or a visible share of server errors points straight at the first row of the table below. Finally, check how long the important URLs have been waiting. A product published this week and still undiscovered is ordinary; a section that has sat in this state for months while the rest of the site is crawled normally is a signal worth chasing. URL inspection on one of those pages confirms it has no crawl date at all. Where server logs are available, log file analysis shows which templates take the crawler's requests and which important pages it has not requested in weeks.
Diagnosis table
Diagnosis
| Symptom | Check | Likely cause | Fix |
|---|---|---|---|
| Crawl requests fall while response time climbs or errors appear | Crawl stats: average response time, host status, responses by type | Server slow or returning errors so Google crawls less | Fix capacity and errors; serve important pages fast and reliably |
| The waiting list is dominated by filters, sorts, sessions or search results | Group the sample by URL pattern and parameter | Large numbers of low-value URLs (facets, parameters) diluting crawl | Stop exposing the URL space; consolidate onto clean URLs |
| Important pages are several clicks from any hub | Crawl depth and inlink counts for the waiting URLs | Pages deep in the architecture with few internal links | Flatten the path with hub, category and contextual links |
| URLs appear in the sitemap but no page links to them | Compare sitemap URLs with crawled inlinks; look for orphans | Sitemaps listing URLs the site does not link | Link every sitemap URL from relevant pages, or drop it from the sitemap |
| A new domain or section where most pages wait | Referring domains to the site and the section; age of the section | New site or section with little external authority | Earn links and mentions to the section's hub; keep the URL count lean |
Fix, verify and prevent each cause
Server capacity holding Google back
Google's large-site guide on Crawl BudgetHow much a search engine crawls a site. explains that crawling adapts to how the host responds: a fast, healthy server can be crawled more, while slow responses and server errors make Googlebot back off. On a site with many URLs, that can leave newer ones queued.
Fix: find the bottleneck with the host or developers: slow database queries on listing templates, missing caching, rate limits or firewall rules that throttle the crawler, error spikes during deployments.
Verify: crawl stats show a lower average response time and fewer server errors, followed by more requests per day.
Prevent: monitor response time and error rates for crawler traffic alongside user traffic, and read the capacity section of crawling and indexing before infrastructure changes. When the Page Indexing report itself lists server errors on pages that load in a browser, the page on server errors in Search Console separates load, protection rules, failing templates, releases and junk addresses.
Parameter and filter URLs crowding the queue
Every crawlable combination of filters, sort orders and tracking parameters is another URL competing for the same fetches. Google's crawl budget guidance names faceted navigation and session identifiers as common sources of low-value URLs.
Fix: decide which filtered views deserve indexing, and for the rest stop emitting crawlable links, block the parameter space where fetching it is pointless, and keep the clean URL canonical.
Verify: the proportion of parameter URLs in crawl stats and in this export shrinks, and important URLs begin to be fetched.
Prevent: treat new filters as an SEO decision, using the framework in faceted navigation and index control.
Pages buried deep
When a page sits at the end of a long chain of pagination or nested categories, the site is effectively telling Google it is minor. Link best practice in Google's documentation stresses crawlable anchor links as the main way Google finds pages.
Fix: surface the waiting pages through category hubs, related-item modules and contextual links from strong pages, so each is reachable in a few clicks.
Verify: a new crawl shows reduced depth and more inlinks, and URL inspection begins reporting crawl dates.
Prevent: design the hierarchy so depth stays shallow as the catalogue grows, as described in site architecture for SEO.
Sitemap entries without links
A sitemap helps discovery, but a URL that appears there and nowhere else is discovered without any sign of importance. Large batches of orphaned sitemap entries are a frequent source of this status after imports and programmatic launches.
Fix: either connect each URL to the site with real links from relevant pages, or remove it from the sitemap if it should not be a priority.
Verify: the orphan count in your crawl falls and those URLs start receiving crawl dates.
Prevent: generate sitemaps from the same source as the navigation, and check for orphans before any bulk launch, following the audit routine in the internal linking guide.
A new site or section without authority
A new domain, or a new section on an established one, has little external evidence that it is worth crawling heavily. Links from other sites are one of the ways Google discovers URLs and judges how much attention a site deserves.
Fix: earn a handful of genuine BacklinkA link from another site to yours. references to the section's hub page through useful content, partnerships and digital PR, and keep the section small and complete rather than launching thousands of thin URLs at once.
Verify: crawl requests to the section rise and the waiting list for it shrinks over the following weeks.
Prevent: plan launches so the first pages are the strongest ones, and use the approaches in link building methods for a section that starts from nothing.
Prevention: controlling URL growth
This status grows when a site produces URLs faster than it gives Google reasons to fetch them. Keep an inventory of URL patterns with an owner and an intended index status for each, and treat a new pattern as a change that needs review. Watch the ratio of URLs in the sitemap to URLs actually crawled each month. Keep server performance for crawlers on the same dashboard as performance for users. Stage large launches so links and supporting content arrive with the pages. And separate the two queues in your reporting: URLs that were never fetched belong here, while URLs that were fetched and declined are handled on the sibling page for crawled but not indexed. Mixing them leads teams to rewrite content Google has not even read. Templated page sets are a common source of sudden URL growth; the programmatic SEO guide covers releasing them in stages with index rules decided row by row.
A marketplace whose new listings stalled
A second-hand furniture marketplace adds 15,000 listing pages in March. Six weeks later, 11,000 of them sit as discovered but not indexed. Crawl stats show average response time rising from 300 to 1,400 milliseconds on listing pages and server errors at about 4% of requests. The waiting list also contains 40,000 sort and price-filter URLs. The team adds caching to the listing template, removes crawlable links to sort orders, and links each listing from its category and two related listings. Within a month crawl requests double, the error share drops below 1%, and the queue of real listings falls to around 2,000.
Common mistakes
Rewriting content that Google has never fetched. Requesting indexing one URL at a time for a problem that affects thousands. Adding every URL to the sitemap and assuming that is enough to get it crawled. Ignoring the crawl stats report because it sits under settings.
