We create digital solutions that work for businesses
A page can be published, open correctly in a browser, and contain useful copy while remaining absent from Google. This does not automatically mean a penalty or “bad SEO”. In most cases, the cause sits at one of three levels: Google has not discovered the URL, cannot crawl it, or has decided not to add it to the index.
The workflow below avoids random fixes. Start with the exact URL in Google Search Console, confirm access and directives, and only then inspect canonical signals, duplication, internal links, and the page’s independent value.
Indexing means Google has stored a page in its index and may show it in Search. Ranking determines the queries and positions for which it appears. If a URL is not indexed, rewriting the title or adding keywords will not resolve the underlying issue.
| Situation | What it means | First action |
|---|---|---|
| URL is unknown to Google | The page has not been discovered | Add an internal link and check the sitemap |
| URL is known but not crawled | Crawling is delayed or technically blocked | Check the server, robots.txt, and link structure |
| Crawled but not indexed | Google saw the page but did not add it | Review quality, duplicates, canonical, and soft 404 signals |
| Indexed but receiving no traffic | The issue concerns relevance and ranking | Analyse queries, content, CTR, and competition |
Open Google Search Console, paste the full URL into the top bar, and review its status. The URL Inspection tool reports what Google knows about the indexed version and can test whether the live URL is accessible and potentially indexable.
Use the final address with the correct protocol, hostname, language folder, letter case, and trailing slash. Different variants can be treated as separate URLs.
The indexed report may describe an older version. A live test shows what Googlebot can access now, including the response, crawl permission, directives, and processed HTML.
Compare the user-declared canonical with the canonical selected by Google. If they differ, Google considers another address the primary version. Google recommends aligning canonical declarations, internal links, and sitemap entries rather than sending conflicting signals.
The Page indexing report groups known URLs by the reasons they were not indexed. Focus on whether important service, category, product, or article pages appear in an exclusion group, not merely on the total number of excluded URLs.
The request button does not repair a page. Resolve the cause, repeat the live test, and then submit the URL. Google says recrawling can take from several days to several weeks and does not guarantee inclusion in the index.
A new page without internal links is effectively orphaned. Add it to a relevant category, link from pages Google already visits, and include the canonical URL in the XML sitemap. A sitemap helps discovery, but it does not guarantee crawling or indexing.
An accidental Disallow for a directory, language version, parameter, or the entire site can stop crawling. However, robots.txt is not a mechanism for removing a web page from Google. A blocked URL may still appear without a useful snippet if other pages link to it.
noindex in a robots meta tag or X-Robots-Tag header explicitly prevents indexing. It often survives a staging migration, template change, or SEO plugin setting. Google must crawl the URL to read the directive, so blocking the same page in robots.txt creates a contradictory setup.
An indexable page should reliably return 200 OK. Redirect chains or loops, 404, 410, 5xx errors, unstable security rules, or Googlebot blocking interfere with crawling. Test from outside the signed-in session and inspect server logs where possible.
If canonical points to the homepage, a category, another language version, or a parameter-free URL, the current page may not be indexed separately. A unique page generally needs a self-referencing canonical, while internal links should use that same preferred address.
Filters, sorting, parameters, tag archives, and near-identical product cards can create large duplicate sets. A soft 404 returns 200 but looks empty, erroneous, or lacking independent value. Not every technical URL combination should be indexable.
Google can process JavaScript, but rendering adds another stage and more failure points. Do not require a click to reveal primary copy, links, or product data. Under mobile-first indexing, the mobile version is the basis for indexing, so important content, robots directives, and structured data should be consistent.
Technical accessibility does not oblige Google to index a URL. A page that repeats another resource, contains only generic paragraphs, or does not satisfy a distinct intent may not qualify as a useful separate result. Add a complete answer, practical evidence, clear authorship, sources, and relevant internal links.
A structured review of access, directives, and canonical signals reveals the actual cause of an indexing problem.
| Status | Likely explanation | Action |
|---|---|---|
| Discovered — currently not indexed | Google knows the URL but has delayed crawling | Improve internal links, sitemap signals, speed, and server stability |
| Crawled — currently not indexed | Google crawled the page but did not select it | Review value, duplicates, canonical, and soft 404 signals |
| Excluded by noindex tag | An indexing prohibition was found | Remove noindex if the page belongs in Search, then retest |
| Blocked by robots.txt | Googlebot cannot crawl the URL | Correct the rule if the block was not intentional |
| Duplicate, Google chose different canonical | Another primary version was selected | Align canonical, redirects, sitemap, and internal links |
| Page with redirect | The URL redirects elsewhere | Confirm the redirect and remove the old URL from the sitemap |
| Soft 404 | The content resembles an empty or error page | Add genuine value or return an appropriate 404/410 |
Interpret every status according to the URL’s purpose. Excluding a cart, sign-in page, or technical filter is often correct. The same outcome for a service or category page requires investigation.
200 OK without loops or blocks.site: operator as a complete index report.noindex.200 OK.noindex exists in HTML or HTTP headers.There is no fixed deadline. Google gives a range of several days to several weeks for recrawling. Accessibility, internal links, crawl patterns, and page quality all influence the outcome.
No. It helps Google discover preferred URLs but does not force crawling or indexing. Include only canonical 200 pages that genuinely belong in Search.
No. Repeated requests do not replace a fix or guarantee faster processing. Submit after a material change and monitor the report.
Signals may conflict: the canonical declaration identifies one URL, the sitemap another, and internal links a third. Pages may also be similar enough for Google to group them as duplicates.
Yes. Indexing only makes a URL eligible to compete. Impressions still depend on relevance, quality, clear structure, and competitiveness.
When one important page is missing, work through the checklist from top to bottom. If the issue affects categories, localized versions, or hundreds of URLs, perform a technical SEO audit of templates, indexing rules, sitemap files, canonicals, and site architecture.
Explore more guidance in the SEO promotion section. For a systematic diagnosis, see BB STUDIO SEO services or send us your website address for an initial assessment.
Prepared by the BB STUDIO team. This article draws on our technical website review practice and official Google Search Central and Google Search Console documentation.
Web development
For business
Design & UI/UX
Hosting & tech
Let’s create something amazing together Leave your number — we will call you back within 15 minutes during working hours.
We will call you back shortly.