For all webmasters and SEO professionals, Google Search Console (GSC) is a great tool for obtaining insights into how Google crawls and interprets itself for a website.
One of the more confusing statuses that a website owner may receive is “Discovered-Currently not indexed”. This article examines the relationship between internal no-follow links and the “Discovered-Currently not indexed” status, and how they contribute to crawling and indexing, and overall website performance.
Understanding the “Discovered—Currently Not Indexed” status
When a URL appears in GSC with the status “Discovered—Currently Not Indexed,” it signifies that Google has found the URL through a sitemap, internal linking, or external backlinks, but has not yet added it to its index. This delay or refusal to index can arise from various factors:
- Low quality or thin content: Pages lacking substantial or unique value may not meet Google’s indexing criteria.
- Crawl budget limitations: For larger sites, Google prioritises crawling and indexing pages that it deems more important.
- Technical issues: Improper configurations, such as meta tags or txt settings, can hinder indexing.
The status poses a challenge for website owners, as unindexed pages fail to generate organic search traffic, limiting their visibility and value.
The role of internal no-follow links
Internal no-follow links hyperlink a website without it having the rel=”no-follow” attribute. This means a search engine is not supposed to follow the link, and therefore does not pass link equity onto the destination URL.
While no-follow links serve specific purposes, such as preventing authority from passing to unimportant or paid links, excessive or improper use can lead to unintended consequences.
Misleading signals to search engines
Marking internal links as no-follow indicates to Google that the linked pages are either less important or untrustworthy. Overuse of this attribute can create confusion about a site’s hierarchy, potentially:
- reducing crawl efficiency: Google may deprioritise crawling the no-follow pages, assuming they hold little value.
- affecting indexation decisions: Pages with limited internal links or primarily no-follow links may remain “Discovered—Currently Not Indexed.”
Unintended page isolation
Internal linking structures are crucial for helping Google understand the relationship and importance of pages. No-follow tags may isolate pages, complicating evaluation of their relevance by search engines—particularly when they are applied indiscriminately across:
- important product pages in e-commerce websites
- blog posts with high informational value
- landing pages designed for conversions.
Impact on crawl budget
The term “crawl budget” refers to the number of pages Googlebot crawls on a site within a given timeframe.
Efficient management of this budget is essential for large websites. Internal no-follow links can negatively impact crawl budgets in several ways:
- Reduced efficiency: Google may squander its crawl resources on pages that lack significant pathways to other content.
- Missed opportunities: Pages prioritised for crawling through sitemaps may conflict with no-follow signals, creating ambiguity.
- Negative perception: Google may deprioritise the entire domain if the overall site structure appears inconsistent or disorganised due to no-follow usage.
SEO implications
An increase in URLs labelled “Discovered—Currently Not Indexed” can significantly impact upon a site’s SEO performance:
- Reduced search visibility: Unindexed pages will not appear in search results, limiting organic traffic potential.
- Diminished authority flow: Excessive no-follow links can disrupt the natural flow of link equity, weakening the authority of key pages.
- Inconsistent user experience: Users may have trouble finding relevant content if search engines don’t index essential pages.
- Long-term rankings drop: Prolonged issues with indexing can lead to a decline in overall domain credibility and rankings.
Resolving no-follow link issues and improving indexing
To reduce the negative impact of internal no-follow links on crawl efficiency and indexing, consider the following actionable strategies:
Audit and minimise internal no-follow Links
Carry out a comprehensive audit of your site’s internal links to identify unnecessary no-follow tags. Use tools like Screaming Frog or Sitebulb to map your site’s link architecture and:
- remove no-follow attributes from essential internal links.
- limit no-follow usage to links with a clear purpose, such as login pages or tracking parameters.
Ensure a logical and consistent internal linking structure
Design a robust internal linking framework that:
- creates clear pathways between pages.
- emphasises cornerstone content or high-priority pages.
- balances the distribution of link equity across the site.
- avoids orphan pages by ensuring all content is linked from at least one other page.
Prioritise important pages for indexing
Use additional tools and methods to emphasise the importance of key pages.
- Sitemaps: Ensure your XML sitemap includes all high-value pages and is submitted to Google.
- Canonical tags: Use canonical tags to signal preferred versions of duplicate or similar pages.
- Internal linking: Increase the number of “dofollow” links pointing to priority pages.
Regularly monitor GSC and crawl reports
Stay proactive by monitoring Google Search Console and third-party tools for changes in indexing status. Pay attention to crawl anomalies or warnings related to your linking structure.
Balance the crawl budget
For larger sites, implement measures like these to optimise the crawl budget:
- Blocking low-value pages via txt.
- Consolidating thin or duplicate content.
- Frequently updating sitemaps to reflect site changes.
Improving crawl efficiency and indexing through strategic internal linking
Internal no-follow links, while useful in certain scenarios, can inadvertently contribute to the “Discovered—Currently Not Indexed” status in the Google Search Console. Mismanagement of these links can affect crawl efficiency, indexing, and overall SEO performance.
By auditing internal no-follow usage, optimising site structure, and prioritising important pages, website owners can mitigate these issues and enhance their site’s visibility in search engines.
Staying vigilant with regular monitoring and implementing best practices ensures long-term SEO success.
