Google: Noindexed Pages Do Not Impact Crawl Spending Plan

Posted by

Google’s Search Relations group validates that noindexed pages don’t negatively affect a site’s crawl budget plan, no matter how many a website has.

This topic is resolved not as soon as however thrice throughout the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Supporters John Mueller and Gary Illyes take turns addressing three similar concerns from individuals concerned they have a lot of noindexed pages on their websites.

From Mueller’s and Illyes’ actions, we find out there’s no such thing as “too many” indexed pages. Even more, unless your site has over a million pages, there’s no need to fret about crawl spending plan.

Here’s a quick recap of each question and response.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “excessive” variety of indexed pages is a concern for discovery or indexed.

Illyes says noindex is a tool to assist sites keep material out of online search engine. Google motivates utilizing the noindex tag when essential, and for that reason, there are no adverse results connected with it.

“Noindex is an extremely effective tool that search engines support to help you, this site owner, keep content out of their indexes. For this reason, it doesn’t bring any unintended impacts when it pertains to crawling and indexing. For instance, having many pages with noindex will not influence how Google crawls and indexes your website.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following question turns up at the 10:22 mark:

“Should we keep an eye on the ratio between indexed and non-indexed pages in Search Console in order to better acknowledge potentially lost crawl budget on non-indexed pages?”

Mueller debunks that websites must attempt to balance their indexed and nonindexed pages.

To that end, crawl spending plan is an aspect that few websites need to think about; Mueller states:

“No, there is no magic ratio to look out for. Also, for a site that’s not enormous, with less than a million pages, maybe, you really don’t need to worry about the crawl budget of your site. It’s fine to get rid of unneeded internal links, however for little to medium-sized websites, that’s more of a website hygiene subject than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a question comes up about no indexed pages that’s a little different from the previous 2.

The concern checks out:

“A lot of SEOs are complaining about having millions of URLs flagged as excluded by noindex in Google Browse Console. All to rubbish internal search pages connected from spammy sites. Is this a problem for crawl budget plan?”

Ilyes reiterates the earlier point about noindex being a tool for websites to utilize as needed.

Assuming the pages are purposefully noindexed, there’s no need to worry about Browse Console flagging them. It does not imply you’re doing anything wrong.

Illyes states:

“Noindex is there to assist you keep things out of the index, and it does not included unintentional negative impacts, as we said previously. If you wish to ensure that those pages or their URLs, more particularly, don’t end up in Google’s index, continue using noindex and do not fret about crawl budget.”

Source: Google