Error cause and remedy for noindex tag added to submitted URL

When using the Google Search Console, you may receive an email stating "A new'index coverage'problem has been detected." Also, what does that email mean? I think some of you may have arrived at this article.

This time, what will happen if you don't deal with the content of the "error" and how to deal with it? I would like to explain such a part.

Message from the search console

The message about "index coverage", which is the content of this talk, is like this.
Email from the search console
In the image,

The Search Console has detected one new coverage issue affecting your site.

Main errors (up to 5)

An error may prevent the page from appearing in Google search results. The following error was detected on your site.

-The noindex tag has been added to the sent URL.

It has become. What do you mean?

I will explain.

What is an index coverage report in the first place?

Google crawls and indexes web pages found by crawlers and displays them in search results. The storage of page information in Google's database is called an index, and the index coverage report can list how many pages in your site have been indexed.

Index coverage report is one of the functions in the search console and can be confirmed from "Coverage" on the left menu in the tool.

Index coverage errorGoogle is not indexing the page correctlyThat means that the page will not be indexed by Google and will not appear in search results unless you clear the error. In terms of SEO, a non-indexed page is the same as having no page itself, so no matter what search query you search for, it will not be displayed as a result. It's not very good.

See also here for index coverage

Index coverage status and workaround

Mainly, the displayed status is

  • error
  • Effectiveness
  • Valid (with warning)
  • Exclusion
  • It will be four.
    Of these, the ones that should be paid attention to"Error" and "Exclusion"There are two.
    If you see more than one "error", there may be a problem with your website. Regarding "exclusion", please note that there are cases where pages are unintentionally excluded from the index, and cases where a huge number of excluded pages hinders the crawler's migration.

    Also, regarding "effectiveness", it is said that it will not be a big problem even if you do not deal with it, but it is ideal to deal with this part as well.

    What is the noindex tag added to the URL sent?

    In the series of "Sent URL is (ni) ..." including this error, something should be sent in the sitemap (sitemap.xml) as the URL that you want Google to index the corresponding URL. It shows the situation where the index could not be done for some reason.

    Many causesOne of the reasons is that the site map has not been created properly... Be careful to include only legitimate URLs (URLs you want to index) when creating a sitemap.
    In other words, the inconsistency that the URL with the noindex tag (the tag that you do not want to display, so do not index) is included in the XML sitemap (sitemap.xml) is causing an error.

    See also here for the site map.

    Click the error item to display a specific URL list, so check each one.

    If your intention is to write a noindex tag on the page, delete the URL from the sitemap (sitemap.xml), and if it is a URL you want to index, delete the noindex description.

    What are the criteria for indexing or not indexing in the first place?

    I feel that there is no correct answer in this regard,Think about whether there is "no need to appear in search results"maybe.

    For example, I feel that pages that do not have "Inquiries" or "Terms of Service" are often not indexed.

    If the tag page is not indexed

    This is also a very difficult part. Basically, there are many similar pages, so there was a tendency not to index them in consideration of crawlerability.

    However, in the article that has been talked about recently, there are cases like this.

    I see ... You can't decide whether it's good or bad.
    However, as mentioned in the above article, it is important to operate the tag page systematically.

    For example, it is a good idea to index the tag page as a lead to reach the past article because there are too many pages, but it is better for the user to be able to handle it by putting a link for the past article in the first place. It may be kind to you.

    As with our site, the number of posted articles will inevitably increase, and trends and technical stories are likely to increase as the latest articles, so the basic theme is pushed to the back. I'm sorry.

    However, it is difficult to go back to the old page from there, soThe basic story is displayed at the top in advanceI am allowed to do it.

    Content design story

    Please consider this area in light of the site management policy.

    How to handle with WordPress

    If you are using WordPress, you probably manage XML sitemaps and noindex settings with plugins.

    Most plugins allow you to choose whether to add to the XML sitemap or insert noindex for each page type, so the problem with the search console is "only for one page type". For example, on the plugin management screenYou can noindex the entire page or exclude it from the sitemap.is.

    Let's take a look at the management screen of the "All in One SEO Pack" that I use.
    Management screen capture
    If you want to index it, you don't need to check anything. On the contrary, if you do not want to indexCheck "Use noindex for this fixed page / post" and "Exclude from sitemap".is.

    How to deal with Google XML Sitemaps

    Let's take another commonly used "Google XML Sitemaps" plugin as an example.
    First, log in to Wordpress and open Settings-XML-sitemap.
    sitemapxml

    Uncheck "Include sitemap in HTML format" with the arrow. This file has noindex set to itChecked here and an error has occurredIn many cases.

    summary

    After dealing with the error, let's "verify the correction".
    This will allow Google to immediately check if the webmaster has taken action.
    However, please note that if you do not correct all the target URLs that have the same error, you will not be able to start verification, or even if you can start it, it will fail... There is a "Verify Fix" button in the coverage report, so request a re-crawl from here.

    The corresponding method itself is not difficult, but even with WordPress, there are cases where noindex is described in the theme file etc. or an XML file is statically created and uploaded instead of a plugin. Therefore, please check your own environment before taking any action.

    If you do nothing, Google will prioritize the noindex tags and will not index those pages. Therefore, if it is a URL that you do not want to index, you can leave it as it is, but if it is a URL that you want to index, you need to take immediate action. anywayIt's not good to have an errorSo let's hurry up.

    Please feel free to contact us if you have any questions.

    I'm sure some of you may be worried when you suddenly receive a warning email.

    I hope this article will be of some help to you.

    If you have any questions after reading the article, feel free to Twitter (@kaznak_com) Etc., please ask.

    Please excuse me.

    Kazuhiro Nakamura
    Kazuhiro Nakamura
    Representative of Cocorograph Inc. 13 years of SEO history, more than 970 sites with countermeasures. We provide SUO, an upward compatible service of SEO that optimizes not only search engines but also search users. SEO / SUO's original report tool, Sachiko Report Developer. Book "The latest common sense of SEO taught by professionals in the field"
    Kazuhiro Nakamura
    Kazuhiro Nakamura
    Representative of Cocorograph Inc. 13 years of SEO history, more than 970 sites with countermeasures. We provide SUO, an upward compatible service of SEO that optimizes not only search engines but also search users. SEO / SUO's original report tool, Sachiko Report Developer. Book "The latest common sense of SEO taught by professionals in the field"