Recently, I've been asked several times, such as "When I publish a new site or article, it is no longer indexed."
"The blog site that I update every day suddenly doesn't index only yesterday's and today's articles."
"I added a new page to the corporate site, but it hasn't been updated in nearly a month."
After repeating various measures, it was finally indexed, but recently John Mueller told a similar story at Google Search Central, so I will tell you based on that as well. increase
What is written on this page
How long will SEO be reflected on new pages?
At Google Search Central on June 30, 2021, "How long will SEO be reflected on new pages?"
John keeps talking, avoiding clear numbers every time.
SEO is reflected ・ There is no time limit for obtaining results.
However, there are some tips that can reduce the time it takes to be reflected in SERP.https://youtu.be/6xtYk8optLc
In John's answer, he continued to talk about what he could do to speed up crawling and indexing when new publications or updates such as rewrites were made.
About the index
When a new page is published, it can take hours or even months before it is indexed.
I think that basically good content tends to be indexed in a week or so.
It's hard to say because it can cause technical problems on the web and keep Google's system busy with other things.https://www.youtube.com/watch?v=6xtYk8optLc
There are various cases of problems that are not indexed, so it's hard to say "this is it".
What you can do to be indexed
Now let's talk about some of the things you can actually do.
If you are worried, please try it.
I will also quote Mr. John's remarks.
Did you fix the critical error in the first place?
The main premise is that if you have critical errors or lots of coverage errors, it's considered a poor site for Google.
It's unlikely that a small error will be the cause, but it's not "absent." First of all, check if there are many coverage errors and take appropriate measures.
▼ Please see here for coverage
Submit a sitemap from the search console
Probably the most basic method.
By sending a sitemap from the sitemap area of the sir and console to encourage crawling,GoogleThere is also a detailed explanation from.
As a method
- Open the search console and click "Site Map" on the left
- Enter the URL of the XML sitemap and click Submit.
- Once submitted, you will see a screen that says it's done.
Let's wait a few more days.
Permalink changes (case by case)
This is on a case-by-case basis.
Google says, "It's not a big problem even if the URL is in Japanese." If you set it to a Japanese URL, it will be encrypted like "" (this is "AIUEO" decoded)
I think that there are many cases where it is indexed, but I feel that the performance of Japanese URL pages tends to be poor.
There is a need for redirects, but as much as possible, the URL should be in English and a combination of numbers should be summarized briefly.
▼ Click here for redirects
Use the lastmod of the sitemap
Sitemap as a way to know URL updates
lastmod Google is using.
(Lastmod describes the last modified date and time of each sitemap file in W3C Datetime format. It is not the date and time when the page in each sitemap was changed.)
But where and how much should I update
lastmoThere is no clear announcement from Google if d should be updated. If there have been major changes to the main content, I feel it's not wrong to update lastmod and request a re-crawl.
But the page hasn't changed at all
lastmoCurrently, there are many sites that try to update d and crawl it. Not suitable for brute force
lastmodAfter repeated use, Google will stop using the sitemap.
Update lastmod in compliance with proper usage.
Prevent server overload
Make sure that the server can handle the appropriate requests in a timely manner.
Search engines tend to slow down as servers slow down.https://www.youtube.com/watch?v=6xtYk8optLc
It feels like Mr. John, who is an engineer, is the point of view.
Especially, if the site is large or has a large number of pvs, you should be careful.
AWS load balancerKeep in mind that these are also very useful and effective tools.
Proper placement of internal links
Place internal links in prominent places on new pages.
The easier it is for Google's system to recognize pages that it considers important, the easier it is to prioritize crawling and indexing.
For example, if it is an EC site, it is convenient to have a link to a new product on the homepage. When that happens, Google doesn't have to crawl several categories to find them.https://www.youtube.com/watch?v=6xtYk8optLc
I think this is definitely a measure that will not hurt.
It is important to firmly install internal links as a fundamental SEO concept.
However, it does not mean that it should be installed in the dark clouds, so please try to arrange it appropriately according to the related contents.
* For the author's skin feeling, it is recommended to select the article that is in the best condition (many PVs, many clicks, etc.) among the related articles.
Delete unnecessary URLs on the site
Clean up unwanted URLs on your website.
Search engines can get stuck trying to figure out all the URLs on your site and miss important or interesting URLs.https://www.youtube.com/watch?v=6xtYk8optLc
This is also an important measure when you are aware of crawlerability.
Don't add extra space by consolidating and rewriting or deleting articles that are long ago or that aren't working very well.
Organize your content daily, even when considering crawl budgets.
Keep your website high quality
The more important a site is to your users, the easier it will be for Google to recognize it.
【Related article】What is Google's appropriate quality content?
John says it's important to keep quality content in mind and create it carefully in order to crawl and index more frequently.
[Caution] Although not recommended, a tool that promotes indexing has appeared.
indexMeNowThere seems to be an index promotion tool called.
It's been a little busy since the end of last year, so let's touch on this as well.
How effective it is
- Enter URL to promote indexing
- 80% URL registered within 24 hours
- 95% registered within 48 hours
- Monitors if indexed
- Paid tool, but full refund if not indexed in 10 days
Information such as was obtained.
- indexNow API
- Ping to Google
There is a theory that it uses the mechanism around, but detailed information is not known, and there is a great possibility that it is forcibly promoting the index in a gray (out) method close to spam.
▼ Actually "SEO research channelThere is also a tweet that Mr. "tried to use."
Writer's experience example
Everything is important except the last tool, and I find it a useful task to encourage indexing.
Finally, when I faced the same problem. I have taken the above measures as well, so I would like to talk about that as well.
The URL was changed as a measure taken for pages that are not indexed.
Changing the URL of the indexed page should not be done easily from the SEO's point of view.
However, the case at that time was an article page that was not indexed and was dynamically created in large numbers, so I tried to encourage such measures.
As a result, I don't know if this work had a direct impact, but it was successfully indexed afterwards.
Strived to eliminate index coverage
In the first place, it is not good that there is an error in the site, so I checked from the search console to see if index coverage was occurring.
There were some small errors that I resolved.
If it is a minor one, I think that it can be dealt with immediately, so let's check this as well.
Index coverage is also explained here, so please refer to it.
I checked if there was a problem with the site speed
Regarding CWV, there has been a lot of movement recently, so I also checked this.
If it's too slow, there's no doubt that it will have a negative effect on crawls and indexes, so check it out as well.
Please refer to the past articles here as well.
In the case at that time, I checked it in the lighthouse and there was a part where the size of the image affected a little, so I changed the resolution and uploaded it again.
Maybe Google will also implement "Index Now"?
Index NowPublished by Microsoft Bing with Yandex, it's a great way to get immediate notifications through APIs without the need for search engines to crawl.
Currently Google is not involved in that, Bing and Yandex.
[Bonus] How to use Index Now
IndexNow API publishedTherefore, it is a mechanism to notify the search engine of the addition / update / deletion of the content through the API.
For example, let's send an HTTP request with a URL of the following format.
www.bing.comThe part is the domain name of the search engine that sends IndexNow. With Yadex
IndexNow The value of is the URL to be notified (in the example
key Value (in the example
your-key) Is a unique API key to be issued.
16e9b28cb6dc4c2596800f79rgw0s4f6f It will be a character string like.
You can build your own tools for IndexNow according to the specifications.
CMS-specific plugins such as WordPress and Wix are expected to appear in the near future.
There are other (planned) services within the CDN that support IndexNow.
Recently popularCloudflare Was the first to support Index Now.
While there are many aspects to not being indexed, it's undeniably Google's whims.
I also think that there may be times when "the capacity of the crawl budget suddenly exceeded one day, so it's bad, but I can't index it."
However, based on Mr. John's story this time, it is best to mass-produce high-quality products.
It would be great if we could improve the quality of the site every day and at the same time raise the level of content.
I hope this article will be of some help to you.
If you have any questions after reading the article, feel free to Twitter (@kaznak_com) Etc., please ask.