crawl stats home screen

There is a new Google Crawl Stats report that is replacing the old one, and providing a lot more actionable data.

The link to the new report is here: https://search.google.com/search-console/settings/crawl-stats

Alternatively you can go to Google Search Console -> Settings -> Crawl stats (open report)

crawl stats report 2020 google search console

First Impressions

After having an initial look around, it feels much more like a log file analysis.

It has urls broken down by response codes, which also allow you to dig in granularly and see which urls are being crawled.

One of the interesting things I noticed, was it flagged multiple 404 urls that Google was crawling, that WERE NOT included in the usual Coverage report – this suggests it will be very useful to granular technical audits, without requiring log file access.

You can also see how much of your crawl budget is used on Discovering new content vs Refreshing existing content.

You can see crawl by Googlebot type, including Smartphone, Image, Page Resource Load, and Desktop crawlers (from my initial checks).

You can also see which file types are being crawled, and more importantly you can see the Average response times of them. However, it seems they don’t keep the data of urls for the JSON, Javascript, or CSS files, so you can’t dig into which ones are loading slowly.

It also gives you notifications if your host has problems, checking robots.txt fetch, DNS resolution, and Server Connectivity.

I think this will make an excellent addition to a technical audit tool set.


Do you need help with a technical audit?

I offer comprehensive SEO audits that can help your website succeed in search, appropriate for small, medium, and large businesses. Contact me to learn more.

How useful was this post?

Click on a star to rate it!

Average rating 5 / 5. Vote count: 1

No votes so far! Be the first to rate this post.

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?

Matt Jackson

Ecommerce SEO specialist, with over 8 years of full time experience analysing and fixing online shopping websites. Hands on experience with Shopify, Wordpress, Opencart, Magento, and others CMS.
Need help? Email me for more info, at info@matt-jackson.com

This Post Has 0 Comments

Leave a Reply

Your email address will not be published. Required fields are marked *