Google launches updated crawl stats report in Search Console

Posted by Edith MacLeod on 1 Dec, 2020
View comments SEO
More granular insights and actionable data for webmasters in the new report.

Google crawl report.

Google has launched a new version of its crawl stats report in Google Search Console.  The more detailed information aims to help webmasters better understand how their sites are crawled and provides useful data for identifying and tackling any issues.

In its blog post, Google highlighted the following new features:

  • Total number of requests grouped by response code, crawled file type, crawl purpose, and Googlebot type.
  • Detailed information on host status
  • URL examples to show where in your site requests occurred
  • Comprehensive summary for properties with multiple hosts and support for domain properties

The new over-time chart displays total crawl requests over a period of time, total download size and average response time, enabling you to track changes in crawling patterns.

Over time.

Crawl requests can be broken down by:

  • response
  • file type of the fetched URL
  • purpose of the crawl request (Discovery or Refresh)
  • Googlebot agent

Requests breakdown.

Host status shows whether Google encountered any availability issues when trying to crawl your site over the past 90 days.

Host status.

If you have domain properties with multiple hosts, you can check the host status for each of the top hosts in the report summary view.

Multiple hosts.

The updated crawl stats report is a useful addition for webmasters, providing detailed and actionable information for debugging any crawl issues.

For a detailed overview of the crawl report see Google's support page here.

Recent articles

Google launches new personalisation options in Search
Posted by Edith MacLeod on 27 November 2023
Google adds small business filter to Search and Maps
Posted by Edith MacLeod on 21 November 2023
Google releases Nov 2023 reviews update
Posted by Edith MacLeod on 9 November 2023
Interactive content: engaging your audience in the digital age
Posted by Brian Shelton on 8 November 2023
Google releases November 2023 core update
Posted by Edith MacLeod on 3 November 2023