Google’s New Crawl Limits Reward Fast Dealership Websites

[DjSec]

Google recently updated how much of a page Googlebot will actually read when crawling. The documented per-page fetch limit dropped from ~15MB to ~2MB. This is not a monthly quota. It is a hard stop on how much of a single page Google processes before ignoring the rest.

For dealerships, this matters because most dealer sites are bloated!

This gives fast websites an even bigger advantage!​

As Google becomes more cost-sensitive, page speed and crawl efficiency will become more important and dealerships with fast, clean sites will gain a measurable advantage while bloated sites will lose more and more ground.

 

[douglaskarr]

There are some nuances to this:

• The 2MB Cutoff: For standard HTML pages, Googlebot now only processes the first 2MB of uncompressed data. Once this limit is reached, Googlebot stops the fetch and only indexes the downloaded portion.
• Uncompressed Data: The limit applies to the raw HTML size, not the compressed version (like Gzip or Brotli) sent over the network. If your raw code is bulky, content at the bottom of the page may be ignored.
• Subresources are Separate: This limit applies to the initial HTML file itself. Resources like CSS, JavaScript files, and images are fetched separately, and each has its own 2MB limit.
• PDF Exception: Interestingly, Google significantly increased the limit for PDFs to 64MB, recognizing that documents are often much larger than web pages

 

[DjSec]

There are some nuances to this:

• The 2MB Cutoff: For standard HTML pages, Googlebot now only processes the first 2MB of uncompressed data. Once this limit is reached, Googlebot stops the fetch and only indexes the downloaded portion.
• Uncompressed Data: The limit applies to the raw HTML size, not the compressed version (like Gzip or Brotli) sent over the network. If your raw code is bulky, content at the bottom of the page may be ignored.
• Subresources are Separate: This limit applies to the initial HTML file itself. Resources like CSS, JavaScript files, and images are fetched separately, and each has its own 2MB limit.
• PDF Exception: Interestingly, Google significantly increased the limit for PDFs to 64MB, recognizing that documents are often much larger than web pages

It changes the outcome for dealerships.

Yes, subresources are fetched separately. That doesn’t help when the uncompressed HTML itself is bloated and Google stops processing before it reaches vehicle details, service content, or internal links.

Most dealership sites push meaningful content far down the DOM behind navigation, scripts, filters, and repeated components. Hitting a 2MB processing cap means Google often indexes a partial understanding of the page.

This isn’t a problem for lean, fast, server-rendered sites. It is a problem for platform-based dealer sites that treat pages like applications instead of documents.

The result isn’t “Google can’t crawl the site.”
The result is lower crawl efficiency, slower indexing, and weaker signals.

And that opens a competitive gap.

 

[douglaskarr]

It changes the outcome for dealerships.

Yes, subresources are fetched separately. That doesn’t help when the uncompressed HTML itself is bloated and Google stops processing before it reaches vehicle details, service content, or internal links.

Most dealership sites push meaningful content far down the DOM behind navigation, scripts, filters, and repeated components. Hitting a 2MB processing cap means Google often indexes a partial understanding of the page.

This isn’t a problem for lean, fast, server-rendered sites. It is a problem for platform-based dealer sites that treat pages like applications instead of documents.

The result isn’t “Google can’t crawl the site.”
The result is lower crawl efficiency, slower indexing, and weaker signals.

And that opens a competitive gap.

No disagreement! I think legacy platforms are becoming increasingly problematic here.

 

[Gary Hopkins]

How can I test my pages to see where my sites stand? Even better, is there a tool that will scrape my site and show the over-2MB pages?

 

[douglaskarr]

How can I test my pages to see where my sites stand? Even better, is there a tool that will scrape my site and show the over-2MB pages?

A site crawler like SEO Screaming Frog does a nice job.

Otherwise, working on them one at a time can be done using Google Chrome Dev Tools. This method is precise because it shows you the "Resource Size" (uncompressed) vs. "Transferred Size" (compressed).

1. Press F12 to open Developer Tools.
2. Go to the Network tab.
3. Refresh the page.
4. Look for your main URL in the list (usually the first item, type "document").
5. Hover over the value in the Size column.
   • Top number: Transferred size (compressed).
   • Bottom number: Resource size (This is the one that matters for the 2MB limit).

 

[Gary Hopkins]

Fantastic, helpful reply! Just a quick check on a Dealer.com detail page with several third-party add-ons, and we're under 200k for the resource size. Thanks so much!