Your website might be invisible to ChatGPT and nobody at your store would ever know - AEO / GEO Megathread

[carguyfiles]

We all keep debating whether artificial intelligence, umm I mean super intelligence (sorry Mr. President), is coming for the BDC.

Meanwhile a buyer in your town is asking ChatGPT where to get a deal on a used Tahoe, and your website might not even be letting it in the door.

Everybody's pitching AEO and GEO right now, aka getting your store to show up in ChatGPT, Claude and Perplexity answers. None of it matters if the bots can't read your site. And when they can't, nothing on your end tells you.

Two quick checks:

1) Go to yourstore.com/robots.txt and ctrl+F for OAI-SearchBot, Claude-SearchBot and PerplexityBot. If any of them have Disallow: / under them, or you see User-agent: * followed by Disallow: /, you're locking them out. (GPTBot is the training bot, different conversation.)

2) Pull up a used VDP, view the source (ctrl+U) and ctrl+F the price. Try it with and without the comma. If it's not in there, it's probably getting loaded by javascript, and ChatGPT might be looking at a car with photos and no price.

I wrote up the full 15 minute check, including the firewall piece (that's the sneaky one):

Can ChatGPT and Claude Read Your Dealership Website?

A 15-minute check of whether ChatGPT, Claude and other AI tools can read your dealership website: robots.txt, firewalls, JavaScript and VDP text.

autolander.ai

Who's brave enough to try it? Post what you find, even if you pass. And the website and SEO people on here, am I overblowing this or are you seeing it too? This thread is for everyone to discuss their positions on it as well as methods on how to rank.

 

[joe.pistell]

Great write-up, Michael. Thank you. Any thoughts about dealer inspire sites being behind the Cloudflare wall?

Dealer Inspire dealers should be very mad.

Example, a car shopper writes:

"I like this car, can you find me one like this at a better price? My zip is 13029.
https://www.maguirecars.com/invento...-base-fwd-4d-sport-utility-5xyzt3lb0jg526346/"

Grok:
That listing is a 2018 Hyundai Santa Fe Sport 2.4 Base, front-wheel drive, VIN 5XYZT3LB0JG526346. Maguire’s own page is blocked, but Autotrader has:

Grok Output:

Car shopping at better price | Shared Grok Conversation

I like this car, can you find me one like this at a better price? My zip is 13029. https://www.magu

grok.com

 

[carguyfiles]

Any thoughts about dealer inspire sites being behind the Cloudflare wall?

Great example Joe. I ran Maguire through the checks and it passes 3 of the 4. The robots.txt doesn't name a single AI bot, and that Santa Fe page has the price, mileage and VIN right in the raw HTML. But the site runs through Cloudflare, so that's where Grok hit the wall and sent your shopper to Autotrader instead. It's the one door nobody at the store ever sees.

To be fair to DI, their own page says they let verified crawlers from OpenAI, Google, Microsoft and Anthropic through Cloudflare. Grok and Perplexity aren't on that list, which matches your test.

Good news is the fix is a setting on their end. Cloudflare lists Grok's agent (GrokAgent) as verified, and AI Crawl Control lets whoever runs the account allow crawlers one by one.

If you're on DI or anything behind Cloudflare:

1) Paste a VDP link into ChatGPT, Claude, Perplexity and Grok and ask for the price and VIN. Note which ones can't open it.

2) Send your rep: "Please allow xAI's GrokAgent and Perplexity's PerplexityBot and Perplexity-User for our domain in Cloudflare, and confirm ChatGPT and Claude are allowed too. Training bots can stay blocked. Please confirm in writing with the date it's live."

3) Rerun step 1.

Any DI store that gets it flipped, post your before and after.

 

[JimmyBrown]

I know I need this stuff but I don’t even know where to begin. I’m old skool built my dealer from the ground up now there’s all this technology and I don’t know where to start.

 

[joe.pistell]

To be fair to DI, their own page says they let verified crawlers from OpenAI, Google, Microsoft and Anthropic through Cloudflare. Grok and Perplexity aren't on that list, which matches your test.

GPT = No Dealer Inspire
"I could not read Maguire’s page directly, so the dealer still needs to confirm the advertised price."

See what I’ve been working on

Someone shared part of their work with you.

chatgpt.com

 

[carguyfiles]

GPT = No Dealer Inspire

Dug a bit deeper on this...

DI's page talks about crawlers, but when a shopper pastes a link, ChatGPT reads it live with a different bot called "ChatGPT-User". That's the one getting bounced. Cloudflare counts it as an "Agent," and that's a separate setting.

Maguire can't fix it on their end either. The site's IP is registered to Cars Commerce, so it's on DI's to change. I'd be willing to bet every DI site is set up the same way too.

So the fix HAS to come from DI. Any DI should be able to send their rep this:

"Please set Agent to Allow in Cloudflare's AI bot policies for our domain and make sure nothing else is blocking ChatGPT-User, Claude-User, Perplexity-User or GrokAgent. Training bots can stay blocked. Send a dated screenshot when it's done."

That should do it. Then paste a live VDP into ChatGPT and ask for the price and VIN. If it says it can't read the page and falls back to Cars.com or Autotrader then there is still some work to be done there and a custom wrapper can be built that is purpose driven for the site. We do this as one of our specialties to help dealers with the same problem by creating a mirror page that is crawlable by GPT and others. But yea I agree it is probably frustrating to all DI customers. Too bad too because they are a decent company. The good thing though is regardless of what it is, there is a solution.

 

[joe.pistell]

Dealer Inspire had better get this fixed fast.

GPT assessment of DI:
The feed is accessible. The cause of the vehicle-page failure is still unknown.

The exact URLs are:

• Maguire group inventory: https://www.maguirecars.com/llm/inventory/
• Chevrolet used inventory: https://www.maguirecars.com/llm/inventory/?make=Chevrolet&type=used
• The feed that returned your Tahoe: https://www.maguirechevroletofithaca.com/llm/inventory/?bodytype=SUVs&type=used. Its indexed result listed your VIN and 10,334 miles.

I need to correct my earlier explanation: I constructed the vehicle-page URL from a common URL pattern. I did not obtain it from the dealer’s actual listing link. Its failure therefore does not prove Maguire blocks AI.

What this session established:

Your first diagnostic step is to test the actual Tahoe listing URL. Then check server logs for crawler requests and response codes. Those checks distinguish a wrong URL, a security block, and a page-rendering problem.

This session shows a discovery advantage for CarGurus, but it does not establish the cause of Maguire’s low AI traffic.
Cloudflare is a plausible cause, but this session does not prove a Cloudflare block. My retrieval tool returned “not accessible.” It supplied no HTTP status, response headers, or Cloudflare challenge page.
Cloudflare can block or challenge automated requests through its bot protection and firewall rules. Being a Cloudflare customer does not establish that DealerInspire enabled those rules for Maguire.

Ask DealerInspire to check this:

Check Cloudflare Security Events for Maguire’s domain around October 3, 2026, 10:05–10:16 a.m. Eastern. Identify any blocked or challenged AI retrieval requests. Return the requested URL, action, matched rule, user agent, and Ray ID. Also check AI crawler controls and bot protection settings.

A matching Block or Managed Challenge event would establish Cloudflare’s role. Without that evidence, blaming Cloudflare would be premature—especially because my attempted vehicle URL was constructed and may have been wrong.


Dealer Inspire says its Cloudflare configuration allows trusted AI access. A blanket AI block would conflict with its published policy.

Two official pages address this directly:

Official page	What Dealer Inspire says
AI-ready dealer websites — August 2025	Cloudflare bot management allows trusted crawlers. Its allowed-access list names OpenAI, Google, Microsoft, and Anthropic.
AI Inventory Boost — April 2026	An AI-optimized inventory feed helps AI find and match vehicles. It repeats that trusted AI assistants can access sites through Cloudflare.

These are Dealer Inspire’s published claims, not verification of Maguire’s actual configuration.

For Maguire, the next step is to verify that the live configuration matches that policy. Our search found inventory-feed data, but my failed vehicle-page request used a constructed URL. That failure cannot establish a Cloudflare block.

Ask Dealer Inspire: “Does Maguire’s domain follow your published AI-access policy, and can you demonstrate successful AI retrieval of this Tahoe’s actual vehicle page?”