I heard back from DI today. I'm not totally sure what it means as it is a bit above my skill level.
Has anyone else been able to fix their issue yet?
"Dealer Inspire utilizes best-in-class web security including a web application firewall (WAF), distributed denial of service (DDoS) protection, and bot abuse prevention technology from Cloudflare to protect our customers’ websites. While this technology blocks undesirable bot traffic, Cloudflare also maintains a list of recognized and verified bots that includes benevolent tools like search engine and AI crawlers. You may view the list of verified bots
here, but of note, AI engines such as ChatGPT, Google Gemini, and a dozen more are already verified.
While Cloudflare does now offer the ability for websites to block AI crawlers, Dealer Inspire does not have this function enabled as indexing dealer inventory in AI search engines is valuable in this industry. Therefore, our customers do not need to take any action to continue allowing these verified AI crawlers access to their inventory listings.
Both malicious bot traffic and AI crawlers continue to evolve rapidly and having the protection of a tool such as CloudFlare to sort out the good from the bad should bring dealers peace of mind.
The use of Grok may be the core reason why this is being blocked but please let me know if you have further questions or concerns."
