- Feb 7, 2019
- 64
- 41
- Awards
- 3
- First Name
- Anthony
Running a simple "site:" test, the attached screenshot shows only one indexed page.
Sitemap: https://www.autotrader.com/sitemap.xml
Sitemap: https://www.autotrader.com/sitemap_certified_geo.xml.gz
Sitemap: https://www.autotrader.com/sitemap_new_geo.xml.gz
Sitemap: https://www.autotrader.com/sitemap_used_geo.xml.gz
Sitemap: https://www.autotrader.com/sitemap_dlr.xml.gz
Sitemap: https://www.autotrader.com/sitemap_mm.xml.gz
Sitemap: https://www.autotrader.com/sitemap_mmt.xml.gz
Sitemap: https://www.autotrader.com/sitemap_mmty.xml.gz
Sitemap: https://www.autotrader.com/index.php?sitemap=1
@Dan Sayer, do those stores subscribe to Autotrsder?@georgenenni Zero referrals to our FD sites from there but after searching the FBA site, and our VDPs, I don't see a link or CTA to "Visit Dealer Site" or the equivalent? Only our largest store had 3 leads in the last three weeks and all are from 60 to 400 miles from our dealership, which is odd.
@craigh I just sent this to FordThese guys have their robots.txt file all wrong, which is likely what happened here.
https://www.fordblueadvantage.com/robots.txt
1. They copied the robots.txt file from AutoTrader.com
2. It tells Indexing robots that the sitemap is on autotrader.com
They're basically telling Google not to index this site and to index autotrader.com instead.
Bash:Sitemap: https://www.autotrader.com/sitemap.xml Sitemap: https://www.autotrader.com/sitemap_certified_geo.xml.gz Sitemap: https://www.autotrader.com/sitemap_new_geo.xml.gz Sitemap: https://www.autotrader.com/sitemap_used_geo.xml.gz Sitemap: https://www.autotrader.com/sitemap_dlr.xml.gz Sitemap: https://www.autotrader.com/sitemap_mm.xml.gz Sitemap: https://www.autotrader.com/sitemap_mmt.xml.gz Sitemap: https://www.autotrader.com/sitemap_mmty.xml.gz Sitemap: https://www.autotrader.com/index.php?sitemap=1
@craigh it looks like they are tweaking the robots.txt file:These guys have their robots.txt file all wrong, which is likely what happened here.
https://www.fordblueadvantage.com/robots.txt
1. They copied the robots.txt file from AutoTrader.com
2. It tells Indexing robots that the sitemap is on autotrader.com
They're basically telling Google not to index this site and to index autotrader.com instead.
Bash:Sitemap: https://www.autotrader.com/sitemap.xml Sitemap: https://www.autotrader.com/sitemap_certified_geo.xml.gz Sitemap: https://www.autotrader.com/sitemap_new_geo.xml.gz Sitemap: https://www.autotrader.com/sitemap_used_geo.xml.gz Sitemap: https://www.autotrader.com/sitemap_dlr.xml.gz Sitemap: https://www.autotrader.com/sitemap_mm.xml.gz Sitemap: https://www.autotrader.com/sitemap_mmt.xml.gz Sitemap: https://www.autotrader.com/sitemap_mmty.xml.gz Sitemap: https://www.autotrader.com/index.php?sitemap=1
This is much better. It's the right site and it's at least the start of a good sitemap.@craigh it looks like they are tweaking the robots.txt file:
"Since FordBlueAdvantage.com launched in February 2021, we have seen tremendous growth compared to our CPO site, with average monthly page views up 450% and average monthly leads to dealers up over 700% year-over-year. We expect the site to continue to grow through the year. We currently have over 1,640 dealers engaged in Ford Blue Advantage." -- Ford rep, as quoted by Autotrader press relations.