• Stop being a LURKER - join our dealer community and get involved. Sign up and start a conversation.

Have you ever gone dark on a marketing channel to see what happens?

Dan Sayer

Boss
Staff member
Dec 4, 2009
472
513
Awards
7
First Name
Dan
Would that be more like not wearing deodorant to see if you actually stink (I smell like a rose) or like a major league catcher risking it all and not wearing a cup just to feel the rush:rocks:?

Either way, I've gone dark on Classified before but got scared and re-upped too soon to measure (got a better price though LOL). I've also seen inadvertent black-outs on mailers and TV because the vendor screwed up the drop or spot but the store had a good weekend regardless because they THOUGHT it was running.

Anyway, have any of you gone dark on all SEM/Dig Ad to see what happened? Curious. I feel like @Steve Stauning would know someone who has...
 
  • Like
Reactions: Steve Stauning
I've worked for a few dealers that have gone dark (a few months) to test just that. Actually, it proved to be beneficial, they killed a bunch of channels and didn't see a dent in their sales. Dealers don't want to waste money. I don't blame them. Especially with bad "SEO / Content Marketing," piss poor "Social Media Management (both organic and paid)," "Reputation Management," etc. A ton of false positives.
 
John Clavadetscher from Cars.com wrote a great article a couple years ago that included recommendations for over-riding your cognitive biases by using empirical data to drive decisions. One of those suggestions being to go dark and test. I often reference and use this article. Thanks John, if you're still out there!

Is the Marlboro Man Giving You Health Advice?
 
Back in the day, we 100% cut-out TV, Ummmm... this was probably '04 or '05ish, more a big deal back then than it would be today. Gave that budget back to the owners, never noticed a thing, except that our PVRU dropped to $250ish a unit. At 700 units a month, it added-up quick.
 
Testing this out now, not seeing any real value in a majority of 3rd party sites. We dialed back zip code/radius for leads on the others we are keeping. the 66% jump in Gurus' pricing was enough to get a cancellation letter (was underperforming at the previous rate as is).

Will see if anything needs to get re-activated after the new year.
 
I test this all the time with my clients and find more than 50% of the time, the channel was worthless and the test proved that out. To be fair, we only test this when the "old-fashioned" digital metrics (like boring leads and sales) aren't up to par or when the cost as a percent of gross is lopsided.

The key is to only test one channel at a time. First, be sure you have a good baseline measurement (like 30-60 days of good data) and then shut them off for at least 30 days. Measure throughout the month, but resist the temptation to add the channel back during the test.
 
We have had a lot of experience with dealers changing tactics, adding, canceling, etc. There are a lot of factors that come into play when testing the effectiveness of one tactic or strategy. Every dealer has a unique situation (location, brand, history, population, socioeconomic factors, etc.), so unfortunately, the experience or advice from one person (“We dropped xyz and sales increased.”) isn’t going to benefit you that much. You have to test it for yourself.

The best way to do it is to take a scientific approach. Like @Steve Stauning suggested, start with a good baseline of data that you wish to affect, but make sure you are measuring more than just that one metric. Trying to test one tactic and one KPI probably won’t give you the full picture.

Come up with your hypothesis, but only test one at a time. “Paid Search is a better investment than Cars.com” or “Car Gurus is better than AutoTrader.” Then test it.

What data should you measure?

Don’t look at sales or gross revenue. Those are lagging results, not leading indicators. Look at the activities at your dealership that contribute to the results you want.

Here are a few things to consider:
  • Total website traffic
  • Count and Percent of total traffic visiting inventory
  • Count and Percent of inventory visits that engage (this can be any combination of actions you decide, but should be more than just VDP visits).
  • Count and Percent of traffic converting into a lead (email, phone call or chat)
  • Count and Percent of leads that convert to appointments
  • Count and Percent of appointments to show
  • Count and Percent of appointments to sold
  • Total ups separate from appointments
  • Count and Percent of ups to sold

I would suggest working with at least 6 months of data, and using daily averages. This way you can see trends much more quickly.

Understand and track the variables you do control

These variables are rarely tracked over time, but can have an incredible effect on total units. It’s actually kind of amazing that we will so easily compare YOY stats without this information.

  • Product: Particularly with used cars, your inventory can change wildly from month to month, but that is rarely taken into account when understanding leads, sales and gross. You should be tracking mix and number of vehicles in stock.
  • Price: The average price of vehicles you have on the ground are going to have a huge effect on leads and sales. Knowing this can help you diagnose problems before they happen.
  • People: If the number of salespeople will directly affect the number of sales, then this is something else to track.
  • Profit: We all know that gross and volume are directly relative, yet we don’t use this as a KPI. Tracking overtime will tell a story.

How long should you test?

I would argue that 60 days is a minimum and if you really want to learn something you should test for 90 to 180 days. Just based on the consumer’s average buying timeline of 10 – 12 weeks, you need at least two months.

We make the mistake of thinking that money spent this month will activate this month. It doesn’t work that way for buyers. It may take 6 months of ad spend to activate a buyer and create a conversion.

That said, consider the other variables you can’t control:

Interest rates, lease rates, weather, unemployment rates, stock market, home sales, brand trust (think VW 2015), competitive changes (more spending, lower prices, new point, new owners), political climate, etc.

For instance, if you decide to run this test in February and have a record setting year for snow…That is probably going to skew the results. The longer you run your test, the less that things like weather can affect the outcome.

I would also go as far as suggesting that tracking some of these variables over time could help you learn about what does and doesn’t “work”.

One last recommendation…Unless you are trying to settle into a comfort zone, don’t just turn something off and pocket the money. That isn’t a growth strategy. You should be seeking more efficient and effective ways to invest your dollars.

Good luck – it’s a big task, but it’s worth it.
 
We have had a lot of experience with dealers changing tactics, adding, canceling, etc. There are a lot of factors that come into play when testing the effectiveness of one tactic or strategy. Every dealer has a unique situation (location, brand, history, population, socioeconomic factors, etc.), so unfortunately, the experience or advice from one person (“We dropped xyz and sales increased.”) isn’t going to benefit you that much. You have to test it for yourself.

The best way to do it is to take a scientific approach. Like @Steve Stauning suggested, start with a good baseline of data that you wish to affect, but make sure you are measuring more than just that one metric. Trying to test one tactic and one KPI probably won’t give you the full picture.

Does anyone have experience with a company that will help you analyze this type of info, BUT doesn't have a dog in race? typically its advertising vendors that offer to help you with this and is always biased of course.
 
Last edited by a moderator:
  • Like
Reactions: alexgauthier