Picture the monthly report. A new customer signed last Thursday, and the dashboard hands the whole sale to one line: a click on your search ad the afternoon before they filled in the form. Earlier in that customer's story there was a podcast episode, a colleague who mentioned your name over lunch, a comparison article and two visits to your pricing page from a phone. None of that is on the line that got the credit.
That is last-click attribution doing exactly what it says. Google's own Analytics help page on attribution describes its last-click model as giving all of a key event's value to the last channel the customer clicked through before converting. The model is honest about its rule. The trouble starts when a budget meeting treats that rule as a finding.
The usual fix on offer is a smarter model, one that spreads the credit across every touch it can see. That is a real improvement, and the free guide on AI attribution modeling lists the data you need in place before any such model works. This post is about a step that comes before all of it and costs nothing except some nerve. Before you pay for a model that divides credit more cleverly, find out whether a channel does anything at all. Pull one domino out and watch what falls.
Credit and cause are different questions
Every attribution model, from last-click to the most expensive machine learning platform, answers one question: given the touches we recorded before a sale, how should we divide the credit? It is a sharing rule. It can be a good sharing rule or a poor one, but it only works with the touches it can see, and it never asks what would have happened if one of them had been missing.
Budget decisions need that second question. When you ask whether to keep paying for retargeting, what you really want to know is how many of those sales would have happened anyway. A retargeting ad shown to someone already on their way back to your site collects credit under most rule-based models, because it sits right next to the sale. Standing next to the sale says nothing about whether the ad changed the outcome.
The name for the second question is incrementality: the sales that happened because of a channel, as opposed to the sales that merely passed through it on the way. You can estimate it with statistics. You can also measure it the plain way, by removing the channel for a while and watching.
How to run a fair pause
A pause test is crude, but it is crude in a way you can reason about, which is more than most dashboards offer. The work is in setting it up so the result means something.
- Pick one channel and write down why you suspect it. Good candidates sit close to the sale and collect a lot of last-click credit: ads on your own brand name, retargeting, coupon and deal sites, a discount email that goes to people who already have a cart open.
- Decide the length before you start. It should be longer than the usual gap between a customer's first touch and their purchase, or you will only measure the tail end of deals that were already moving. Your CRM can tell you that gap: compare the created date and the won date on your last twenty closed deals.
- Choose what you will compare against. The cleanest design is a split: pause in one region or for one product line and keep everything else running. If you only have one market, compare against the weeks just before the pause and the same weeks last year, and accept that the answer will be rougher.
- Write down the result that would change your mind. Before the pause starts, agree on the drop in sales that would make you switch the channel back on and the result that would make you cut it. Deciding afterwards is how a test turns into an argument.
- Change nothing else. A pause that overlaps a price change or a site relaunch measures both at once and tells you about neither.
Reading what comes back
Once the pause ends, the numbers will usually land in one of four places, and each of them is worth knowing.
- Sales drop clearly. The channel was doing real work. Switch it back on, and you now know its credit reflects something real, even if the exact share is still a guess.
- Sales hold. Most of what the channel was credited with would have happened anyway. That does not always mean cutting it to zero, since it may still earn its keep at a lower spend. It does mean the report was flattering it.
- Sales hold and another line rises. Pause ads on your own brand name and you may find organic clicks on that name rise to fill the gap. That is the clearest sign you were paying for customers who were already looking for you.
- The numbers wobble and prove nothing. With small volumes this is common, and it is still an answer. A model fed the same small numbers will not see this channel's effect clearly either, so be wary of any software that claims it can.
What a pause cannot tell you
I should be honest about the limits, because they are real. Some channels work slowly. A podcast appearance or a well-ranked article can keep sending people for months, so switching one off for a month mostly measures nothing. The channels that build awareness are the ones last-click undervalues most, and they are also the hardest to pause-test. For those, ask new customers where they first heard of you and read the answers every month. The post on tracking where a lead actually came from covers why those answers are imperfect and still worth collecting.
A pause also has a price. If the channel was working, you lose the sales it would have brought in while it was off. Keep the test short enough to afford and long enough to read. If you cannot afford to lose that month anywhere, the split by region or product line is the kinder design.
Direct traffic deserves a note of its own. The same Google help page says its attribution models give direct visits no credit unless the whole path was direct. So when a customer hears about you somewhere your analytics cannot see and later types your address, the credit goes to the last trackable click in the path, or to direct if there was nothing else, and the podcast that started the story never appears at all.
Where an AI attribution model fits
None of this makes attribution software pointless. If you run several paid channels with real volume, a data-driven model that updates every week is a better way to divide credit than a rule somebody picked years ago, and it is far less disruptive than switching channels off. What the pause gives you is a check on the model. Run one pause a quarter on the channel the model likes best, and see whether the real world agrees with it.
The order I would do it in: tag your links properly first (the post on UTM tagging discipline covers that dull, necessary part), run one pause on your most suspicious channel, and only then decide whether you need a platform. If you get there, the AI attribution modeling guide sets out the tracking, identity and CRM connections that have to exist first, compares Northbeam, Triple Whale, Rockerbox and GA4's data-driven model for B2B use, and includes a framework for explaining the change to a skeptical finance lead. It is a free PDF.
Whatever you decide, write the pause plan down before anyone touches a budget. One paragraph covers it: which channel, how long, compared against what, and the result that would change your mind. Pick the channel today and put the start date in the calendar.
Does your business show up when AI answers?
ChatGPT, Claude, Perplexity and Google's AI Overviews are already answering the questions your customers ask. The $49 AI Visibility Scan shows you where you're cited, where you're invisible, and the three changes that move you first — a written report in your inbox within 48 hours. If nothing in it is actionable, you don't pay.
Run the $49 AI Visibility Scan →Share this article
Comments
Leave a comment