Check the Plumbing Before You Touch the Strategy

When a new channel or market underperforms, the conversation almost always jumps straight to strategy. Wrong audience? Wrong creative? Wrong budget split? Everyone has a theory, and every theory is about what to change next. Almost nobody starts with the question that has to be answered first: can the numbers that started the conversation actually be trusted?

It's an unglamorous question, which is partly why it gets skipped. It's also the first one Halo asks. A performance problem and a trust-in-the-data problem look the same from the outside: a number is disappointing, and someone wants to fix it. The difference only shows up once the plumbing has been checked, and by then it's expensive to have acted on the wrong one.

Same symptom, three different faults

A regional placement and in-home care provider had just launched a second market, and it was underperforming. The relationship with the account had narrowed to launching campaigns and reacting to issues. The usual reading was available: ordinary growing pains, the kind more spend or sharper creative is supposed to fix. Instead, the first piece of work was checking whether the numbers meant anything. They didn't, yet. Tracking parameters were passing placeholder values. Form-to-CRM data was inconsistent. Scripts were interfering with attribution. Tracking was fixed before any performance call was made, because optimising against numbers that can't be trusted isn't optimisation. It's guesswork with a dashboard. Full story on From Reacting to Leading.

A specialist architecture firm's search campaign had the opposite fault. Instead of hiding good news, the data was manufacturing it. A CAPTCHA-related tracking bug had been counting conversions that weren't real. Correcting the record meant admitting the channel was performing worse than it looked, which is never a comfortable conversation, but the alternative was building a strategy on results that hadn't happened. The full story is on We Told the Client the Market Was Too Small, and the "good number" side of it is covered in Some of Your Best Numbers Might Not Be Real.

A high-spend rehabilitation facility had a third version. Nothing was broken. The data simply hadn't been read. The client had been sending structured verification and admission data every month, and nobody had turned it into anything a decision could rest on. Once someone did, the picture reversed the obvious call: some of the expensive campaigns were producing verified admissions, while some of the cheaper leads stalled at the first verification step. That's the story behind "We Don't Have the Data" Is a Claim Worth Checking.

Three businesses, three different faults: numbers that meant nothing yet, numbers that flattered, numbers that had never been read. What they shared was the order of work. In each case the first move was to find out what the measurement could honestly support, and only then to judge the performance sitting on top of it.

Why the order matters

This is the first stage of Halo's Master Framework doing what it says. Observe comes before Diagnose for a reason: you can't diagnose friction in a system you're only seeing through a distorted lens. In the language of the Commercial Leakage Framework, the diagnostic question for Decision & Reporting Systems is whether leadership has one trusted number per key metric, or several versions of the same one. If the honest answer is "several," then every conversation about performance is really a conversation about which version to believe.

Getting the order wrong doesn't just waste effort. It can push a business to act on the wrong problem with real confidence. Cut the campaign that was actually producing the best admissions. Scale the channel whose conversions weren't real. Replace a strategy that was never the problem. Each of those decisions would have looked reasonable against the number in front of everyone, which is exactly the danger.

The same discipline shows up in what the placement provider engagement chose not to do. Once the tracking could be trusted, the client's own parallel test platform was assessed just as honestly, and scaling onto it was held off until its maturity problems were resolved. That's the logic from Fixing the First Constraint Isn't the Finish Line applied in advance: don't scale onto anything you haven't checked.

A short pre-check before judging any channel

Before anyone decides a channel, market, or campaign is failing (or succeeding), these are worth asking:

• Can you trace one lead from click to CRM to outcome? If a single, real example can't be followed end to end without someone saying "it should be in there somewhere," the chain isn't trustworthy yet.
• Do the fields hold real values? Placeholder text, blank parameters, and inconsistent form-to-CRM entries are quiet signs the numbers are describing the tracking, not the customers.
• Is any good news too good? A sudden run of conversions deserves the same scrutiny as a sudden drop. Both can be artefacts.
• What data is already arriving, unread? Before asking for new tracking, check what a client, partner, or system already sends on a regular cadence and whether anyone has actually read it closely.
• What would you decide differently if the number were wrong? If the answer is "a lot," that's the number to verify first.

Checking the plumbing isn't a delay before the real work. It's the first piece of it.

None of this means strategy doesn't matter. It means strategy is only as good as the evidence it's reacting to. This is the same test Halo applies to reporting in general, covered in Does Your Reporting Actually Change Any Decisions?: a number that can't be trusted can't change a decision well, however carefully it's presented. And it's why a disappointing result is often the right time to ask the unexciting question first, as in Marketing Problem vs. Commercial Problem. The sequence Halo follows is laid out in The Seven-Stage System Behind Every Halo Commercial Diagnostic.

If a channel in your own business is underperforming and nobody has yet checked whether the numbers describing it are real, a Commercial Diagnostic is a focused way to find out which kind of problem you actually have before anything gets changed. A Commercial Audit goes further and scores every commercial pillar on evidence quality, performance gap, and commercial leverage. More on the thinking behind this is on About, or get in touch directly.

What people ask about trusting their numbers.