Set your pass mark before you spend

When a test finishes without an agreed pass mark, the result becomes a negotiation. The person who proposed the idea sees promise; the person paying for it sees cost. Both can point to a number that supports them.

The fix is simple and slightly uncomfortable: write down, before launch, the result that counts as a win. Once that's signed off, the data makes the decision — not the loudest voice in the room.

A useful threshold has three parts:

• The deciding metric — for example, cost per qualified lead.
• The level it must reach — for example, at or below your current average.
• The conditions — the minimum run time or sample size before anyone reads the result.

The right threshold comes from your numbers, not from what would feel exciting. If you know what a customer is worth and how many leads become customers, you can work out the most you can afford to pay for a lead. That's your ceiling; the pass mark sits safely beneath it.

If you don't know those numbers yet, finding them is the first piece of work — because without them, no test can tell you whether growth is profitable.

Early results swing. A test that looks like a clear winner after three days often settles back to average by the end. That's why the run time is part of the pass mark: nobody reads the result until the conditions are met.

It feels slow. It's much faster than scaling a false winner and spending a quarter finding out.

A test that fails its pass mark isn't wasted — provided you log what you believed and why it didn't hold. Over time, that record of disproven beliefs is one of the most valuable things a marketing team owns.