Testing creatives on a limited budget

A cheap click is not necessarily a cheap customer. A creative test should answer one question: which message brings suitable visitors to an agreed outcome at an acceptable cost?

Agree on the outcome first

The advertiser defines the target event and approval conditions. The publisher documents the source, audience and variant labels. Compare cost per approved result; use CTR and click cost as diagnostic metrics.

Change one meaningful element

Start with two versions of one hypothesis, such as a different explanation of value with the same offer. Keep audiences, landing pages and periods comparable. Unequal platform delivery matters: normal ad rotation is not necessarily a randomized A/B test.

Do not promise guaranteed earnings or hide material terms. For restricted categories, check the applicable platform and market rules before launch.

Set the budget and stopping rules

Illustrative example: a $300 cap allocates $150 to each variant. This limits expenditure; it does not guarantee sufficient statistical evidence. Do not stop one variant simply because the other records its first conversion earlier. Define the observation period, minimum evidence and time allowed for approvals beforehand. With too little data, the conclusion is inconclusive.

Calculate after approval

If A spends $120 for 4 approved results, its cost is $30. If B spends $90 for 2 results, its cost is $45. A looks better in this small sample, but that does not prove a persistent advantage. Keep held events separate; do not compare approved events for one variant with all events for the other.

Carry learning into the next test

Record the hypothesis, variants, dates, spend, statuses and limitations. Increase budgets gradually and reassess quality. Publishers avoid scaling random success; advertisers can explain traffic requirements using concrete evidence.

Set up conversion tracking before testing the hypothesis.