About this tool
Plan an ad copy A/B test: write both variants against real platform character limits, then size the test and its run time with the two-proportion sample formula.
The Ad Copy A/B Planner works out how many impressions or clicks a two-variant copy test needs before its winner is trustworthy, using the standard two-proportion sample-size formula with a pooled null variance. Give it your current click-through or conversion rate, the smallest lift worth acting on, and your daily traffic, and it returns the sample per variant, the run time in days and whole weeks, and the media cost at your CPM or CPC. It also checks both variants against the published character limits for Google responsive search ads, Meta, LinkedIn and X.
Open Ad Copy A/B Planner on AltFTool — it loads instantly in your browser.
Fill the Test inputs panel: pick a Platform and choose Impressions (testing CTR) or Clicks (testing conversion rate). The volume and cost labels change with that choice — Daily impressions plus CPM, or Daily clicks plus CPC — and you can then set Current rate, minimum relative lift, confidence and statistical power.
Write Variant A (control) and Variant B (challenger) side by side. Each box is checked against the selected platform's first listed field and shows its own character count, limit, number, call-to-action and question diagnostics; changing copy updates those diagnostics and the Wording difference, but the sample plan depends on the numeric test inputs above.
Read Run the test for and the rows beneath it, including sample per variant, total sample, whole-week schedule, expected events, estimated media cost and the lift a 7-day test could detect. Copy plan copies a text summary, while Reset restores every field to its defaults.
Uses z(1-a/2) and z(power) quantiles in the pooled two-proportion formula, not a rule of thumb.
Rounds the run time up to full weeks so weekday and weekend behaviour are both represented.
Scores how much the two variants actually differ in wording, because near-identical copy produces a tie.
Long enough to collect the calculated sample, and never less than 7 full days. A 2% baseline with a 20% relative lift target needs about 42,000 impressions in total at 95% confidence and 80% power, which is nine days at 5,000 impressions a day.
It depends on the lift you want to detect, not on a fixed count. At a 2% baseline and 80% power, detecting a 20% relative lift takes roughly 422 conversions per variant; detecting a 10% lift takes about four times that, because sample size scales with the inverse square of the effect.
30 characters per headline and 90 characters per description, plus 15 characters for each display path segment. Meta allows 40 characters for a headline and recommends 125 for primary text, LinkedIn allows 70 for a headline, and X allows 280 for the post.
Because every extra look is another chance to cross the significance line by luck, so repeated peeking pushes the real false-positive rate well above the 5% a 95% confidence level implies. Fix the sample and the end date first, then read the result once.