The short answer
A landing page smoke test describes a product that does not exist yet and measures whether real visitors take a meaningful action, such as joining a waitlist, choosing a price plan or requesting access. It tests whether your message and offer attract interest from a specific audience. It cannot prove people will pay or keep using the product, and small samples easily mislead.
On this page (8)
What a smoke test is, and what it is for
The name comes from hardware testing: switch it on and see if smoke comes out. In product terms, you put up a page describing the offer as if it were available, send targeted traffic to it, and watch what visitors do. A fake-door test is a close relative, usually inside an existing product: a button or menu item for a feature that is not built yet, which records clicks and then explains that the feature is coming.
Smoke tests are good at answering narrow questions. Does this audience respond to this problem framing? Which of two value propositions gets more sign-ups? Does showing a price kill interest entirely? They are a cheap way to compare messages and audiences before committing to building. They work best after you have done customer interviews, so that the page uses language real customers actually used.
Building the page
- Headline — State the outcome for a specific person, in their words. 'Match every cleaning job to its payment in minutes' beats 'Smart finance for modern businesses'.
- Problem and workaround — One short paragraph naming the pain and the current workaround, so the right visitors recognise themselves.
- How it works — Three plain steps. Avoid screenshots of a product that does not exist; a simple diagram or description is more honest.
- Price — If you can, show an indicative price or plans. Interest with a price attached is far more informative than interest without one.
- One call to action — 'Join the early access list', 'Request an invite' or 'Choose a plan'. One clear action makes the result easy to read.
- Follow-up step — After the click, explain honestly what happens next, and optionally ask one or two short qualifying questions.
What to measure
Decide what you will measure, and what result would change your mind, before you send any traffic. Otherwise any number can be rationalised as encouraging.
| Metric | What it measures | Strength of signal | Watch out for |
|---|---|---|---|
| Click-through from ad or post | Whether the headline grabs attention | Weak | Curiosity clicks from the wrong audience |
| Waitlist sign-up rate | Interest strong enough to share an email | Moderate | Free sign-ups cost the visitor almost nothing |
| Pricing plan click | Interest at a stated price | Stronger | Clicking a plan is still not paying |
| Qualifying answers completed | Effort the visitor will invest | Stronger | Fewer responses, so smaller samples |
| Reply to a follow-up email | Willingness to engage with a person | Strong | Slow to collect and hard to scale |
| Deposit or pre-order | Willingness to commit money | Strongest | Requires honest refund terms and real delivery intent |
Honest disclosure
A smoke test should never take money or personal details under false pretences. Visitors who click should be told promptly and plainly that the product is not available yet, what you will do with their email, and whether and when they will hear from you. A short message such as 'We are not live yet. Leave your email and we will contact you once early access opens; we will not use it for anything else' is enough.
If you take a deposit or pre-order, the page must say clearly that the product is in development, give an expected timeframe, and explain how refunds work. Make refunds easy and fast. Check the consumer protection and data protection rules that apply where you and your visitors are; this guide is not legal advice. Treat the people who sign up as your first potential customers, because that is what they are.
Sample size: why small numbers lie
This is where most smoke tests go wrong. Suppose, as an illustration, that page A gets 6 sign-ups from 100 visitors and page B gets 10 from 100. B looks two-thirds better, but with numbers that small the difference could easily be chance. Run the same test again next week and the order might flip.
Before declaring a winner between two versions, check whether the difference is statistically meaningful with the A/B test significance calculator, and plan how many visitors you need beforehand with the sample size calculator. If the required sample is far more traffic than you can afford, accept that the test can only detect large differences, and treat small gaps as no result at all.
Traffic source matters as much as volume. Visitors from a tightly targeted community or ad audience tell you about that audience; visitors from a general launch site tell you about curious browsers. Mixing sources in one test blurs the result. Keep a note of where every batch of traffic came from.
What a result does and does not mean
- A strong result means — This message, shown to this audience, at this price, generated interest. That is a reason to go deeper: contact the sign-ups, interview them and ask for a stronger commitment.
- A strong result does not mean — People will pay, stay, or recommend the product. A sign-up is the cheapest possible commitment, and many will not respond when you follow up.
- A weak result means — This page did not persuade this traffic. The problem could be the headline, the audience, the price, the channel, or the idea itself.
- A weak result does not mean — The idea is definitely bad. Before abandoning it, check whether the traffic was the right people and whether the page used customer language.
- Any result is strongest when — It is consistent with what you heard in interviews. A smoke test that contradicts ten interviews deserves suspicion in both directions.
Your action checklist
0/7 doneSaved in this browser only. Nothing is sent anywhere.
Questions
What is a good conversion rate for a smoke test?
There is no universal benchmark worth trusting, because conversion depends heavily on the audience, traffic source, price and how much the action asks of the visitor. A more useful approach is to set your own threshold in advance, based on what you would need for the business to work, and to compare versions against each other with enough traffic to be confident.
Is a fake-door test ethical?
It can be, if it is honest. Tell visitors promptly that the product or feature is not available yet, explain what happens to their details, and never take money without clear disclosure and easy refunds. Problems arise when people are misled about what exists, charged for something that may never arrive, or added to marketing lists they did not agree to join.
How much traffic do I need for a landing page test?
It depends on how big a difference you want to detect. Detecting a large difference needs far fewer visitors than detecting a small one. Use a sample size calculator before you start to estimate the number, and if that number is out of reach, design the test to look only for large effects rather than over-reading small gaps.
Should I use a waitlist or ask for payment?
A waitlist is easier to run and gathers more responses, but it is a weak commitment. Asking for a deposit or pre-order gives a much stronger signal, at the cost of fewer responses and a duty to deliver or refund promptly. Many founders run a waitlist first, then contact sign-ups individually and ask the most interested for a paid commitment.
Terms in this guide
Finished? Mark it so your paths and the library remember.