Why this matters
The danger here is a test that reads correctly and still rewards the wrong thing: pressure devices win on the immediate rate, and their cost arrives later as cancellations, refunds and complaints. The guide to honest persuasion gives the three questions and the guardrails, and the guide to designing pricing pages gives the page its jobs: who each option suits, an intended choice that does not steer, and the complete cost. Prices stay fixed; only their presentation changes. Guardrails come from the intermediate CRO level.
The hire firm and its booking pages
Yewdrisk Campervans is an invented campervan hire firm taking bookings online: dates, a prices page, extras, payment. After complaints, the owner wants an audit before the season.
Yewdrisk Campervans: devices, prices and last season
| Device | Where | What the systems show |
|---|---|---|
| "Spring offer ends in" countdown | Prices page | Restarts for each visitor; the offer runs all season |
| "Only one van left" | Every date search | Typed into the template; the fleet system shows several vans free for most dates |
| Excess waiver, £18 a night | Pre-ticked in the booking summary | Optional |
| Cleaning fee, £60 a hire | First shown at payment | Compulsory |
| Cancellation | A link in the confirmation email only | Free until a set number of days before pickup |
| "Easter bookings close on the date shown" | Prices page | Taken from the handover schedule, and kept |
| Van | Sleeps | Nightly rate, mid-season | Share of last season's bookings | Current page |
|---|---|---|---|---|
| Two-berth | 2 | £95 | 58% | "From £79 a night", the low-season rate |
| Four-berth | 4 | £125 | 34% | — |
| Four-berth with shower | 4 | £165 | 8% | Highlighted "Best choice" |
Last season: 1,240 bookings, 96 requests to remove the waiver after booking, 41 complaints about the cleaning fee and 130 emails asking how to cancel. An agency's test of the pre-ticked waiver read revenue per booking on the day of booking only. Date-search visitors in season: about 4,000 a week.
Three questions for every device
Is it true? Would the customer choose it if asked? Does the experiment measure the harm? Fail the first and the device is removed, not tested; fail the second and the default changes; and any test of what remains carries the delayed harms as guardrails.
Task
- Put every device through the three questions and decide: remove, fix or keep.
- Rebuild the prices page: what each van card says, its price for a sample stay, the intended choice and the call to action.
- Explain why last season's waiver test reached the wrong answer.
- Design one test on the rebuilt page: the question, arms, primary metric, guardrails, duration and reading horizon.
Worked answer
The audit.
| Device | True? | Would the customer choose it? | Decision |
|---|---|---|---|
| Restarting countdown | No: the offer has no end | — | Remove; show the season's prices as they are |
| "Only one van left" | No: not from the fleet system | — | Remove now; a live count is a candidate to test |
| Pre-ticked waiver | The offer is real | No: removal requests show many did not | Untick; explain the excess and the cover in plain words, price beside |
| Cleaning fee at payment | A compulsory charge, hidden | — | Include in every price shown |
| Cancellation in an email | True terms, hidden route | No one would choose a hidden exit | Terms on the prices page; a cancel route in the booking as easy as booking |
| Easter deadline | Yes, from the schedule | Yes | Keep |
None of these is tested: an untrue ScarcityA persuasion device that tells buyers stock, places or time are limited, prompting a decision; it must be true to be fair to customers. claim, a paid extra selected by default and a hidden compulsory fee are not variants.
The prices page. Each card leads with who the van suits ("Two adults, touring", "A family of four", "A family of four who want their own shower"), then the price for the visitor's dates including the cleaning fee, with the nightly rate beside it and the waiver shown as an optional extra. The recommendation goes to the van that fits the main segment, not the one with the highest margin: the two-berth, labelled with the buyer it suits. Each card's CTAThe prompt that tells a reader the one action to take next, such as a button or link. says what happens next, such as "Choose this van for your dates". Cancellation, the excess and what happens if pickup is late sit in a short answers section beside the cards, as the trust and proof guide places policies next to the decision.
Complete costs for a five-night mid-season stay
| Van | Hire | Cleaning | Price shown | With the optional waiver |
|---|---|---|---|---|
| Two-berth | 5 × £95 = £475 | £60 | £535 | £535 + 5 × £18 = £625 |
| Four-berth | 5 × £125 = £625 | £60 | £685 | £775 |
| Four-berth with shower | 5 × £165 = £825 | £60 | £885 | £975 |
The old headline, "From £79 a night", matched none of these: a low-season rate without the compulsory fee.
Why the waiver test misled. It measured the number pressure works on, revenue at booking, and stopped before removal requests, disputes and complaints arrived. A pre-ticked extra wins that test by design.
The test. One honest device has an uncertain effect: a live availability message drawn from the fleet system for the selected dates and van, against no message. Both arms run on the rebuilt page with complete prices. Assign by visitor and hold them in their arm on every return, as the billing period default test does for a similar repeat-visit decision. The primary metric is hire value per date-search visitor, net of cancellations and refunds; each Guardrail MetricA metric an experiment must not worsen beyond an agreed bound, watched beside the primary metric that decides the test. gets a limit in advance: cancellations, complaints mentioning availability, waiver removals and card disputes. Read once, after the free-cancellation period has passed for every booking in the test.
Can the season carry the test?
The team's sample-size calculation asks for about 20,000 date-search visitors per arm. At about 4,000 a week: 20,000 × 2 ÷ 4,000 = 10 weeks of entries, then a wait for the cancellation window to close on the last bookings. It fits the season if entries open early. If they open late, the cancellation window on the last bookings runs past the season and the result arrives after the decision it was meant to inform.
Common mistakes
- Testing the countdown or the stock badge. Untrue claims are removed, not tested.
- Unticking the waiver and hiding it. Offer it plainly, with its price and what it covers.
- Showing the nightly rate as the price. The price includes every compulsory charge.
- Recommending the premium van. Choose the highlighted option by fit with the main segment.
- Reading the test at booking. Hold it until cancellations and refunds have had time to arrive.
The conversion strategy capstone follows and brings the whole level together.
