Three questions media measurement answers
Did it run? Delivery is the most basic question and the one most easily answered. The plan said a certain weight would run in certain placements over certain dates; delivery reports from media owners, platforms and ad servers say what actually ran. Comparing the two shows over- and under-delivery, missed placements and pacing problems.
Can we trust it? Verification asks whether the delivery claimed is real and reached the audience the plan described. For television, radio, out-of-home and print, that means the audience measurement system behind each medium. For digital, it means third-party verification of viewability, invalid traffic, brand safety and geography, and an ad server count independent of the seller's own. Invoices are then reconciled against verified delivery and the insertion order.
Did it work? Effectiveness asks whether the media changed awareness, consideration or behaviour beyond what would have happened anyway. It is the hardest question and needs methods designed for causal inference rather than delivery reports. It is also the question with the most at stake, because it decides where next year's budget goes.
The three questions build on each other. Effectiveness analysis on unverified delivery data inherits all its errors, and a delivery report on its own says nothing about effect. A measurement plan written alongside the media plan decides which question each data source answers before the campaign starts.
Delivery, verification, effectiveness
The table sets the three side by side: what each asks, its main sources and who usually owns it.
| Question | What it asks | Main sources | Owner | Where it is covered |
|---|---|---|---|---|
| Delivery | Did the media run as bought? | Seller reports, ad server, broadcaster logs, posting reports | Buyer | Post-campaign analysis, Managing a plan while it runs |
| Reach and frequency | How many people saw it, how often? | Audience measurement systems, platform reach reports, planning tools | Planner | Post-campaign analysis |
| Verification | Can the delivery claims be trusted? | Accredited audience measurement, third-party verification, invoice reconciliation, audits | Buyer and finance, sometimes an independent auditor | Auditing and verification |
| Efficiency | What did it cost against the buy? | Invoices, insertion orders, delivery data | Buyer | Post-campaign analysis |
| Effectiveness | Did it change behaviour? | Attribution, lift tests, mix modelling, brand tracking | Analytics | Choosing an attribution approach |
The first four rows sit within the media team's remit and are the subject of this section. The last row draws on them but belongs to analytics.
The core guides
The core guides cover the review of a finished buy and the proof that it ran as bought.
- Post-campaign analysis for media plans is the structured review of a finished buy against its plan: delivery line by line, ReachUnique people who saw an ad. and FrequencyAverage times a person saw an ad. achieved against the goal, cost efficiency against what was agreed, and the learnings about creative, placement and timing that should shape the next plan. It ends with a written analysis whose findings become the next plan's assumptions.
- Media auditing and delivery verification covers proving the buy was delivered as bought: the audience measurement system for each medium, third-party verification for digital, reconciling delivery and invoices against the insertion order, independent media audits, and the accreditation and standards that make a measurement claim credible.
The core guides are deliberately separate. A post-campaign analysis takes delivery figures as its input; the verification guide asks whether those figures deserve to be trusted. The media planning and buying hub shows how both close the loop back to the next plan.
Further guides
A further tutorial covers the weeks between sign-off and the post-campaign analysis:
- Managing a media plan while it runs — running a live plan: a weekly delivery check against the baseline, make-good claims, releasing the reserve and a log of every change made.
Routes to effectiveness: attribution, lift, mix modelling
Effectiveness is owned by the analytics guides, but a media planner needs to know which route answers which question, because the choice affects how the plan is built.
Attribution assigns credit for conversions to the touchpoints that preceded them. It works best for digital, click-based media where individual paths can be observed, and it struggles with broad-reach and offline media whose effects are not visible in a user path. The attribution models framework sets out the main rules, and the guide to choosing an attribution approach covers how to pick one. AttributionAssigning conversion credit to touchpoints. describes correlation along a path, not causation.
Lift testing compares an exposed group with a held-out group to measure the IncrementalityConversions caused by marketing. of a channel or campaign: what happened because of the media that would not have happened otherwise. It needs to be designed into the plan, with geographic or audience holdouts, before the campaign runs.
Marketing mix modelling (MMMStatistical model of channel impact.) uses statistical models on aggregate data over time to estimate the contribution of each medium, including offline media and longer-term effects. It needs a reasonable history of varied spend and is better at strategic budget questions than at weekly optimisation.
Most mature advertisers combine the three, using lift tests to calibrate the other two.
Measurement across offline and online media
Offline and online media are measured by different systems that were never designed to talk to each other. Television, radio, print and out-of-home rely on industry audience measurement: panels, surveys, audits and models run by joint industry bodies or accredited research companies, reporting estimated audiences against trading definitions. Digital media rely on counts from ad servers and platforms, reported at the impression level but often only within each platform's own walls.
The result is that a multi-media plan has no single source of truth for reach. Each medium reports its own reach, the overlaps between them are estimated rather than measured, and the totals use different definitions of an exposure. The Media Rating Council in the United States, and comparable bodies in other markets, accredit measurement services against published standards, which is the main assurance that a given medium's figures were produced by a sound method.
For planners, the practical response is to be explicit about which source reports each line, to use accredited measurement wherever it exists, to treat cross-media reach totals as estimates, and to rely on lift tests and mix models for the effectiveness question rather than summing platform-reported results.
A pet food brand separates its three questions
Pawsprig Pet Foods, an invented brand, runs a ten-week campaign across linear television, online video and paid social with a £600,000 budget. Delivery: the buyer confirms 96% of television ratings and 103% of video impressions ran as booked, with make-goods agreed for the shortfall. Verification: third-party verification shows 71% of video impressions met the viewability standard, and invoices are adjusted where the contract allows. Effectiveness: a regional holdout test shows a 4% lift in sales in exposed regions, which the analytics team feeds into the mix model. The planner reports all three separately, and the delivery figures are never quoted as evidence of the sales lift.
Common measurement problems
Most measurement problems show up as a familiar symptom. The table routes each to the guide that covers it.
| Symptom | Usual cause | Guide |
|---|---|---|
| No one can say whether the plan delivered | No baseline plan frozen at sign-off | Post-campaign analysis |
| Under-delivery found only after the campaign ended | No weekly delivery check against the baseline; make-goods chased at wrap-up | Managing a plan while it runs |
| Reach reported as the sum of each platform's reach | Overlap between media ignored | Post-campaign analysis |
| Invoices paid without question | No reconciliation against insertion order and delivery | Auditing and verification |
| Seller and ad server counts disagree | No agreed counting source in the contract | Auditing and verification |
| Delivery report presented as proof of impact | Delivery and effectiveness confused | Choosing an attribution approach |
| Broad-reach media look ineffective in reports | Judged by last-click attribution | Choosing an attribution approach |
| Same mistakes repeated campaign after campaign | Learnings not carried into the next plan | Post-campaign analysis |
