Skip to content
Faisal Mahmud TusherDigital marketing, SEO & analytics
with Faisal Tusher

Audit Guides

Marketing Research Audit Scorecard

A scored marketing research audit: decision-led briefs, samples and screeners, questionnaires and interviews, consent, analysis, reports and their use.
Auditintermediate13 min readUpdated

Scope: what this audit covers and what it does not

The question this audit answers is whether the decisions that rest on the business's research can trust it: whether each study is tied to a decision, sampled and run soundly with consent, analysed and reported honestly, kept where it can be found and acted on, and which weakness should be fixed first. It covers the customer and market research the business runs or buys within the evidence window, from briefs to the repository, agency work, market sizes and competitor monitoring.

It does not re-teach the work, which sits in the marketing research methods section and its tutorials. The continuing rhythm is the customer research programme playbook; a single survey or session is checked before it starts with the survey launch checklist or the research session readiness checklist; one failed study is diagnosed in the marketing research troubleshooting collection.

Evidence from data rather than research, such as attribution and tests of cause, is scored by the marketing measurement audit. Usability research on pages belongs to the conversion research guides, survey scores read as service measures to the customer retention audit, the support operation to the customer service audit and controlled tests to the experiment library. Legal compliance is out of scope. Every scorecard sits in the audit library.

Before you score: access and evidence

Ask for the folder or tool where studies are kept, the recruitment records and the repository, and ask whoever owns data protection to show the consent records, which sit in a restricted log; without them the consent rows stay provisional. Fix an evidence window that includes at least one study whose findings fed a decision, and keep it for every rescore.

Collect:

  • the briefs, questionnaires, discussion guides and screeners of the studies run or bought in the evidence window;
  • the sample frames, draw records and recruitment logs, with who was invited, who took part and who was excluded;
  • participant information, consent records, incentive terms and the deletion date set for each study;
  • codeframes, analysis plans and any AI tools or prompts used to summarise transcripts or open answers;
  • the reports, readout notes and the decisions recorded after each study;
  • the research repository or wherever findings are kept, and the agency proposals and deliverables accepted;
  • the current market size workings and the competitor monitoring log.

Before reading any study, list the decisions in the window that cited research. The audit tests whether the evidence each one leaned on could bear its weight.

Criteria and scoring

Rate each row missing (absent or broken), partial (present but incomplete, inconsistent or out of date) or solid (matches the "what good looks like" column). The scale is your judgement against that column, not a number. Score a row across the studies in the window: a practice followed in some and not others is partial. Rows marked gate decide the band on their own when they score missing. A row that does not apply is marked not applicable rather than missing.

Decisions and design

CriterionWhat good looks likeScore guidance
A decision behind every study (gate)Each brief names the decision, who takes it, by when and what finding would change it, before a method is chosenMissing: studies start from a topic / Partial: no owner, date or deciding finding / Solid: all named first
Existing evidence searched firstInternal data and published sources are searched and logged with a judgement of each source before primary fieldwork is boughtMissing: fieldwork bought first / Partial: searched, not logged / Solid: logged and judged
Method fitted to the questionExploratory work finds the questions worth measuring and surveys count them, in that order unless the brief says why notMissing: surveys before any exploration / Partial: method by habit / Solid: chosen, order explained

The gate follows the guide to research design and the research brief, recorded in the research brief template. Desk research is judged against the tutorial on running a desk research pass and method against the comparison of qualitative and quantitative research. The hierarchy of evidence helps match a design to the size of its decision.

Samples and recruitment

CriterionWhat good looks likeScore guidance
Sample frame and draw recordedThe population is written down, the frame cleaned of duplicates, staff and people who must not be contacted, drawn at random within strata and recorded so the next wave can repeat itMissing: whoever is easiest to reach / Partial: draw or exclusions unrecorded / Solid: written, cleaned, repeatable
Neutral screener and quotasParticipants are described by what they recently did, screened without giving the qualifying answer away, held to quotas for each group compared and replaced only from the same groupMissing: volunteers, or the answer given away / Partial: no quotas / Solid: neutral, held to quotas
Respondents compared with the frameAfter fieldwork respondents are compared with the frame, gaps are reported, and weighted and unweighted figures are both shownMissing: never compared / Partial: gaps or weighting hidden / Solid: compared and reported
Every buying role heardWhere a business buys, each role in the buying committee and lost prospects are heard, recruited without account owners picking friendly contactsMissing: the usual contact only / Partial: picked by account owners / Solid: every role, recruited independently

Frames follow the tutorial on drawing a survey sample from a customer list and each Screener the tutorial on recruiting participants and writing a screener. The comparison is the prevention routine in the diagnosis for survey results that are not representative, and buying roles follow the guide to researching business buyers and buying committees.

Instruments and fieldwork

CriterionWhat good looks likeScore guidance
Questionnaires pretestedEvery question traces to the analysis plan, the build is read on respondents' devices, think-aloud sessions and a soft launch find problems and the questionnaire is frozen before full fieldworkMissing: no pretest / Partial: internal read only, or edited after launch / Solid: pretested and frozen
Neutral wording and orderQuestions ask one thing each without suggesting the answer, scales are balanced, order effects are considered and stated intent is not read as behaviourMissing: questions suggest answers / Partial: unbalanced scales or order / Solid: neutral throughout
Interviews about past behaviourDiscussion guides reconstruct specific recent episodes rather than ask for opinions or predictions, and interviewers probe without leadingMissing: "what would you buy?" / Partial: episodes planned, opinions asked / Solid: episodes, neutral probes
Groups and diaries used where they fitGroups are chosen only where interaction between people is the point and moderated against dominant voices, and diaries only where behaviour must be caught as it happensMissing: groups as cheap interviews / Partial: unmoderated / Solid: chosen and moderated

Pretesting follows the tutorial on pretesting a questionnaire, ending in a Soft Launch, and wording the survey and questionnaire design guide, which cites Nielsen Norman Group's articles and treats each Leading Question as the writer's bias. Interviews follow customer interviews, step by step, whose Discussion Guide is a plan, not a script; groups the guide to running a focus group; diaries the tutorial on running a diary study. Stated and revealed preference explains why stated intent is not behaviour.

CriterionWhat good looks likeScore guidance
Consent recorded for each use (gate)Participants are told every use of what they say, agree to each optional use separately, and the consent record sits in a restricted log linked by participant codeMissing: no record, or one bundled agreement / Partial: clips, quotes or re-contact not covered / Solid: each use, recorded, restricted
Research kept apart from sellingInvitations carry no offer, incentives neither bias nor bind, and answers are never used for sales follow-up without separate consentMissing: invitations sell, or answers reach sales / Partial: policy only / Solid: kept apart in practice

The gate follows the tutorial on participant information and consent, which rests on the MRS and ESOMAR codes as the research guides summarise them and applies the GDPR by agreeing each use and how long material is kept with whoever owns data protection: general direction, never legal advice. The second row follows the research methods section, where research is never a pretext for selling; the sampling and recruitment tutorials, in line with the ICO's direct marketing guidance, treat an invitation that promotes a product as marketing.

Analysis and synthesis

CriterionWhat good looks likeScore guidance
Open answers coded against a codeframeOpen answers are coded with a defined codeframe built from a sample, applied consistently, checked by a second coder and counted against a baseMissing: skimmed for quotes / Partial: no definitions, second coder or base / Solid: defined and checked
AI summaries traced to sourcesAny AI summary of transcripts or open answers is traced back to the material before it becomes a finding, and personal data is removed before material reaches a toolMissing: pasted into reports / Partial: sometimes traced, or identifiable input / Solid: traced, de-identified
Simulated respondents kept out of findingsSynthetic personas and simulated answers prepare real research at most and are never reported as what customers saidMissing: reported as customers / Partial: mixed with real findings / Solid: preparation only

Each Codeframe is judged against the tutorial on coding open-text survey answers, with the base fixed in the survey analysis plan template. AI use follows the guide to using AI for research synthesis, a use the consent tutorial says participants must be told about, and simulated answers the guide to synthetic personas and simulated respondents.

Reporting and use

CriterionWhat good looks likeScore guidance
Answer-first reports with stated limitsReports lead with the answer to the decision, show the evidence and its strength, use quotes fairly and say what the study cannot tellMissing: written in research order / Partial: limits or strength hidden / Solid: answer, evidence, limits
Decisions recorded after readoutsEach readout ends with recommendations that have owners, and the decision taken is recorded and followed upMissing: no decision / Partial: no owners or record / Solid: recorded, followed up
Findings kept in a repositoryFindings are kept as tagged records with their study, date and strength, apart from personal data, and evidence that has aged is retiredMissing: slide decks only / Partial: untagged, never retired / Solid: tagged, separate, retired

Reports follow the guide to reporting research findings, which notes that the MRS and ESOMAR codes, as the methods section describes them, expect findings reported with their methods and limits. The decision row is the prevention routine in the diagnosis for research findings not acted on, where a Decision Log shows which findings changed which decisions, and the repository follows the guide to building a research repository.

Bought and market research

CriterionWhat good looks likeScore guidance
Agency work checkedAgencies are briefed on the decision, judged on the question rather than the presentation, agree data handling and have materials and fieldwork signed off before deliverables are acceptedMissing: accepted as delivered / Partial: data handling or materials unagreed / Solid: briefed, signed off, agreed
Market sizes shown as rangesEach layer of a market size is defined so someone else could apply it, two independent routes are compared and the result is shown as a range with its driving assumptionMissing: one figure from one report / Partial: one route, or undefined layers / Solid: a range with its assumption
Competitor monitoring routineCompetitors' positioning, pricing and messaging changes are tracked from sources within ethical limits on a set rhythm and reach the people who use themMissing: when someone remembers / Partial: never routed / Solid: a rhythm, ethical, routed

Bought research follows the guide to commissioning a research agency or freelancer, which treats a supplier handling participants' data as a processor under the GDPR. Sizes follow market sizing: TAM, SAM and SOM and the market sizing worksheet template. Monitoring follows the competitive intelligence guide, which, pointing to the Competition and Markets Authority's guidance, rules out exchanging sensitive information with competitors.

How to score and prioritise

Score the two gates first. If studies start without a named decision, mark the quality rows provisional: they describe research nobody could use. If consent was not recorded for each use, stop any use participants did not agree to: the consent tutorial treats every use not listed before fieldwork as closed to the study afterwards.

Then rank the remaining weaknesses in this order:

  • Whatever makes findings describe the wrong people: unrecorded frames, recruitment of whoever answers, screeners that give the answer away and respondents never compared with the frame.
  • Whatever distorts the answers: untested questionnaires, leading wording, interviews about opinions and AI summaries nobody traced to the material.
  • Whatever stops findings being used: reports in research order, hidden limits, no recorded decision and no repository; agency, sizing and competitor practice ranked by the decisions they feed.

Within each group, a flaw in the study behind a large decision outranks the same flaw in a study nobody cited.

Reading the result: what to do with each band

Red means a gate scored missing. Hold new fieldwork until every brief names its decision and every study records consent for each use, and check findings already in circulation against what participants agreed to. Rescore on the same evidence window.

Amber means the gates hold at least partially but several other rows are partial or missing, the usual outcome. Work a short ordered list, one area at a time, and judge each fix on the next study.

Green means the gates are solid and most rows are too. Move effort into the rhythm the customer research programme playbook runs, and rescore each quarter or after each major study.

From findings to a prioritised fix list

Write each partial or missing row as a finding in plain words: what you saw, in which study, and which decision it weakened. Then build one fix list with a line per fix: the finding, the fix, the owner, the guide that explains it and the rescore date, ordered by the priorities above rather than by ease.

Group the lines by who does the work: briefs and readouts with decision owners, frames, screeners and questionnaires with whoever runs studies, consent with that person and the data protection owner, the repository with its keeper and agency terms with whoever signs the order. Show the band, the gate findings and the first fixes to whoever commissions research, and keep the full scorecard for the rescore.

Illustrative example

Illustrative example — not a real result

A pushchair maker audits its research before a range decision

Yuskeprand Prams, an invented pushchair maker, audits the 4 studies it ran or bought in the 12 months before deciding on a new range: a survey, 9 parent interviews, an agency study and a market size. The survey went to 3,000 newsletter readers and 540 answered; nobody compared them with the 18,000 customers on its full list, so the frame and comparison rows score missing. The interview guide asked parents which pushchair they would buy next, so that row scores missing too. Consent covered taking part but not the clips from 6 interviews shown at a staff meeting, so the consent gate scores partial, and the briefs named a topic, not the range decision, so the decision gate scores missing. The agency report spent its first 14 slides on method. Of the 22 rows, 1 is not applicable (it sells only to families), 8 score missing, 9 partial and 4 solid. The band is red. The fix list puts consent for each use and a brief naming the range decision first, a fresh draw from the full list compared with its respondents second, an interview guide built on recent purchases third and an answer-first report from the agency fourth. After the next study both gates score solid, 5 rows remain missing and the band moves to amber.

Common mistakes

  • Scoring the questionnaire before the brief. A flawless survey that serves no decision is still wasted.
  • Treating engaged customers as the market. Newsletter readers answer first.
  • Accepting consent to take part as consent to everything. Clips, quotes and re-contact each need agreement.
  • Trusting an AI summary or a simulated respondent as evidence. Trace every finding to real participants.
  • Judging bought research by its slides. Its quality sits in the sample, screener and pretest.
  • Counting studies instead of decisions. Many studies and no recorded decisions score worse than few acted on.

Frequently asked questions

How is this audit different from the survey launch checklist and the customer research programme playbook?

The survey launch checklist and the research session readiness checklist are ticked once, before a single survey or session starts. The customer research programme playbook runs research as a continuing rhythm of intake, recruitment, conversations, surveys and readouts. This scorecard looks back across the studies a business has run or bought in a fixed window, rates how soundly each stage was done, and ranks the weaknesses into a fix list. Use the checklists while fixing, the playbook for the rhythm and this audit to see whether either is working.

Why are the decision behind a study and recorded consent the gates?

A study with no decision behind it cannot be judged useful, however well it was run, because nothing it finds can change a plan. Research without a record of what participants were told and agreed to puts them and the business at risk, and limits what the material can be used for afterwards. Either weakness makes the quality rows beside the point, so both are scored first and fixed before anyone polishes a questionnaire or a report.

Can a small business that runs a few interviews and the odd survey use this audit?

Yes. Most rows ask whether a decision was named, a choice recorded or a document kept, not whether a research team exists. One person can write a short brief, keep a recruitment log and consent records, run interviews about recent episodes, report the answer first and record what was decided. Rows that do not apply, such as hearing every role in a buying committee for a business that sells only to consumers, are marked not applicable rather than missing.

Terms used on this page

Frameworks

Also related

Sources

  1. Market Research Society — MRS
  2. ESOMAR — ESOMAR
  3. Regulation (EU) 2016/679 (GDPR) — EUR-Lex
  4. Direct marketing guidance — Information Commissioner's Office (UK)
  5. Nielsen Norman Group articles — Nielsen Norman Group
  6. Competition and Markets Authority — GOV.UK

Related