Event qualitative evidence collection
The survey comments are full of useful detail, and nobody has agreed how to turn them into evidence.
The short answer
Qualitative evidence is what people say and what you observe, gathered on purpose and sorted by theme. It explains why numbers look the way they do, and it needs a method so it is not just the best quotes.
Decide the questions, who is asked, how consent is handled and how comments are grouped before collection starts. Report themes with counts of how many people raised them, and label the whole as reported, not measured.
Ask a question that the evidence can answer
Link each qualitative question to an objective in your objectives-to-evidence map. For example, why did afternoon attendance fall, or what did members find hardest to apply.
Avoid leading questions. Ask what happened, not whether it was excellent.
Methods that suit professional events
| Method | Good for | Limit |
|---|---|---|
| Open comment box in the survey | Breadth, low effort | Short answers, self-selected |
| Short interviews with 5 to 8 people | Depth on one question | Not representative, needs time |
| Facilitator or session-chair notes | What happened in the room | Observer's view |
| Staff and supplier debrief | Operational causes | Internal perspective, state it as such |
Consent, privacy and quoting
- Tell people how comments will be used and whether quotes may be published.
- Remove names and details that identify a person or company before comments leave the working team.
- Ask the privacy owner about notice and retention for interview notes.
- Do not quote critical comments in a way that exposes junior or unnamed staff.
From comments to themes
- Read all comments once without sorting.
- Draft five to eight theme labels and sort each comment under one.
- Count how many people raised each theme, and note how many responded in all.
- Pick one or two quotes per theme that represent the group, not the loudest voice.
- Flag themes backed by one person only as single mentions.
Worked example · Fictional example
Free-text comments from a member forum
Fictional organisation and figures, illustrative only.
A fictional professional body received 64 free-text comments from 181 attendees. Sorting them gave six themes. Eleven people mentioned the afternoon room being too far from the main hall, and nine wanted longer discussion time.
The report lists the themes with counts, shows one representative quote for each, and states that comments came from about one in three attendees. It treats the room comment as a lead to check against the floor plan, not a proven cause.
Use this yourself
Qualitative evidence collection plan
Copy and fill before the event so questions and consent are ready.
- Objective each question serves:
- Question wording (neutral):
- Who is asked and how they are chosen:
- Method and who runs it:
- What attendees are told about use and quoting:
- Privacy owner's confirmation of notice and retention:
- Theme labels (draft) and who codes:
- How quotes are chosen and anonymised:
- How findings will be labelled in the report:
Handle it in-house, or bring in help?
Your team can usually handle this when
- There is one open comment question and one person reads the replies.
- The audience is small and comments are low-risk.
- Findings are for an internal debrief.
Outside planning help earns its fee when
- Interviews or sensitive topics are involved.
- Several people code comments and results are inconsistent.
- Findings will go to a board, funder or the public.
Want comments turned into evidence others can trust?
A recurring programme manager can set the questions, consent wording and theme labels once, then apply them each edition so findings can be compared. For a single event, a conference project lead can coordinate collection, the privacy questions and the write-up with the committee.
Questions organisers ask
How many comments do we need?
There is no fixed number. State how many people responded and who may be missing, and avoid generalising from a handful.
Can we publish attendee quotes?
Only if people were told at collection time and agreed, and with identifying details removed.
Is positive feedback enough as evidence?
It is useful, but it needs to be tied to an objective and shown alongside other evidence, including critical comments.
Related resources
Content record: Draft. Written from the cited sources and checked by automated rules; not yet independently reviewed.