Comparing hybrid engagement without mixing metrics
The board wants one engagement number for the conference, and the room and the platform count different things.
The short answer
Report the two audiences with their own measures and compare them only where the measure means the same thing. A badge scan in a room and a click on a screen are different acts.
Define each metric before the event, name its source, and avoid adding numbers that do not mean the same thing, such as in-room headcount and online logins, into a single total.
Why the numbers do not add up
An in-room delegate who attends all day is counted once at registration, and perhaps again at a session scan. A remote delegate may log in and out several times, keep a tab open without watching, or join through a shared screen.
Each system records what it can detect, which is not always what the organiser means by attended or engaged.
Define each metric before the event
| Metric | In-room source | Online source | Comparable? |
|---|---|---|---|
| Registered | Registration system | Registration system | Yes, if both use the same list and definition |
| Attended | Check-in or session scan | Platform login or watch time rule | Only if you define attended the same way, for example present for a set share of the session |
| Session reach | Session scans, if used | Unique viewers per session | No, report separately |
| Questions asked | Collected in the room | Platform question tool | Partly; count both, show separately |
| Poll responses | Show of hands or device | Platform poll | Only if the same poll was run for both |
| Feedback form completion | Survey sent to both | Same survey | Yes, if the form is the same |
| Resource downloads or clicks | QR or link scans | Platform clicks | Partly; confirm both are tracked the same way |
Ask the platform supplier what it can report
- What counts as a viewer: a login, a minute of watch time or something else?
- Can watch time be reported per session and per delegate, and does it handle repeated logins?
- What does it record for shared screens or group viewing?
- What data can be exported, in what format, and who owns it?
- What delay or gap might appear in the data on the day?
Report in two parts, then compare carefully
Part one reports the room: registered, attended, session reach and feedback. Part two reports online: registered, attended by the agreed rule, watch time by session and feedback.
Part three compares only the measures that are defined the same way, such as registration and feedback completion. Say plainly what is not compared and why.
Decide the purpose of the numbers
Decide first what decision the numbers will inform: replay planning, sponsor reporting, next year's format or budget. Each decision needs different measures, and many do not need a combined figure at all.
For how this feeds replay planning, see whether replay access should outlive the conference. For sponsor reporting, see sponsor visibility across hybrid audiences.
Worked example · Fictional example
A fictional teachers' association reports its hybrid day
Fictional organisation and illustrative figures, to show the structure.
The fictional Persatuan Guru Contoh has 320 in-room registrations and 180 remote registrations. It defines attended as present for at least half of a session. 288 in-room and 117 remote registrants meet that rule for at least one session.
The report shows rooms and online separately, with registration and feedback completion side by side. It does not add 288 and 117 into a single total of engagement, because the secretariat cannot confirm that the two counts record the same kind of presence.
Use this yourself
Hybrid engagement metric definitions and report template
Copy this before registration opens, agree each definition with your platform supplier and use the same layout in the report.
- Purpose: the decisions these numbers will inform:
- Definition of registered, in-room and online:
- Definition of attended, in-room and online (same rule for both where possible):
- Source system for each metric and who supplies it:
- Session-level measures to report (reach, watch time, questions, polls):
- Feedback form: same questions for both audiences? Response rate shown per audience:
- What is compared and what is deliberately not compared, with the reason:
- Format and date of the report, and who receives it:
- Retention of the data and who owns the export:
Handle it in-house, or bring in help?
Your team can usually handle this when
- A single report to your committee with a few simple measures.
- A platform that already provides clear watch-time data.
- A registration system that tags in-room and online delegates.
Outside planning help earns its fee when
- Sponsors, members and the board each want different numbers.
- Systems are separate and nobody owns the definitions.
- The report will inform a major decision about next year's format or budget.
Want the metrics defined before the event?
A conference project lead can agree the metric definitions with your committee and suppliers before registration opens, make sure each system captures what you need, and prepare the post-event report from the supplier exports. Platform data and technical reporting stay with your supplier, and the conclusions stay with your committee.
Questions organisers ask
Can we add in-room and online attendance together?
Only if both are defined the same way. Otherwise report them separately and say what each one counts.
What is the simplest comparable measure?
Registration and survey response rate are usually the most comparable, because both audiences are given the same list and the same form.
Should we define attended before or after the event?
Before. Setting the rule afterwards makes the result look chosen to suit the outcome.
Related resources
Content record: Draft. Written from the cited sources and checked by automated rules; not yet independently reviewed.