Skip to content

Compare cases with similar opportunity to show an outcome

Account for unequal observation opportunities before interpreting differences in public reports as differences in performance or interest. Keep unobserved exposure unknown.

Guides

Do compared cases have the same chance to generate evidence?

A tutorial published yesterday has had less time to accumulate follow-up questions than one published months ago. Likewise, a short demonstration offers fewer opportunities to reveal a long-session problem. Compare the opportunity to observe the relevant outcome before treating different amounts of public evidence as meaningful differences between the underlying products or materials.

Example research prompt
Compare supplied tutorials for follow-up questions only after assessing publication age and visible task opportunity. Do not invent exposed-user denominators from follower totals.
01 / Guides

Define the opportunity that matters

For a tutorial review, specify whether the outcome is immediate comprehension or later task use. Include known publication age and explicitly described use duration where relevant. Exclude inferred exposure from follower totals or platform prominence; those signals do not establish who saw the tutorial or attempted the task after viewing it.

02 / Guides

Identify unequal observation conditions

Record differences in elapsed time, visible task duration and availability of follow-up discussions. Keep unknowns separate. Do not assume equal opportunity merely because two sources were retrieved in the same session; their authors, publication histories and visible reporting windows may differ in ways that directly affect the evidence the reviewer can inspect.

03 / Guides

Restrict the comparison

Where possible, compare similarly aged materials or accounts describing comparable task duration. Preserve the excluded cases in a separate evidence view. If no suitable restriction is possible, describe each case independently rather than dividing raw question counts by a guessed exposure denominator and presenting the result as a fair performance rate.

04 / Guides

Deliver opportunity-aware conclusions

State which observed differences survive the comparable-condition view and which remain entangled with unequal opportunity. Recommend additional follow-up only where it could resolve that gap. If the owner needs a rate per exposed user, explain that the available public evidence does not establish the denominator rather than substituting impressions, audience size or assumed reach for actual exposure.

Keep the boundaries clear.

  • Equal retrieval timing does not imply equal opportunity for outcomes to become visible.
  • Available records and platform badges do not establish complete source coverage.

Start with a read-only check: ask your agent to report actual source coverage before collecting records or exporting an audience.

Primary references

Documentation reviewed 2026-11-13. Product capabilities, client availability and plans can change. Third-party marks identify their products, not an affiliation.

Know what social media shows about you.
Start with a question.

Get started
montage