The idea, in plain English
Start here.
A transparent AI visibility test uses relevant questions, a recorded setup and saved answer evidence. Define what counts as a mention or an owned citation before scoring. Report the numerator, denominator and missing observations. The resulting rate describes your collected sample; it does not measure all customer questions or prove that a content change caused an improvement.
A dashboard says ‘75% visible.’ That number is difficult to use until you know visible where, for which questions and out of how many answers. You can build a more useful beginner test with a small observation sheet and explicit limits.
A few words you’ll meet.
OPEN WHAT YOU NEED ↙Prompt set
The versioned collection of questions selected for the test, with the reason each question belongs.
Observation
One recorded answer attempt under a stated product, mode, date and context. A failed attempt is still a record, but not a successfully inspected answer.
Denominator
The total used under a rate’s counting rule. State whether it means evaluable answers, unique questions or something else.
Owned citation
For this exercise, a displayed reference to the organization’s own website. This is a chosen coding rule, not a universal industry metric.
Select questions for a real purpose
Start with the reader or customer tasks you want to understand. Use real questions where available and label invented practice prompts as ideas. Keep branded questions separate from category questions: explicitly asking about a business makes its appearance mean something different from being named in a broader comparison.
Record the exact wording, purpose and prompt-set version. Choose a manageable collection that covers the tasks you can actually review. There is no universal number of prompts that turns a convenience sample into a representative survey. If you later add questions, preserve the old version so a changed mix is not mistaken for a visibility change.
Write the counting rules before collecting answers
Decide what counts as a mention, an owned reference and an answer you can evaluate. For this lesson, a mention means the organization is explicitly named in the saved answer; an owned citation means at least one displayed reference points to its website. A repeated name in one answer still counts once for the answer-level mention measure.
Record the product, mode, date, market/language context you can establish, prior conversation and collection method. If a field cannot be observed, say unknown. Keep source verification and factual accuracy as separate notes; a positive appearance can still contain a wrong detail. Do not silently turn a passing mention into a recommendation.
Five attempts. Four answers to evaluate.
Show the count behind the percentage
Keep every attempt, including answers with no mention and failures to collect an answer. Under a stated rule, an evaluable answer with no mention belongs in the denominator. An access failure does not establish absence in an answer you never inspected. Report it separately rather than deleting the record or calling it a negative answer.
In the fictional exercise below, three of four evaluable answers contain a mention: 3 ÷ 4 = 75%. Two of those four contain an owned citation: 2 ÷ 4 = 50%. One additional attempt failed. Those are arithmetic summaries of the supplied records, not market estimates, traffic figures or evidence that a method worked.
Keep comparison, interpretation and action separate
Repeat a stated method if you want to compare collection windows. Preserve dates, prompt-set versions, product/mode changes and missingness. A stable method helps interpret differences, but does not freeze the platform or remove every outside influence. A before/after increase alone cannot isolate the effect of a rewrite.
Use the records to choose inspectable actions: verify an inaccurate business detail, improve an ambiguous source page or investigate an access problem. Keep manual answer observations separate from Google’s current Generative AI Search impression report, recorded website referrals and actual outcomes. Report what each dataset measures and what you could not observe, instead of combining them into one unsupported score.
Five fictional attempts, four evaluable answers
All records belong to one fictional practice setup and one prompt-set version. They are not live observations. Mention and owned-citation rates below use evaluable answers as the denominator.
| Attempt | Answer record | Coding |
|---|---|---|
| R1 | Organization named; owned source displayed | Mention yes / owned citation yes |
| R2 | Organization named; no owned source displayed | Mention yes / owned citation no |
| R3 | Organization not named; third-party source displayed | Mention no / owned citation no |
| R4 | Organization named; owned source displayed | Mention yes / owned citation yes |
| R5 | No answer collected: access failure | Not evaluable; failure retained separately |
Put it into practice
Calculate and qualify the sample
Use R1–R5 above. A colleague proposes reporting 100% visibility because they saved only the three positive answers.
- Count all attempts and all evaluable answers separately.
- Calculate answer-level mention and owned-citation rates under the supplied rules.
- Explain how R3 and R5 are treated differently.
- Write a headline containing the raw counts and fictional scope.
- State one comparison limitation and one useful next action.
Keep your working notes in your own document. This page saves only your completion check, not your answers or customer data.
Check your understanding
Make the call.
Choose an answer for each question. Then compare the reasoning.
You have a useful next step.
- Freeze and document the question set and counting rules.
- Retain answers with no mention and report failed attempts.
- Show counts, denominators and limits beside the rate.
Completion is your own learning record. Quiz scores and practice checks are saved separately, on this browser.
Sources & context
The sources below explain the factual foundations and editorial methods used in this lesson. Worked examples, planning models and exercises are illustrative teaching material.
- Geolyze: How to measure AI visibility
Secondary capture-field and denominator workflow; causal conclusions and universal cadence prescriptions are not adopted.
- Google: Generative AI performance report (Search)
Primary impression-report scope, kept separate from this manual fictional answer sample.
