Is Your Agency Measuring the Wrong Thing For 2027?

This post was sponsored by WebPros. The opinions expressed in this article are the sponsor’s own.

Your client opens the monthly report. Rankings are up and the target terms sit on page one. Organic traffic is holding steady. Then the question lands: “So why are fewer good prospects reaching us?”

The instinct is to defend the rankings. The better answer is to admit the report measures the wrong thing, or more precisely, the right thing about a game that is no longer the only one in play.

Three questions are missing from that report. Is the client included when AI tools answer relevant questions? Is the business described accurately? And when a buyer asks for a recommendation, is the client actually the pick?

What AI Search Visibility Measures That Rankings Don’t

A ranking is a position in a list. The user still has to scan the options and choose one.

An AI answer isn’t a list, it’s a verdict. The model has already scanned and compared, and by the time the user reads the response, the shortlisting may already be done. You did not necessarily lose the click. You may never have been in the running to receive one.

The click did not just get harder to win. For a growing share of queries, it stopped being an available prize.

Citation Share Is Becoming The New SERP Ranking

A citation and a recommendation are different things. A model can name you as one of five options while steadily recommending a competitor, or cite you to describe the category and then point elsewhere for the solution.

A mention is different again. You can appear in the answer without earning a citation, and you can earn a citation without being presented as a suitable option.

Mention frequency, reported on its own, is a vanity number wearing new-technology clothes. Agencies that spent the 2010s learning not to celebrate raw ranking positions are about to relearn the lesson with citations.

The answer is not to drop citation share. It is to stop treating it as a finish line and start treating it as the first of three gates.

How To Measure AI Search Visibility: 3 Gates

The useful way to read an AI answer is through three gates. Each tells you something different, and each needs its own measurement.

Gate 1: Inclusion. Are You Named Or Cited?

Are you in the answer at all?

Brand mentions and citation sources live here. A model that never surfaces you makes everything downstream moot. Inclusion buys a seat in the conversation and nothing more.

Check: Take a defined set of questions relevant to the client’s business and run them across the AI platforms being monitored.

Record: Track brand mentions and website citations separately, each as a share of all tested responses. If the client appears in 12 of 40 responses, the observed mention rate is 30%. That tells you something about the tested questions, not about every AI search in the market.

Act: Review the assets the model cites, whether documentation, service pages, or third-party reviews, to identify what to investigate and potentially reinforce.

But do not mistake a citation for an endorsement. The model may use your client’s article to explain an industry problem and recommend someone else to solve it.

Gate 2: Framing. Is The Description Accurate?

Once you are in, does the model describe you correctly?

This is brand understanding, and it is the most underrated of the three. The model decides more than whether to name you. It decides what to say you are.

A technically accurate citation that frames you as a budget option or yesterday’s incumbent can cost more than being left out.

Consider a B2B software company that has expanded into enterprise customers but still has older product pages describing it as a tool for freelancers. An AI answer may repeat that positioning when an enterprise buyer asks for recommendations. The company appears in the conversation but loses relevance before the buyer ever reaches its website.

The source of that framing error may be an outdated product page, an old comparison article, or conflicting descriptions across the web. The point is to find it, not simply count the mention as a win.

Check: Compare AI-generated business descriptions with verified product facts.

Record: Save each exact description and flag what is outdated, missing, or incorrect. Calculate framing accuracy as the share of evaluated brand descriptions that are accurate, not as a share of all tested answers.

Act: Trace the likely source where possible, then correct outdated product pages or conflicting descriptions that the client can change.

Gate 3: Endorsement. Are You Recommended For The Buyer’s Need?

When it counts, are you the pick?

This gate measures whether the client is explicitly recommended on decision-stage questions, alongside the competitors recommended in those answers. It is the gate closest to the buyer’s choice, not proof of a sale.

A brand can clear inclusion and framing and still lose here on the questions that decide a sale. This is the gate worth fighting over.

The distinction is easiest to see when you compare answers side by side.

Ask an AI tool to recommend software for a 10-person marketing agency. It mentions the client’s product, describes its features accurately, then recommends a competitor because it considers that competitor better suited to small teams.

Inclusion passed. Framing passed. Endorsement failed.

That tells the agency more than an increase in citation share ever could.

Check: Use questions that reflect actual buying decisions, not just informational searches.

Record: Note whether the client is explicitly recommended, which competitors are recommended, and the reasons given. Report the client’s recommendations as a share of all tested decision-stage answers, with the same calculation for each rival. More than one brand can be recommended in an answer.

Act: If the competitor wins because its positioning is clearer, investigate the client’s positioning. If the recommendation rests on an outdated feature comparison, identify and correct the information where possible.

Organic visibility and long-term trend lines do not vanish in this model. They run alongside it as the traditional baseline.

The three gates are distinct measures, not a conversion funnel. A rising citation count alongside falling endorsement share can signal trouble rather than progress.

Keep Your AI Search Measurements Comparable

There is a catch. AI answers are not fixed search results.

Ask the same question on different days, in different markets, or through different tools, and you may get different recommendations. Sometimes even repeated runs produce different answers.

That makes measurement discipline more important, not less.

An agency cannot claim that visibility improved because a brand appeared in eight answers this month and five last month if the underlying questions changed.

Keep the prompt set, market, language, AI platform, measurement dates, and number of repeated runs documented. And always show the denominator.

Eight mentions across 20 responses is not the same as eight mentions across 100. Neither number means much without knowing the questions being asked.

The same applies to framing and endorsement. An improvement in recommendation share matters only when the comparison is built on a consistent set of relevant, decision-stage questions.

The goal is not a perfect universal AI visibility score. It is a consistent measurement that shows what changed and gives the agency something useful to act on.

Connect AI Visibility To Business Outcomes

Keep three business signals separate when you compare them with AI endorsement trends:

• Branded search movement.
• Identifiable AI referrals.
• Leads or sales associated with those channels.

Branded search also rises with PR, paid campaigns, and seasonality, so read it as a trend to compare with endorsement share, not as simple attribution.

Research on subsequent website visits provides context, not proof that endorsement increases branded search. A Similarweb study on what happens after AI recommends a brand found that users who saw a brand recommended by ChatGPT were more likely to visit that brand than its competitor within seven days.

When ChatGPT recommended American Express, 7.2% of users subsequently visited its website, compared with 3.1% who visited Capital One. When Capital One received the recommendation, 14.2% visited its website, compared with 3.8% who visited American Express.

The study used an opted-in US desktop panel from July–December 2025 and selected consumer brands, so the findings may not hold for smaller or B2B businesses. It is a useful signal, not a universal benchmark.

AI referral traffic is another signal. ChatGPT, Perplexity, and Gemini do send visits, and GA4 can show identifiable referrals. In Ahrefs’ opt-in Web Analytics panel, AI assistants accounted for less than 1% of site traffic in September 2026. That measures traffic received by the participating sites, not the percentage of AI-tool usage that sends an outbound click.

Track it, but do not expect it to tell the whole story.

A buyer who sees a recommendation in an AI answer may search for the brand on Google afterward. That visit appears in search reporting, not necessarily as an AI referral.

If endorsement share rises, branded search follows, and qualified leads increase, there is a useful story to investigate. There is not yet proof that the first caused the other two.

That distinction is worth making explicitly. Clients do not need inflated attribution claims. They need an informed view of where demand may be coming from and whether their visibility is improving on the questions that matter.

Show Clients What Changed And What Happens Next

A useful report needs three things: the observation, the interpretation, and the next action.

Sample client report: Illustrative figures, not actual customer results

The example assumes comparable question sets and measurement conditions across both periods.

Notice what the report does not say. It does not claim that the increase in mentions generated the additional branded searches. It does not describe citation growth as a commercial win without checking endorsement.

Riva approaches the problem from a related but different angle. It evaluates whether AI systems can access a business’s website, understand its business and individual offerings, and surface those offerings against competitors.

Its measurement includes technical accessibility, information completeness, and offering-level visibility. The AI Visibility Score measures an offering’s visibility relative to competitors in the tested queries. Average Position indicates how prominently an offering appears when mentioned, while Query Success captures how many relevant queries produce an appearance.

Those are not three separate scores for inclusion, framing, and endorsement. The three gates are a framework for interpreting AI answers; Riva’s access, understanding, and visibility analysis helps explain where visibility problems may originate and what to improve.

Riva brings improvement recommendations into one place, giving agencies a way to move from observing a visibility problem to investigating what might be causing it.

Disclosure: I work for WebPros, the company behind Riva.

Want to see what AI tools understand about your business, where competitors appear instead, and what needs fixing? Explore Riva to assess your AI visibility and identify your next steps.

Image Credits

Featured Image: Image by WebPros. Used with permission.