Cell Phone with all the AI apps on the screen

I Asked 3 AIs the Same Question 135 Times. They Almost Never Agreed on Sources.

Written by : Diego Lapetina
Read Time: 3 minutes

Here’s a number that should bother you: 0.05.

That’s the average overlap between the sources Claude, ChatGPT, and Gemini cite when you ask them the exact same question. Not 50%. Not 15%. Effectively zero.

I ran a controlled experiment — 15 standardized queries, 3 platforms, 3 interfaces (mobile, web, API), 135 total runs, 750+ citation events. Then I cross-referenced every frequently cited domain against its full SEO profile via Ahrefs’ API. To my knowledge, nobody had done this at the query level before. The aggregate studies (Profound’s 680M citations, Semrush’s 78.6M searches) told us overlap was low. The controlled version shows it’s worse: for a query about CRM software, zero domains were shared between ChatGPT and Claude.

But the finding that actually matters for anyone spending money on visibility is this one:

The same platform doesn’t even agree with itself.

ChatGPT’s web interface never cited a single domain below Domain Rating 50 — a de facto DR 85+ gate. ChatGPT’s API cited a domain with DR 4.5 and roughly 12 organic visitors a month, six times, in one query. Same company. Same model family. Completely different retrieval pipeline.

I’m calling it the Two-Tier Citation System: the consumer-facing web product runs quality controls that the API — the thing powering every chatbot, integration, and “AI research tool” built on top of it — does not share.

Three more findings worth your attention:

Platforms have personalities. Claude behaves like a researcher (41–56% vendor documentation and primary sources). ChatGPT behaves like a librarian (58% guides and how-to content). Gemini behaves like a journalist (36% media citations — Forbes, PCMag, TechRadar). If you’re optimizing one strategy for “AI visibility,” you’re optimizing for a platform that doesn’t exist.

Vendors cite themselves. On commercial and comparison queries, 40–56% of all citations went to the vendors being compared. Ask an AI to compare project management tools, and it quotes asana.com and monday.com back at you.

Academic sources barely exist. Across all 135 runs, .edu and .gov domains appeared in fewer than 2% of citations — even on queries with substantial academic literature behind them.

So what does this mean if you’re buying or selling GEO services?

It means “ranking” in AI citation is a category error. There is no position 1. The same query, seconds apart, on the same platform, produces nearly disjoint citation sets. AI citation is stochastic — the best you can do is raise the probability of being cited, never guarantee it.

Which leads to the only recommendation in the study I’d put in bold: be deeply skeptical of anyone promising guaranteed AI citations. The data says that certainty doesn’t exist. Selling it is selling something that isn’t real.

The full study — methodology, tables, and the DR 85 threshold data — is free, just enter your email to receive it. Because the industry has enough fabricated urgency already; what it’s missing is evidence.

DOWNLOAD NOW

What you need to know:

Subscribe to our Newsletter.

Every couple of weeks, notes straight from the trenches — plus the keys to our growing library. Subscribe today and the Skincare Launch Playbook lands first.

Drop your email and enjoy.

Or Keep Reading...