Notes from the work

ChatGPT almost never opens your page. Here is what it reads instead

New log research maps ChatGPT's retrieval stack: its own index, a shared read cache, and rare live page opens. What it means for AI search visibility.

John KyprianouJohn Kyprianou9 min readUpdated

Most advice about getting cited in ChatGPT assumes the model reads your page. New log research says that is the rarest thing it does.

In a sample of 61,332 URLs that ChatGPT retrieved, only 759 were actually opened and read (Search Engine Land). Everything else was judged on a title and roughly 200 characters of text.

Diagram of ChatGPT's three retrieval layers, its own index, a shared read cache and rare live page opens, by SEO Turtle

The three layers, and why the distinction matters

The research, published on 17 August 2026 by Olivier de Segonzac and based on log analysis by the Resoneo team, splits ChatGPT's retrieval into three separate systems that most people treat as one thing (Resoneo).

The index. OpenAI's own search index, which the researchers found internally referred to as "labrador". It holds a URL, the full page title, and a snippet of roughly 200 characters anchored on your H1.

The read cache. A shared store of full pages converted to Markdown. When ChatGPT needs the body of your page, this is usually what it gets, not your live server.

The live open. The model sends a fetch to your actual URL. This is rare, and it is the layer that decides citations.

Those are different systems with different crawlers, different refresh behaviour and different content. Treating them as one pipeline is why so much GEO advice misfires.

Layer one: ChatGPT's index is not Bing's index

This is the finding that should retire a tired piece of advice.

The researchers compared the URLs in OpenAI's index against Bing results for the same queries and found that only 1.5 percent of them appeared in Bing's top 20. OpenAI is running its own crawl and its own index, not passing your site through Microsoft.

We flagged the softer version of this recently when we wrote about the second AI answer network running on Microsoft's index. That post still holds: Copilot, DuckDuckGo and Yahoo Scout genuinely do depend on Bing. What it does not buy you is ChatGPT. Fixing Bing Webmaster Tools is worth an afternoon, and it is not a ChatGPT strategy.

The practical detail buried in the crawl data is more useful anyway. OAI-SearchBot, the crawler OpenAI says "is used to surface websites in search results in ChatGPT's search features," discovers pages by following links (OpenAI). URLs that exist only in your XML sitemap were not reliably picked up.

If a page on your site is reachable only from the sitemap, or sits four clicks deep behind a paginated archive, it is not in the conversation. Internal linking is doing the discovery work here, not your sitemap submission.

Layer two: the cache serves an old copy of your page, on purpose

The read cache is where the mechanics get genuinely strange, and where most people's mental model breaks.

A cached copy is treated as fresh for about 30 minutes. Past that, ChatGPT still serves the stale copy to the next user, then refreshes in the background so the following request gets the new version. Retention runs for months rather than days, with the researchers seeing a copy from 11 July still served on 23 July.

Two consequences worth sitting with.

Your fix is not live when you think it is. You rewrite a page, you ask ChatGPT about it, and you get the old text back. That is not the model being wrong. That is you reading a cached copy. Any before-and-after test you run on the same day is close to meaningless.

Blocking directives that work everywhere else do not work here. The cache ignores Cache-Control: no-store, and pages carrying meta robots: noindex were still cached and served. If you have a staging URL, a thin location page or an old pricing page you quietly noindexed rather than removed, assume it is readable. Removing it or gating it properly is the only reliable answer, which is a slightly different job from the one covered in our AI crawlers and robots.txt guide.

There is also a hard ceiling: pages over 4 MB were rejected outright. That is not a theoretical limit for a modern site with hero video posters, uncompressed images and a fat client bundle.

Layer three: opens are rare, and they decide everything

Here is the asymmetry that reframes the whole exercise.

Pages that ChatGPT actually opened were cited 74 percent of the time. Pages that were merely retrieved from the index were cited 7 percent of the time. Opens happened for roughly one page in eighty.

So there are two completely different games. Winning the retrieval game gets you into a pool where nine out of ten candidates get discarded, which lines up with earlier work showing 85 percent of retrieved sources never make the final answer. Winning the open is close to winning the citation.

What triggers an open is mostly outside your control. Free instant responses lean entirely on index snippets and never open a page. Paid thinking mode does the real fetching, and the Think button free users got in August opens well under one page per conversation in the same logs. You cannot make a user upgrade their plan.

What you can control is whether the snippet that represents you is worth opening, and whether the page survives being opened.

Our take: this is the least glamorous GEO advice you will ever read

We will state the opinion plainly, because it cuts against a lot of what is being sold.

If the model's view of your page is a full title and about 200 characters after your H1, then the highest-leverage work in generative engine optimisation is writing a good title and a good opening paragraph. That is it. That is the lever.

No schema markup fixes a vague opening sentence. No llms.txt file rewrites your first 200 characters, which is part of why we called that standard mostly SEO theatre. An entity optimisation subscription does not help when the snippet representing your page says "We are passionate about delivering solutions tailored to your needs."

One specific habit worth breaking. SEO has spent a decade truncating title tags at around 60 characters because that is what Google displays. The index stores the full title. A title that reads as a complete, specific statement is now working harder than one trimmed to fit a SERP snippet preview. That does not mean writing 140-character titles for Google. It means the useful words should be in there, not cut for display reasons.

The second habit: stop burying the answer. Plenty of pages open with a paragraph of scene setting before the substance arrives in section three. In classic search Google would find the good passage anyway. Here, the 200 characters after your H1 are the whole audition. This is the same principle behind structuring content so LLMs cite you, applied to a much smaller window than most people realise.

What we would actually check on a site this week

Six things, in rough order of return.

  1. Read your own first 200 characters after each H1. Out loud. If it does not state what the page is and who it is for, rewrite it. Do this on your money pages first.
  2. Write titles that are complete statements. Specific, unhedged, with the thing you do and the place or audience you do it for. Stop trimming useful words purely for display. If you want variants to compare, our meta title and description generator writes them at SERP length.
  3. Check internal links to your important pages. If a page is only reachable via the sitemap or deep pagination, add real links from pages that already get crawled.
  4. Check page weight. Anything approaching 4 MB is at risk of being dropped entirely. This is usually images and an oversized JavaScript bundle.
  5. View source, not the rendered page. If your service detail, pricing or FAQ answers only appear after a client-side fetch, they are invisible at this layer. The cache stores what it receives, and it is not running your app for you.
  6. Audit anything you noindexed instead of deleting. Assume it is cached and readable. Decide whether you are comfortable with that.

None of that is new technique. It is technical SEO and clear writing, aimed at a narrower window than we are used to.

The caveat we would attach to all of it

This is one research team's log analysis of a sampled crawl, on a system that OpenAI changes without announcement, as Reddit found out when its ChatGPT citations collapsed in four days. The 30-minute figure, the 4 MB limit and the codename are observations, not published specification. They will move.

What we would not expect to move is the shape of it. A retrieval system that judges most candidates on a title and an opening snippet, reads a cached copy when it needs more, and rarely opens the live page is a reasonable design for anyone serving answers at that volume. The specific numbers are this month's. The incentive to be legible in a very small window is structural.

It also pairs badly with the other half of the picture. A large share of ChatGPT answers never run a web search at all and come straight from model memory, which we covered in two-thirds of ChatGPT answers never search the web. Between memory on one side and a 200-character snippet on the other, the space where a long, carefully argued page gets read in full is genuinely thin.

That is not an argument for writing worse pages. Depth is still what earns the open, and the open is what earns the citation. It is an argument for making sure the first thing anyone reads, human or model, does its job.

If you want a second pair of eyes on how your pages are structured for this, our AI search optimisation work starts with exactly these checks, and the free SEO review covers the technical side of it.

More on technical seo
John Kyprianou

John Kyprianou

Founder & SEO Strategist

John brings over a decade of experience in SEO and digital marketing. With expertise in technical SEO, content strategy, and data analytics, he helps businesses achieve sustainable growth through search.

Keep reading

More to think about.

All insights
A sitemap.xml file listing URLs with two of them marked by red crosses where the page no longer resolves, by SEO Turtle

Technical SEO

XML sitemap best practices: what Google reads and what it ignores

Almost every XML sitemap in the wild was generated by a plugin and nobody has looked inside it. Google throws away priority and changefreq, treats lastmod with suspicion, and will skip your file entirely if it does not rate your site. Here is what to fix in ten minutes, and what to stop touching.

November 10, 2026
Diagram of a single tap split into input delay, processing duration and presentation delay, showing which phase to fix for INP, by SEO Turtle

Technical SEO

How to fix INP: a debugging order for Interaction to Next Paint

Interaction to Next Paint is usually one slow filter, menu or consent banner, not a slow site. The order that works: confirm the problem in field data, identify the single interaction, read which of the three phases is eating the time, and apply the fix that matches that phase. Plus why none of this is worth doing for ranking points.

October 29, 2026
Three-column diagram comparing robots.txt, noindex and canonical by what each controls (crawling, indexing, credit), by SEO Turtle

Technical SEO

Robots.txt vs noindex vs canonical: which one to use

Robots.txt controls crawling, noindex controls indexing, canonical controls which duplicate gets the credit. Most sites treat them as three strengths of the same tool, which is how a page ends up stuck in Google with a noindex tag Google can never read. Here is what each one does, the pairings to avoid, and the order that actually removes a page.

October 27, 2026
Diagram of two pages from one site competing for a query, with Search Console showing only the Google-selected canonical, by SEO Turtle

Technical SEO

Keyword cannibalisation: how to find it, and when it is not the problem

A tool says you have a cannibalisation problem. Google's own people are openly unconvinced the problem exists most of the time. Here is how to tell a real case from a rank-tracker artefact, why a Search Console-only audit structurally misses the worst version, and why the fix is usually to separate intent rather than merge anything.

October 22, 2026
Illustration of a stack of schema markup labels with FAQ, HowTo and Course crossed out and Organization, Breadcrumb, Article and Product kept, by SEO Turtle

Technical SEO

Schema markup that still earns a rich result: what to keep and what to drop

Most sites are carrying a pile of structured data that stopped producing anything visible a year or more ago. Google's gallery lists 25 features, fewer than ten apply to a normal business site, and about four do real work. Here is which ones, the review snippet rules that disqualify most sites, and why 'schema for AI search' is a purchase you can skip.

October 20, 2026