Across thousands of questions put to AI between June and August 2026, the New Zealand businesses it names from memory and those it names after searching the web only match up about one time in eight.
We put more than 1,100 different buyer questions to ChatGPT, Claude and Gemini twice each, once answering from what the AI already knows and once answering after it searched the web. That is thousands of questions in total. Both answers came from the same request, so we are comparing like with like.
Seven New Zealand industries, 18 locations, more than 60,000 recorded business names since 12 June 2026.
About one time in eight. Across every sector we measure, the businesses named from memory and the businesses named after a search match up 12.3 percent of the time. Put another way, roughly seven of every eight names change.
ChatGPT names 6.3 businesses from memory and 6.8 after a search, matching 16 percent of the time. Gemini names 2.3 from memory and 8.8 after a search, matching 14 percent. Claude names 5.3 from memory and 6.0 after a search, matching 10 percent.
Gemini is the most striking. Asked from memory it names two or three New Zealand businesses. Asked again after a search, closer to nine. It barely knows this market until it looks.
Immigration advice, where the remembered and searched answers name the same firm about 5 percent of the time. Premium tourism is the most settled at about 19 percent, and even there four in five names change.
In between sit financial services at 6 percent, cosmetic and aesthetic medicine at 10 percent, real estate at 10 percent, law at 13 percent and private and elective healthcare at 18 percent.
Because it is doing two different things. Answering from memory, an AI repeats what it picked up about your market while it was being built, which was months or years ago. Answering after a search, it reads and quotes whatever it can find today.
One is reputation. The other is being findable. A business can have plenty of one and none of the other.
You have to win twice, and the two jobs are not the same work. Clear, quotable answers on your own site move the searched answer within months. Being described the same way everywhere online moves the remembered answer over much longer.
Most tools report one number for AI visibility. If that number mixes both answers together, it is averaging two different things and hiding the one you can actually fix.
More than 1,100 different buyer questions put to ChatGPT, Claude and Gemini twice each, once from memory and once after a search, inside the same request, across seven New Zealand sectors and 18 locations, between 12 June and August 2026. Thousands of questions in total.
Those two always search, so there is no memory answer to compare against. We measure them once.
We will run your market's questions and show you the result. Phone 027 368 0892 or email rob@citable.co.nz.