Skip to content
NewA calmer, faster ZeroHour

Most AI buying answers changed when 210 questions were repeated

Original title: We asked AI the same 210 buying questions 2 days in a row,84% of answers changed

Hacker News · securityby avatar99 ()7 min read2
AI summary · x-ai/grok-4.7Summaries by Vani AI

Gemini changed on 95% of questions, and only 42% of cited pages stayed the same overnight.

A two-day test repeated 210 buying questions across ChatGPT, Gemini, Google AI Overviews and Google AI Mode. The authors report that 84% of 839 answers named a different set of brands the next day, and 27% of day-one brands disappeared. Top-ranked brands were more stable than lower-ranked or smaller brands, while cited pages changed faster than brand lists. The post attributes shifts to different pages being read, not overnight product changes.

Unconfirmed: The figures come from one company’s two-day test and are not independently confirmed.

Key facts
  • A day-one number-one brand was still named 90% of the time, but remained first only 63%.
  • Smaller brands kept 51% of spots, compared with 73% for category leaders.
  • ChatGPT kept the same number-one brand 71% of the time, the highest of the four engines.
  • Google AI Overviews changed least, with 67% of answers moving.
  • Across eight answers to one question, about 14 brands appeared and only about two appeared in all eight.
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

7 min read at supercite.ai

Yesterday we showed that AI product recommendations mostly come from "best X" lists . The most common question we got was simple: do the answers stay the same? So we asked again.

Hacker News · security

By avatar99 · supercite.ai

Read the full article at Hacker News · security

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.