Most AI buying answers changed when 210 questions were repeated
Original title: We asked AI the same 210 buying questions 2 days in a row,84% of answers changed
Gemini changed on 95% of questions, and only 42% of cited pages stayed the same overnight.
A two-day test repeated 210 buying questions across ChatGPT, Gemini, Google AI Overviews and Google AI Mode. The authors report that 84% of 839 answers named a different set of brands the next day, and 27% of day-one brands disappeared. Top-ranked brands were more stable than lower-ranked or smaller brands, while cited pages changed faster than brand lists. The post attributes shifts to different pages being read, not overnight product changes.
Unconfirmed: The figures come from one company’s two-day test and are not independently confirmed.
- A day-one number-one brand was still named 90% of the time, but remained first only 63%.
- Smaller brands kept 51% of spots, compared with 73% for category leaders.
- ChatGPT kept the same number-one brand 71% of the time, the highest of the four engines.
- Google AI Overviews changed least, with 67% of answers moving.
- Across eight answers to one question, about 14 brands appeared and only about two appeared in all eight.
- Vendors
From the original article
7 min read at supercite.aiYesterday we showed that AI product recommendations mostly come from "best X" lists . The most common question we got was simple: do the answers stay the same? So we asked again.
By avatar99 · supercite.ai
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.