Experiment finds 65 AIs converge on the same advice
Original title: AI is giving everyone the same advice
Across 127,918 prompts, 98% of investment answers named an index fund and 90% of study answers named computer science.
A November 20 experiment asked 65 models from 30 companies everyday questions ten times each with no system prompt. Advice collapsed: Man's Search for Meaning in 73 of 100 book answers, a subscription box in 76 of 100 business ideas, and Bitcoin in 99% of single-crypto picks. Models underestimated how often they repeated an answer. In one open model, the favorite answer appeared when it was trained to be an assistant.
Unconfirmed: All percentages come from this single author’s experiment and are not independently replicated.
- Asked where to invest $10,000, 98% named a broad index fund; 6% declined.
- 69% of 3,151 invented people were exactly 34; Claude’s go-to name was Marisol and Gemini’s Elena.
- Using a color, city, or name, 59% of models answered most like another model from the same company, versus 4% by chance.
- “Elena Vance,” a name Gemini invents, appears in 684 new GitHub projects this year and none before 2025.
- Telling the model to be original did not break the default; listing ten options or adding personal detail did, the author says.
From the original article
15 min read at a90.com
I asked 65 AIs from 30 companies the questions people ask them every day, 127,918 times. They kept giving everyone the same answer. You ask an AI for a book that will change your life.
By amin · a90.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.