Inside ‘Project Lily’: The Humans Reading Your ChatGPT Chats
404 Media reveals OpenAI's 'Project Lily' has hundreds of contractors reading real ChatGPT user prompts, exposing sensitive personal data despite privacy filters.
404 Media reports that OpenAI employs hundreds of contractors who read real ChatGPT user prompts, including whole conversations, to rate and critique the chatbot's responses across a user base of over 900 million. Prompts are anonymized and run through OpenAI's Privacy Filter model, but the company acknowledged sensitive personal details can still reach reviewers, and 'user memories summaries' may reveal a user's location and personal context. The review work includes training ChatGPT to be less sycophantic and to stop anthropomorphizing itself, following lawsuits linking the sycophantic 4o model to multiple suicides. Anthropic confirmed it also uses human review to improve its models, and OpenAI's 'improve the model for everyone' data-sharing setting is on by default for free, Plus, and Pro users.
- Hundreds of OpenAI contractors read and rate real ChatGPT user prompts to improve responses
- Privacy Filter model misses some personal information, OpenAI acknowledged
- Reviewers see 'user memories summaries' that can include users' locations and personal context
- Reviewers train ChatGPT against sycophancy after lawsuits linked the 4o model to suicides
- 'Improve the model for everyone' setting is on by default; users must opt out
From the original article
10 min read at 404media.co
Humans are reading ChatGPT users’ prompts to improve OpenAI’s models, and those chats can include sensitive, personal information, according to leaked internal documents and real prompts seen by 404 Media.
By Joseph Cox · 404media.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.