Skip to content
NewA calmer, faster ZeroHour

Can Prompt Anonymity Protect Your Identity From LLM Providers?

arXiv cs.CRby Dzung Pham ()1 min read1 · 1 read
AI summary · grok-4.7Summaries by Vani AI

Prompt embeddings re-identify 50-75% of SWE-Chat users behind anonymizing LLM proxies.

The authors test whether anonymizing proxies that separate user identity from prompts still allow LLM providers to recover authorship. PromptAnonBench contains over 175,000 cleaned multi-turn prompts drawn from SWE-Chat and WildChat. Using embeddings of historical conversations, an attacker re-identified at least one anonymized conversation for 50-75% of SWE-Chat users and up to 10% of WildChat users at a 10% false-acceptance rate for out-of-set users, even after text-based defenses.

Key facts
  • PromptAnonBench contains over 175,000 multi-turn prompts
  • Sources include SWE-Chat and WildChat conversations
  • Attack re-identified 50-75% of SWE-Chat users
  • WildChat re-identification reached about 10% at 10% FAR
  • Existing text privacy defenses did not close the gap
Explain this AI news with Vani AIWhat was announced, what is new and why it matters, in a new chat

From the original article

1 min read at arxiv.org

User conversations with large language models (LLMs) often contain highly sensitive personal information that can be exploited by LLM providers to create detailed user dossiers, enable targeted advertising, and train more powerful models.

arXiv cs.CR

By Dzung Pham · arxiv.org

Read the full article at arXiv cs.CR

A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.