ClaimMirage: When Self-Claims in Domain Names Change LLM Threat Judgments
Self-claims in domain names can alter LLM threat judgments without explicit prompt-injection, reducing or increasing domain safety alerts.
A study on ClaimMirage shows that self-claims in domain names can significantly alter how LLMs judge domain safety and approval, without explicit prompt-injection, leading to increased or reduced alerts.
- Self-claims in domain names alter LLM threat judgments without explicit prompt-injection
- Self-claims can reduce or increase domain name alerts
- Risk-denial terms reduce alerts by 45.3 percentage points
- Endorsement terms increase alerts by 65.6 percentage points
- Findings motivate testing resistance to self-claims
From the original article
1 min read at arxiv.orgShort claims such as not-phishing or official can change how a large language model (LLM) judges a domain name, without explicit prompt-injection commands. We study this manipulation as ClaimMirage: a name under inspection claims its own safety or approval. We analyze 622,080 judgments across 64 brands and five LLMs, comparing ten claims with length- and hyphen-matched controls in constructed brand-like names.
By Daiki Chiba · arxiv.org
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.