
Microsoft Research: editing under 10 neurons can backdoor an AI agent
A trigger string makes the model run an attacker command with the agent's access; Microsoft has not seen real-world use.
1
3 stories, newest first · one card per story

A trigger string makes the model run an attacker command with the agent's access; Microsoft has not seen real-world use.

Open-weight AI models can hide backdoors and poisoning that scanners miss, shifting breach liability onto security leaders.
A positive safe-response centroid fails as a safety direction; an explicit safe-minus-unsafe reference scores far better.
Today 1.1K readers · 1.3K views · 176 reads · all time 202K views