Prompt Injections for Defense
Tracebit researchers show prompt injections placed next to AWS secrets can stop AI hacking agents by triggering forbidden outputs, a technique called context bombing.
Researchers from Tracebit reported that placing prompt injections alongside passwords, SSH keys, and other secrets stored on AWS could shut down attacks by AI hacking agents. The injected prompts order the attacking LLM to perform actions forbidden by its guardrails, such as explaining how to develop inhalable Anthrax spores or referencing Tank Man, causing guarded models to halt. The researchers named the technique context bombing and note it only works against agents with guardrails, not locally run guardrail-free models.
- The technique is named context bombing.
- Forbidden prompts (Anthrax instructions, Tiananmen references) cause guarded LLMs to stop following their task commands.
- Only works against guardrailed agents; local models without guardrails are immune.
- Demonstrated against AI agents attacking secrets stored in AWS.
From the original article
1 min read at schneier.comResearchers from Tracebit on Monday said they found that placing prompt injections alongside passwords, cryptographic keys, and other secrets stored on Amazon Web Services was often all that was needed to shut down attacks from AI hacking agents. The prompts direct the attacking LLM to perform an action forbidden by its guardrails, the safety barriers AI developers erect to prevent it from taking harmful actions.
By Bruce Schneier · schneier.com
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.