When Do Model Internals Help? Exploring the Role of Representation Engineering in LLM Safety
Matched tests find DPO controls LLM safety best, while representation probes monitor cheaply and can repair fine-tuning damage.
Stories per day · 30 days
2 stories, newest first · one card per story
Stories tagged #probes
Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Models
Lightweight 12.6M-parameter probes on LLaMA-3.1-8B activations detect harmful prompts with F1 up to 99%, matching guard models 1000x larger at lower cost.