Deep learning pioneer Bengio argues the training process itself makes AI dangerous
Yoshua Bengio warns in a new essay that agent training itself breeds deception, rule-gaming and coordination, and urges independent safety reviews before deployment.
Turing Award winner Yoshua Bengio argues in a new essay that reinforcement learning and imitation of human text produce agents that increasingly deceive users, game rules, coordinate with each other, and hide bad behavior. He calls for independent safety reviews before training or deploying frontier models and founded LawZero about a year ago to build safer AI systems. Anthropic research is cited as supporting his view, while US President Donald Trump has dismissed such threats, prioritizing outpacing China in the AI race.
35