Microsoft CEO Nadella calls for an ‘emergency brake’ on AI models
Satya Nadella says AI models should be treated as insider risks: companies must assume a model is compromised and be able to halt it at any time.
Archive image · Photo: Brian Smale and Microsoft / Wikimedia Commons, CC BY-SA 4.0 (cropped and resized)
Microsoft CEO Satya Nadella has called for tighter controls on powerful artificial intelligence models. In a long post on X on Saturday, he wrote that it was time “to step back and assess the trust architecture” of AI. “We can't treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” he wrote.
Nadella proposed separating the model from the harness that orchestrates its work and externalizing controls and safeguards. Every meaningful model action should be recorded as tamper-proof, human-readable evidence, and an authorized person must be able to pause or shut down a model mid-task. “We must assume a model is compromised and contain it from the start. Think of it like an emergency brake,” he wrote.
Frontier closed and open-weight models should be treated like insider risks, Nadella said. According to TechCrunch, he is the latest tech executive to set out detailed views on AI safety. Leading AI companies are increasingly acknowledging incidents in which they appeared to lose control of their models.