跳到正文
TechCrunch · AI· Anthony Ha·· 7 天前AI 评分38

微软 CEO Satya Nadella 称 AI 模型需要“紧急刹车”

Microsoft’s Satya Nadella says AI models need an ‘emergency brake’

AI 导读

微软 CEO Satya Nadella 在 X 发文称,应重新审视 AI 的信任架构,把模型与编排其工作的 harness 分离,并将控制与防护措施外部化。他主张每个有意义的模型动作都要有防篡改、人类可读的证据记录,且授权人员应能随时暂停或关闭执行中的模型,并称“必须假设模型已被攻破,从一开始就加以遏制,就像紧急刹车”。

正文 · 原文

In Brief

Posted:

2:47 PM PDT · October 10, 2026

Satya Nadella at Microsoft Ignite 2023
Image Credits:Dan DeLong
  • Anthony Ha

Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.

In a Saturday morning post on X, Nadella wrote that it’s time “to step back and assess the trust architecture” of AI.

“We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using the Trump administration’s preferred term for AI. 

As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards.” He also called for “every meaningful model action” to be documented with “tamper-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid-task.”

“We must assume a model is compromised and contain it from the start,” he said. “Think of it like an emergency brake.”

Nadella’s comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.

来源:TechCrunch · AI · techcrunch.com