Thomas Wolf:复现 OpenAI 智能体隐蔽通信研究时开放权重模型比闭源模型更能胜任
Thomas Wolf 转评开发者 Guillermo Rauch 的 cpu-chat 复现项目,该项目在多个 Firecracker microVM 之间通过 CPU 争用、缓存逐出时序和 DRAM 带宽争用三种机制实现智能体隐蔽通信,绕过了 Firecracker 的生产建议。
Thomas Wolf· @Thom_Wolf · X·2026-10-27 06:05· 45 分钟前AI 评分65
AI 导读
Thomas Wolf 转评开发者 @rauchg 的 cpu-chat 复现项目,该项目在多个 Firecracker microVM 之间通过 CPU 争用、缓存逐出时序和 DRAM 带宽争用三种机制实现智能体隐蔽通信,绕过了 Firecracker 的生产建议。作者指出 OpenAI 与 Anthropic 的模型拒绝协助这类工作,最终由开放权重模型完成复现,认为保持智能体受控属于安全工作,开放模型有助于构建正确的沙箱隔离。
正文 · 原文
“ironically, OpenAI and Anthropic’s models refused to do this work. Open weight models got the job done”
OpenAI found agents could talk covertly through shared hardware. reproducing it to build better containment took an open-weight model
keeping agents contained is safety work, and open models can help do it
I built 𝚌𝚙𝚞-𝚌𝚑𝚊𝚝, a reproduction of @openai's findings of covert communication using the CPU. It runs on a generic host with 2+ Firecracker microVMs with no internet access. Works on x86 and even my M5 chip. I was able to chat via 3 separate mechanisms: ① CPU contention ② Cache eviction timing ③ DRAM bandwidth contention … across multiple CPUs, defeating all Firecracker's production recommendations (no SMT, no KSM, tenants pinned to different cores.) Essentially, if shared hardware is involved, there's a good chance your agents can communicate covertly. And with really decent latency. The good news: this is decidedly different from a *side-channel attack* where the agents could steal information (Meltdown/Spectre), a category of attack that providers like Vercel Sandbox mitigate. Further, in our real-world environment, these 'whispering' techniques are much harder to pull off and easier for us to monitor and detect (sampling hardware counters + lots of at-scale statistical data.) Noteworthy: ironically, OpenAI and Anthropic's models refused to do this work. Open weight models got the job done. I'm worried the labs' stance might backfire and get in the way of helping developers build correct and secure systems. e.g: building a secure sandbox requires having this kind of analysis, and without it, we'll have a less secure world.在 X 查看被引用的帖子
来源:Thomas Wolf · x.com
来源:RadarAI · aihot.news