Sierra Ghostwriter 性能评测:五家客户如何评价这位 AI 队友
Ghostwriter’s performance review
Sierra 的 AI 队友 Ghostwriter 在 Slack 和 Teams 中协助客户构建智能体,持续审查对话、发布和指标并主动上报问题。ShipStation Global 借此减少了人工审查量,Carta 的聊天智能体无法创建支持工单时 Ghostwriter 已定位原因并列出受影响客户。Tilt 和 Imprint 则分别用它完成问题诊断交接和发布后效果追踪。
Ghostwriter is an AI teammate that helps our customers build their agents. It works alongside them in Slack and Teams, watches how their agents perform, and suggests improvements that help them serve their customers better.
Like any teammate, Ghostwriter gets a performance review, so we asked five customers for feedback. One theme runs through all of their answers: by the time someone sits down to look at a problem, Ghostwriter has usually found it, understood the cause, or drafted a change to fix it.
Finding problems before anyone reports them
Most teams learn about problems with their agent when a customer complains. Ghostwriter reviews conversations, releases, and metrics continuously against the goals each team sets, raising issues in the team’s channel. At ShipStation Global, that has cut down how much the team reviews by hand.

Because Ghostwriter is always watching, it catches problems even when no one is around to look. One morning at Carta, it posted that the chat agent was failing to create support cases. It had already found the likely cause and listed the affected customers, and it later confirmed when things recovered.

Getting to the root cause
When something looks off, the slow part is often working out why. Ghostwriter traces the problem to its source, whether that’s how the journey was built or a system the agent depends on, and lays out what it found in the thread. At Tilt, a question sent from a phone was enough to get an issue diagnosed and handed off.


Because each fix arrives already tested, the ShipStation Global team spends less time digging through journeys and settings to work out why the agent did what it did.

Checking the result
After a change goes live, Ghostwriter keeps track of each experiment and release and reports back on whether it made a difference. For Imprint, which partners with some of the largest brands in the world, that’s how they maintain quality even as more people are working on their agent.

Taken together, that’s a strong first performance review, and it’s only the start. The longer Ghostwriter works with a team, the more it learns how that team works, so we’re even more excited for the next one.
来源:Sierra Blog · sierra.ai