arXiv cs.AI· Jichao Li, Jinrong Lu, Manjiang Yu, Zhixuan Liu·· 11 小时前AI 评分26
DelegateEval：面向个人对外服务智能体的平台评估框架
DelegateEval: Evaluating Platforms for Personal External Service Agents
AI 导读
研究者提出 DelegateEval，一个面向“个人对外服务智能体”的平台级评估框架，覆盖易创建性、服务发现与匹配、交付质量、专长继承、服务连续性、学习与改进、可靠性与治理、效率与价值八个维度。该框架可评估结合 LLM、可复用技能、MCP 等协议与可执行工具环境的智能体系统，目前仅给出框架与实验设计，完整数据集、可执行环境、统一评分协议及跨模型结果仍待开发与实证验证。
正文 · 原文
Abstract:AI agents that work for an individual over time may also help that individual serve external clients. We define a personal external service agent as an agent authorized and continuously managed by a specific individual to accept client requests, deliver work, and provide ongoing support using that person's knowledge, experience, professional methods, and service boundaries. Such agents could allow individuals to serve more clients with less direct involvement and generate economic value at scale. We propose DelegateEval, a platform-level evaluation framework for agent systems that may combine large language models, reusable skills, protocols such as MCP, and executable tool environments. It covers eight dimensions: ease of creation, service discovery and matching, delivery quality, expertise inheritance, service continuity, learning and improvement, reliability and governance, and efficiency and value. These dimensions assess whether a platform enables people with different backgrounds to turn their expertise into ongoing services that deliver verifiable work, develop capabilities through experience, and remain economically feasible. We present the framework and an experimental design. Complete datasets, executable environments, a unified scoring protocol, and cross-model results remain to be developed and empirically validated.
| Comments: | 28 pages, 7 figures, 6 tables. Evaluation framework and experimental design |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.07508 [cs.AI] |
| (or arXiv:2611.07508v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.07508 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jichao Li [view email]
[v1]
Thu, 5 Nov 2026 06:13:41 UTC (469 KB)
来源：arXiv cs.AI · arxiv.org