HFS：面向端侧智能体增强实时通信的协同网络框架

View PDF HTML (experimental)

Abstract:AI agents are enabling a new paradigm of agent-augmented real-time communication (RTC), where humans focus on high-level collaboration, while agents autonomously retrieve, analyze, and generate information in real time to support their interactions. These apps enable new experiences across various domains: for example, when corporate employees co-author a legal document, their agents can discuss and draft on their behalf, sparing them the burden of manually reviewing each other's work. As existing cloud-based agents suffer from privacy risks and unscalable server costs, on-device agent-augmented RTC offers a promising alternative. However, this on-device paradigm introduces a new networking challenge: contention between concurrent traffic flows generated by humans (for live video streaming) and agents (for sending context files for analysis). We design HFS, a framework to ensure both high live video quality and low agent response latency in agent-augmented RTC apps. We achieve the goal through an app-guided multi-flow transport approach, where a unified app-layer orchestrator jointly controls the sending rates of live video and agent context flows based on their heterogeneous app requirements. Our prototype built atop WebRTC and this http URL demonstrates that HAFS outperforms baselines, achieving 1.5x higher video quality while reducing agent response time by 31%.

Comments:	Accepted to USENIX NSDI 2027
Subjects:	Artificial Intelligence (cs.AI)
Cite as:	arXiv:2607.22854 [cs.AI]
	(or arXiv:2607.22854v2 [cs.AI] for this version)
	https://doi.org/10.48550/arXiv.2607.22854 arXiv-issued DOI via DataCite

Submission history

From: Juheon Yi [view email]
[v1] Fri, 24 Jul 2026 18:52:41 UTC (3,158 KB)
[v2] Mon, 19 Oct 2026 22:59:26 UTC (3,179 KB)