SoftwareGym：用多样化合成软件环境扩展 Computer-Use Agent 训练

View PDF HTML (experimental)

Abstract:Computer-use agents (CUAs) are rapidly improving, yet synthesizing diverse and reliable software environments at scale remains challenging. Native application environments require substantial construction and integration effort, which limits application coverage and increases the risk of application-specific overfitting. Browser-hosted environments provide limited interaction depth and workflow complexity. These limitations motivate SoftwareGym, an automated pipeline for synthesizing GUI software environments with diverse interfaces, executable functionality, and runtime-verified behavior. It generates structurally diverse designs, realizes them as runnable applications, and uses GUI evaluation with iterative repair to ensure functional reliability. Using SoftwareGym, we synthesize 182 applications across twelve categories and achieve a mean GUI task pass rate of 91.5%. We construct SoftwareGym-Bench, a 120-task evaluation suite spanning the same twelve categories, and use trajectories collected from these environments for CUA training. The resulting model improves Pass@3 from 41.39% to 56.97% on the strictly out-of-domain OSWorld benchmark and achieves 40.0% on SoftwareGym-Bench. These results demonstrate the potential of synthesized software environments as scalable and transferable supervision for CUA training.

Comments:	26 pages, 11 figures, including appendices
Subjects:	Multiagent Systems (cs.MA); Software Engineering (cs.SE)
Cite as:	arXiv:2610.12611 [cs.MA]
	(or arXiv:2610.12611v1 [cs.MA] for this version)
	https://doi.org/10.48550/arXiv.2610.12611 arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Tian Jin [view email]
[v1] Thu, 8 Oct 2026 18:31:16 UTC (35,370 KB)