arXiv cs.AI· Shinichi Arimura, Yuchen Li, Julian Togelius·· 1 天前AI 评分23
堆叠更多关卡：如何让 Mario 玩得通用又像人类
Stack more levels: how to get general and human-like Mario playing
AI 导读
研究用 PPO 智能体在 increasingly 大规模 PCG 生成的《超级马里奥兄弟》关卡上训练，并在 1000 个留出测试关卡上评估泛化能力。结果显示，增加不同 PCG 训练关卡数量通常能提升未见关卡表现；再用 DRAIL 结合人类演示微调后，智能体动作层面更像人类，同时保留 PPO 预训练形成的玩法风格。
正文 · 原文
Abstract:Super Mario Bros. is widely used in game AI and procedural content generation (PCG), yet it remains unclear whether a model-free agent can reliably win unseen levels. To address this question, we train Proximal Policy Optimization (PPO) agents on increasingly large sets of PCG-generated Mario levels and evaluate their generalization on 1000 held-out test levels. We then shape competent PPO policies into three gameplay archetypes---runner, killer, and collector. Finally, we fine-tune these PPO policies using Diffusion-Reward Adversarial Imitation Learning (DRAIL) with human gameplay demonstrations. We find that increasing the number of distinct PCG-generated training levels generally improves unseen-level performance, and that fine-tuning PPO policies with DRAIL increases action-level human-likeness while preserving much of the persona induced by PPO pretraining.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.16175 [cs.AI] |
| (or arXiv:2611.16175v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.16175 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yuchen Li [view email]
[v1]
Thu, 12 Nov 2026 02:06:30 UTC (102 KB)
来源：arXiv cs.AI · arxiv.org