arXiv cs.AI· Di Wu·· 4 小时前AI 评分20
PCGRL 新框架:用膨胀包络与前向课程合成可玩且多样的平台跳跃关卡
PCGRL for Complex Platformers: Synthesizing Playable and Diverse Levels via Inflated Envelopes and Forward Curricula
AI 导读
研究者提出一种物理感知、课程引导的 PCGRL 框架,用于在严格刚体规则与非线性运动边界约束下生成大规模平台跳跃关卡。该框架引入“膨胀体积包络”机制将连续运动可行性嵌入 MDP 离散状态空间,并通过中间状态转移反馈与多阶段前向扩展课程学习缓解长序列稀疏奖励问题。
正文 · 原文
Abstract:Procedural Content Generation via Reinforcement Learning (PCGRL) has emerged as a promising paradigm for automated game development. However, existing PCGRL frameworks still suffer from severe exploration bottlenecks and scaling limitations when faced with long-sequence generation tasks governed by strict rigid-body rules and non-linear kinematic boundaries (e.g., platformer constraints). Consequently, traditional approaches frequently fail to maintain reliable level solvability on large-scale canvases. To address these challenges, we present a physics-aware, curriculum-guided PCGRL framework. First, we construct an "Inflated Volume Envelope" mechanism, which provides a physics-constrained representation that incorporates continuous kinematic feasibility into the discrete state space of the MDP. Second, to alleviate the sparse reward challenge induced by extremely long decision sequences, we introduce intermediate state-transition feedback and a multi-stage forward extension curriculum learning framework, enabling informative value estimation and stable credit assignment over long-horizon trajectories. Finally, to resolve the issue where deterministic policies after convergence generate highly monotonous map paths with a lack of diversity, we activate high-entropy stochastic inference during the synthesis phase, regularized by a post-hoc parallel rejection filtering mechanism. Experimental results demonstrate that our framework significantly enhances structural diversity while maintaining high physical playability across multi-scale environments. Comparative evaluations across multi-scale canvases demonstrate that our framework maintains superior convergence stability and dimensional scalability, reliably synthesizing solvable levels where traditional PCGRL baselines degrade.
| Comments: | 9 pages, 6 figures, 1 table |
| Subjects: | Machine Learning (cs.LG); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.22250 [cs.LG] |
| (or arXiv:2611.22250v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22250 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Di Wu [view email]
[v1]
Tue, 17 Nov 2026 05:55:23 UTC (220 KB)
来源:arXiv cs.AI · arxiv.org