跳到正文
arXiv cs.AI· Peiwei Chang, Yongqiang Chen, Yuelan Cheng, Liting Gao, Yishun Lu, Li Zhang, Mark D. Plumbley, Philip J. B. Jackson, Wenwu Wang·· 3 天前AI 评分25

PhysicsSliders:为音频拟音生成学习物理控制

PhysicsSliders: Learning Physical Controls for Audio Foley Generation

AI 导读

研究者提出 PhysicsSliders(PXS),基于 15 个材质、几何与接触参数在模拟接触音上训练,可控制硬度、尺寸、速度与阻尼并支持房间描述。两个独立训练变体分别接受直接参数输入或数值化描述文本,在固定目标下生成频谱可区分的输出。

正文 · 原文

View PDF HTML (experimental)

Abstract:Physical properties provide intuitive controls for sounds made by interacting objects. The challenge is to make a generative model respond predictably to these controls, both individually and in combination. We present \method\ (PXS), trained on simulated contact sounds with 15 material, geometry and contact parameters. Two separately trained variants accept direct parameter inputs or numerical captions. PXS controls hardness, size, speed and damping, supports room descriptions and produces spectrally distinct outputs at fixed targets. When controlling damping and size together, specifying thickness improves frequency accuracy and joint target delivery. Measurements from real recordings define effective-damping targets, which simulator inversion maps to generation inputs without real-audio fine-tuning. Across 18 impact classes from five real-audio datasets, PXS-Physical follows these targets with mean grouped Spearman correlation $\rho=0.976$ and class-median error 0.094 dex (a factor of 1.24).
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2610.18597 [cs.SD]
  (or arXiv:2610.18597v1 [cs.SD] for this version)
  https://doi.org/10.48550/arXiv.2610.18597

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Peiwei Chang [view email]
[v1] Tue, 13 Oct 2026 15:53:45 UTC (156 KB)

来源:arXiv cs.AI · arxiv.org