arXiv cs.AI· Kangjie Zheng, Amirhossein Vahidi, Liying Jin, Joseph Clarke, Vijaya Baskar MS, Connor Rogerson, Mengji Zhang, Muzlifah Haniffa, Anshul Kundaje, Mo Lotfollahi·· 12 小时前AI 评分31
MUSS:面向单细胞基因调控的多尺度序列模型
MUSS: A Multi-scale and Sequence-based Model for Single-cell Gene Regulation
AI 导读
MUSS 是一个基于序列的多尺度模型,可从 DNA 中同时保留 DNA 层面与细胞层面分辨率,用于建模单细胞基因调控。它用冻结的预训练序列编码器生成 peak 与基因表示,并通过 peak-peak 自注意力与距离偏置的 peak-gene 交互整合,再经 peak 掩码语言建模和配对 scATAC-seq/scRNA-seq 训练对齐细胞特异调控状态。
正文 · 原文
Abstract:Modeling gene regulation in single cells requires jointly representing DNA sequence, chromatin accessibility, and gene expression across regulatory scales. Sequence-based models capture DNA-level regulatory grammar but often lack cell-level resolution, whereas many single-cell omics models represent genes and peaks as fixed-vocabulary tokens without their underlying sequence. Here, we present MUSS, a sequence-based multi-scale model for single-cell gene regulation that preserves both DNA-level and cell-level resolution. MUSS derives peak- and gene-level representations from DNA using a frozen pre-trained sequence encoder and integrates them through peak-peak self-attention and distance-biased peak-gene interactions. Peak masked language modeling followed by training on paired scATAC-seq and scRNA-seq aligns these representations with cell-specific regulatory states. Across gene expression prediction, enhancer-gene linking, motif-guided regulatory prioritization, and zero-shot cell clustering, MUSS achieves strong performance against sequence-based and single-cell omics baselines. It further predicts expression for genes and peaks unseen during task training. These results support sequence-grounded, multi-scale representations for decoding cell-type-specific regulatory programs. Code, datasets, and model checkpoints are available at this https URL.
| Comments: | 30 pages, 5 figures; includes references, appendices, and the NeurIPS checklist |
| Subjects: | Artificial Intelligence (cs.AI); Genomics (q-bio.GN) |
| Cite as: | arXiv:2611.08086 [cs.AI] |
| (or arXiv:2611.08086v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2611.08086 arXiv-issued DOI via DataCite (pending registration) |
|
| Journal reference: | NeurIPS 2026 |
Submission history
From: Kangjie Zheng [view email]
[v1]
Thu, 5 Nov 2026 14:34:07 UTC (303 KB)
来源:arXiv cs.AI · arxiv.org