arXiv cs.CL· Kenan Li, Yijian Zhang, Jin Wang, Haipeng Gan, Zeying Sun, Xiaoguang Lei, Hao Dong·· 13 小时前AI 评分38
ChemBART:面向完整合成规划的化学反应语言模型预训练
ChemBART: Pre-training a Reaction Language Model for Comprehensive Synthesis Planning
AI 导读
ChemBART 是一个基于 BART 的反应中心预训练语言模型,通过在完整反应表达式(Reactant > Reagent > Product)上做掩码填充预训练,统一支持前体/试剂生成、温度-产率回归和分子性质分类等任务。
正文 · 原文
Abstract:Recent advances in large language models (LLMs) have demonstrated transformative potential across diverse fields. However, in computer-aided synthesis planning (CASP), current LLM methodologies are often restricted to single-molecule representations, limiting their application to isolated, single-task scenarios such as precursor prediction. Addressing this gap, we present ChemBART, a BART-based language model that adopts a reaction-centric pre-training strategy. By leveraging a mask-filling pre-training task on holistic reaction expressions (Reactant > Reagent > Product), ChemBART effectively solves a variety of chemical problems, including precursor/reagent generation, temperature-yield regression, and molecular property classification. Building on these capabilities, we demonstrate the integration of ChemBART with Monte Carlo tree search (MCTS) for multi-step synthesis route design, where the model serves to optimize the policy and value functions within a reinforcement learning framework. Beyond single-molecule pre-trained LLMs that are constrained to specific applications, ChemBART unifies diverse chemical tasks to facilitate synthesis planning with comprehensive implementation information. Most significantly, the proposed multi-step synthesis routes and reaction conditions were validated in the wet lab, confirming the discovery of shorter synthetic pathways with a >20% yield improvement over established literature benchmarks. Our work highlights the potential of reaction-focused pre-training and showcases the broad utility of ChemBART in closing the loop between in silico prediction and wet-lab synthesis.
| Comments: | Under peer review. 31 pages, 6 figures, 2 tables |
| Subjects: | Machine Learning (cs.LG); Computation and Language (cs.CL) |
| ACM classes: | I.2.7; J.3 |
| Cite as: | arXiv:2601.02915 [cs.LG] |
| (or arXiv:2601.02915v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2601.02915 arXiv-issued DOI via DataCite |
Submission history
From: Kenan Li [view email]
[v1]
Tue, 6 Jan 2026 10:55:38 UTC (3,374 KB)
[v2]
Wed, 21 Oct 2026 09:54:00 UTC (1,362 KB)
来源:arXiv cs.CL · arxiv.org