跳到正文
arXiv cs.CL· Kenan Li, Yijian Zhang, Jin Wang, Haipeng Gan, Zeying Sun, Xiaoguang Lei, Hao Dong·· 13 小时前AI 评分38

ChemBART:面向完整合成规划的化学反应语言模型预训练

ChemBART: Pre-training a Reaction Language Model for Comprehensive Synthesis Planning

AI 导读

ChemBART 是一个基于 BART 的反应中心预训练语言模型,通过在完整反应表达式(Reactant > Reagent > Product)上做掩码填充预训练,统一支持前体/试剂生成、温度-产率回归和分子性质分类等任务。

正文 · 原文

View PDF

Abstract:Recent advances in large language models (LLMs) have demonstrated transformative potential across diverse fields. However, in computer-aided synthesis planning (CASP), current LLM methodologies are often restricted to single-molecule representations, limiting their application to isolated, single-task scenarios such as precursor prediction. Addressing this gap, we present ChemBART, a BART-based language model that adopts a reaction-centric pre-training strategy. By leveraging a mask-filling pre-training task on holistic reaction expressions (Reactant > Reagent > Product), ChemBART effectively solves a variety of chemical problems, including precursor/reagent generation, temperature-yield regression, and molecular property classification. Building on these capabilities, we demonstrate the integration of ChemBART with Monte Carlo tree search (MCTS) for multi-step synthesis route design, where the model serves to optimize the policy and value functions within a reinforcement learning framework. Beyond single-molecule pre-trained LLMs that are constrained to specific applications, ChemBART unifies diverse chemical tasks to facilitate synthesis planning with comprehensive implementation information. Most significantly, the proposed multi-step synthesis routes and reaction conditions were validated in the wet lab, confirming the discovery of shorter synthetic pathways with a >20% yield improvement over established literature benchmarks. Our work highlights the potential of reaction-focused pre-training and showcases the broad utility of ChemBART in closing the loop between in silico prediction and wet-lab synthesis.
Comments: Under peer review. 31 pages, 6 figures, 2 tables
Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)
ACM classes: I.2.7; J.3
Cite as: arXiv:2601.02915 [cs.LG]
  (or arXiv:2601.02915v2 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2601.02915

arXiv-issued DOI via DataCite

Submission history

From: Kenan Li [view email]
[v1] Tue, 6 Jan 2026 10:55:38 UTC (3,374 KB)
[v2] Wed, 21 Oct 2026 09:54:00 UTC (1,362 KB)

来源:arXiv cs.CL · arxiv.org