跳到正文
arXiv cs.AI· Ritika Poddar, Aidan Fennelly, Deirdre Murphy, Eric Wolos, Corre L. Steele, Michael Doyle·· 13 小时前AI 评分31

BUSTA:用逆向基本块执行教小语言模型推理二进制执行

BUSTA: Teaching Small Language Models to Reason About Binary Execution

AI 导读

BUSTA 通过逆向基本块执行任务将逆向工程技能迁移到开源小模型:给定 x86-64 基本块和目标输出寄存器状态,让模型预测产生该状态的输入寄存器值。用 GRPO 微调 Qwen3-1.7B 和 Nemotron-3-Nano 后,可推断寄存器预测准确率分别从 73.2% 升至 85.3%、从 63.3% 升至 95.2%。

正文 · 原文

View PDF HTML (experimental)

Abstract:Large Language Models (LLM) are increasingly applied to Reverse Engineering (RE) workflows. RE, however, differs from common LLM coding tasks as it requires models to reason about low-level program behavior. Furthermore, the deployment of tooling in resource-constrained sandboxed RE environments limits the ability to use frontier-scale solutions. We examine whether a targeted LLM training approach can transfer distinct RE skills to open models via inverse basic-block execution: given an x86-64 basic block and a desired output register state, the model predicts the input register values that produce it. Fine-tuning \texttt{Qwen3-1.7B} and \texttt{Nemotron-3-Nano} with Group Relative Policy Optimization (GRPO) raises knowable-register prediction accuracy from 73.2\% to 85.3\% and from 63.3\% to 95.2\%, respectively. Frontier models still score highest (up to 99.2\%), but our fine-tuned \texttt{Nemotron-3-Nano} comes within four points at a fraction of the parameter count. We release both fine-tuned models and the training dataset.
Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Programming Languages (cs.PL)
Cite as: arXiv:2610.36288 [cs.CR]
  (or arXiv:2610.36288v1 [cs.CR] for this version)
  https://doi.org/10.48550/arXiv.2610.36288

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Michael Doyle [view email]
[v1] Mon, 26 Oct 2026 21:11:48 UTC (23 KB)

来源:arXiv cs.AI · arxiv.org