跳到正文
RadarAI· X:Unsloth (@UnslothAI)·· 9 天前AI 评分62

Unsloth 发布免费 notebook,可将 Qwen3.5-4B 本地训练成决策模型

AI 导读

Unsloth 发布免费 notebook,教用户把 Qwen3.5-4B 训练成生成决策而非文本的决策模型,本地仅需 8GB VRAM,内容涵盖数据准备(state、questions、gold answers)、训练与服务,配套指南见 unsloth.ai/docs。

正文 · 原文

Unsloth AI· @UnslothAI · X·2026-10-09 22:42· 40 分钟前AI 评分59

AI 导读

Unsloth 发布免费 notebook,教用户把 Qwen3.5-4B 训练成生成决策而非文本的决策模型,本地仅需 8GB VRAM。内容涵盖数据准备(state、questions、gold answers)、训练与服务;配套指南见 unsloth.ai/docs。其引用帖提到用 Clef head 加 LoRA(r=64)微调一 epoch,把 Qwen3.5 0.8B 在 3 个决策基准上的总体准确率从 20.7% 提到 74.3%,仅需 4GB VRAM。Notebook:https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_5_(4B)-Decision.ipynb

正文

引用Unsloth AI@UnslothAI
You can now train your own Decision model like Jev locally! We increased Qwen3.5 0.8B’s aggregate accuracy from 20.7% to 74.3% across 3 decision benchmarks - on just 4GB VRAM. Turn any LLM like Qwen3.8, Gemma 4 into decision models with our open-source Unsloth repo. We fine-tuned with a Clef head using Unsloth and LoRA (r=64) for one epoch, increasing downstream accuracy from 30–37% to 78%. GitHub: https://github.com/unslothai/unsloth Guide and Notebooks: https://unsloth.ai/docs/basics/train-your-own-decision-model-with-unsloth
在 X 查看被引用的帖子

来源:Unsloth AI · x.com

来源:RadarAI · aihot.news