MiniMax 汇总 M3.1 Flash 428B 模型本地量化方案

MiniMax (official)· @MiniMax_AI · X·2026-11-02 04:49· 2 小时前AI 评分40

AI 导读

MiniMax 汇总了社区为 428B 的 M3.1 Flash 打造的多种本地量化与推理方案。

正文 · 原文

MiniMax M3.1 Flash, on more of your hardware.

Quantizing a 428B model opens up more ways to run it locally. Lower-bit weights reduce the memory needed to load the model and the weight data moved during decoding. Making those savings useful takes careful calibration, efficient low-bit kernels, and hardware-aware placement of experts across GPU and system RAM.

Thank you to the builders doing that work:

• @UnslothAI @danielhanchen — 2-bit Dynamic GGUF weights at 143.9 GB, with calibration and fidelity testing across coding, tool use and other workloads.
• @ViC305 — SAGE-EXL3, token-level fidelity measurements and a single-DGX-Spark recipe.
• @PeasantSmith — Project Maya quants and expert offloading for local coding and tool use.
• @MiaAI_lab — EXL3-EAQ quantization work.
• @jundotkim + mlx-community — oQ quants and DSpark-powered decoding through oMLX on Apple Silicon.
• @AIatAMD — Quark MXFP4 adapted for AMD Instinct.
• @atomic_chat_hq — GGUFs for local desktop workflows.
• @superalesha — custom inference work combining quantized weights, expert caching and system RAM on 4× RTX 3090.
Every shared quant, kernel, measurement and recipe gives the next builder a better starting point. Thank you.

来源：MiniMax (official) · x.com