跳到正文
GitHub·· 7 天前AI 评分38

Clover Framework:Kimi K3 前向传播单机复现框架

santhoshsathish94/clover-framework

AI 导读

Clover Framework 开源了 clover-k3,将 Kimi K3 前向传播还原为数学表达式并在 Ryzen 9 7950X3D 单机上直接执行,在全部 34 个测试提示上输出与独立实现相同的首个 token,耗时 394.94 秒对 1344.23 秒,加速 3.40 倍。该模型参数量为 2.78 万亿,单独生成运行平均每 token 约 6 秒,但并非分布式系统或通用质量结果。

正文

Clover Framework — System, Human and AI working together for meaningful outcomes

Clover Framework · System, Human and AI working together for meaningful outcomes

cloverframework.com · Quickstart · AGENTS.md · Docs


Clover is a framework for working with System, Human, and AI to produce meaningful outcomes.

The framework itself is documented at cloverframework.com and in docs/.

This repository contains the documentation, practical guidance, case studies, and the implementation work around Clover.

Start here

Clover AI

Clover AI is the implementation arm of the project: an open-source AI system that can produce meaningful engineering outcomes while remaining bounded, observable, verifiable, and accountable.

The first thing built under it is clover-k3/ — the Kimi K3 forward pass reduced to its mathematics and executed directly. It emits the same token as an independent implementation of the same model on all 34 prompts tested, in under a third of the time. What it cost and what it does not show are in results and scope.

Its central principle is:

The model can propose.
The system decides.
The tools enforce.
Evidence verifies.
Humans remain accountable.

The implementation follows the Clover cycle:

Context → Direction → Execution → Outcome → Growth

Upstream work: FareedKhan-dev/kimi-k3-in-c · ggml-org/llama.cpp. The engine that opened this line of work is Fareed Khan's, Apache-2.0, and stays his; Clover does not claim it.


Supporting areas include:

What was built

  • clover-k3/ — the program, how to build it, and the correctness gate it has to reproduce
  • Results — first-token comparison and separate generation outputs
  • Implementation equation — the equation as the program actually evaluates it, and where that differs from the written one
  • Evidence methods — campaigns, configurations, harnesses and reproduction limits

How it was worked out

  • K3 investigation — grouped derivations, measurements, experiments and handoffs
  • Model equation — the model as one composed expression, executed and checked float for float

The direction and the boundaries

Clover-K3 has a measured single-machine result; the broader Clover AI direction remains a proposal. A 2.78-trillion-parameter model runs from its equation on a Ryzen 9 7950X3D, bit-exact against a preserved gate, and emits the same first token as an independent implementation on every one of the 34 prompts tested — in 394.94 seconds against 1344.23, a factor of 3.40 under the recorded configurations. A separate generation run averaged about six seconds per token. These are distinct measurements, not a distributed-system or general quality result.

It will keep improving, and the parts of the principle above that it does not yet reach — the tools that enforce, the serving layer, the evaluation that closes the loop — are the next things to build. They will be held to the same standard: built, gated and measured before they are claimed.

Contributing

Clover is a work in progress. Corrections, disagreements, evidence, implementation experiments, and practical improvements are welcome.

See CONTRIBUTING.md.

来源:GitHub · github.com