Clover Framework:Kimi K3 前向传播单机复现框架
santhoshsathish94/clover-framework
Clover Framework 开源了 clover-k3,将 Kimi K3 前向传播还原为数学表达式并在 Ryzen 9 7950X3D 单机上直接执行,在全部 34 个测试提示上输出与独立实现相同的首个 token,耗时 394.94 秒对 1344.23 秒,加速 3.40 倍。该模型参数量为 2.78 万亿,单独生成运行平均每 token 约 6 秒,但并非分布式系统或通用质量结果。
Clover Framework · System, Human and AI working together for meaningful outcomes
cloverframework.com · Quickstart · AGENTS.md · Docs
Clover is a framework for working with System, Human, and AI to produce meaningful outcomes.
The framework itself is documented at cloverframework.com and in docs/.
This repository contains the documentation, practical guidance, case studies, and the implementation work around Clover.
Start here
- Clover Framework — understand the framework
QUICKSTART.md— use Clover on real workAGENTS.md— AI agent operating guidancedocs/README.md— documentation indexcase-studies/— real work and outcomes- Research — investigations, proposals and hypotheses, with their limits
- Run Clover-K3 — executable single-machine reference
- Repository map — where each kind of material belongs
Clover AI
Clover AI is the implementation arm of the project: an open-source AI system that can produce meaningful engineering outcomes while remaining bounded, observable, verifiable, and accountable.
The first thing built under it is clover-k3/ — the Kimi K3
forward pass reduced to its mathematics and executed directly. It emits the
same token as an independent implementation of the same model on all 34 prompts
tested, in under a third of the time. What it cost and what it does not show are
in results and scope.
Its central principle is:
The model can propose.
The system decides.
The tools enforce.
Evidence verifies.
Humans remain accountable.
The implementation follows the Clover cycle:
Context → Direction → Execution → Outcome → Growth
Upstream work: FareedKhan-dev/kimi-k3-in-c · ggml-org/llama.cpp. The engine that opened this line of work is Fareed Khan's, Apache-2.0, and stays his; Clover does not claim it.
Supporting areas include:
What was built
clover-k3/— the program, how to build it, and the correctness gate it has to reproduce- Results — first-token comparison and separate generation outputs
- Implementation equation — the equation as the program actually evaluates it, and where that differs from the written one
- Evidence methods — campaigns, configurations, harnesses and reproduction limits
How it was worked out
- K3 investigation — grouped derivations, measurements, experiments and handoffs
- Model equation — the model as one composed expression, executed and checked float for float
The direction and the boundaries
- Clover AI direction — broader proposed implementation
- AI-Fire research — dependency and concentration argument; source-ledger work remains open
docs/07-outcome.md— what counts as evidence, and what does notdocs/08-governance.md— accountability and governancedocs/ai-responsibility/— AI responsibility
Clover-K3 has a measured single-machine result; the broader Clover AI direction remains a proposal. A 2.78-trillion-parameter model runs from its equation on a Ryzen 9 7950X3D, bit-exact against a preserved gate, and emits the same first token as an independent implementation on every one of the 34 prompts tested — in 394.94 seconds against 1344.23, a factor of 3.40 under the recorded configurations. A separate generation run averaged about six seconds per token. These are distinct measurements, not a distributed-system or general quality result.
It will keep improving, and the parts of the principle above that it does not yet reach — the tools that enforce, the serving layer, the evaluation that closes the loop — are the next things to build. They will be held to the same standard: built, gated and measured before they are claimed.
Contributing
Clover is a work in progress. Corrections, disagreements, evidence, implementation experiments, and practical improvements are welcome.
See CONTRIBUTING.md.
来源:GitHub · github.com