Jeyzma:用 Go/TinyGo 在浏览器里跑 llama.cpp 的 TypeSafeAI 替代品
Jeyzma is TypeSafeAI minus $850M plus Go/TinyGo/llama.cpp in the browser
Jeyzma 是 TypeSafeAI 的替代方案,用 Go 编写、经 TinyGo 编译为 WebAssembly,在浏览器中 100% 本地运行 System One 模型推理,无需服务器、API key,数据不外传。模型针对状态回答带类型的问题,为每个选项输出概率而非生成文本,支持 Choice、Score、Noul 等题型,有 WebGPU 时用 GPU,否则回退 CPU。
System One in your browser
Go make a decision! Run System One models, 100% local in your browser using WebAssembly written in Go.
A System One model answers a typed question about a state. It gives a probability for each option instead of writing an answer. This page runs all inference in your browser using yzma compiled with TinyGo. There is no server, no API key, and no data goes anywhere.
Question types
| Type | Question | Answer space | Example output |
|---|---|---|---|
| Choice | Which team handles this? | billing, technical, sales | billing |
| Score | How urgent is this? | low, medium, high | high |
| Noul | The customer is angry. | true, false | true |
Uses the GPU with WebGPU when available, otherwise the CPU.
looking for a backend
Model
starting
Answers
来源:Hacker News · jeyzma.com