跳到正文
Hacker News· deadprogram·· 8 天前AI 评分28

Jeyzma:用 Go/TinyGo 在浏览器里跑 llama.cpp 的 TypeSafeAI 替代品

Jeyzma is TypeSafeAI minus $850M plus Go/TinyGo/llama.cpp in the browser

AI 导读

Jeyzma 是 TypeSafeAI 的替代方案,用 Go 编写、经 TinyGo 编译为 WebAssembly,在浏览器中 100% 本地运行 System One 模型推理,无需服务器、API key,数据不外传。模型针对状态回答带类型的问题,为每个选项输出概率而非生成文本,支持 Choice、Score、Noul 等题型,有 WebGPU 时用 GPU,否则回退 CPU。

正文 · 原文

System One in your browser

Go make a decision! Run System One models, 100% local in your browser using WebAssembly written in Go.

A System One model answers a typed question about a state. It gives a probability for each option instead of writing an answer. This page runs all inference in your browser using yzma compiled with TinyGo. There is no server, no API key, and no data goes anywhere.

Question types

TypeQuestionAnswer spaceExample output
ChoiceWhich team handles this?billing, technical, salesbilling
ScoreHow urgent is this?low, medium, highhigh
NoulThe customer is angry.true, falsetrue

Uses the GPU with WebGPU when available, otherwise the CPU.

looking for a backend

Model

starting

Answers

来源:Hacker News · jeyzma.com