跳到正文
GitHub·· 8 天前AI 评分36

CrowdGPT v0.5 发布:用众包算力训练大语言模型

Vxtzq/CrowdGPT

AI 导读

CrowdGPT v0.5 发布,该项目通过志愿者贡献的算力分布式训练任意规模的大语言模型,无需资金、API key 或中心化 GPU 集群。新版本增强了 GUI,coordinator 迁移至 https,并支持一条命令快速安装。训练数据通过 pull request 提交审核。

正文

Website · Architecture · Training Data

Tokens Processed

The best 0$ AI.


🥳🥳🥳 CrowdGPT v0.5 released 🥳🥳🥳

Key changes

  • Enhanced GUI version
  • Migrated to https for coordinator
  • Easy install

What is CrowdGPT?

CrowdGPT is a project for training arbitrary big LLMs using volunteered compute.

Instead of one datacenter doing all the work, CrowdGPT distributes training across participating machines.

All of this working without money, API keys or any centralized GPU clusters.

How it works

See ARCHITECTURE.md

⚡ Quick instalation (one command)

For Linux/MacOS

curl -sSL https://raw.githubusercontent.com/Vxtzq/CrowdGPT/main/install.sh | bash

For Windows

iwr -useb https://raw.githubusercontent.com/Vxtzq/CrowdGPT/main/install.bat -OutFile install.bat; .\install.bat

⏳ Legacy installation (deprecated)

git clone https://github.com/Vxtzq/CrowdGPT.git
cd CrowdGPT

Install the dependencies for your hardware:

# NVIDIA
pip install -r requirements_cuda.txt

# AMD
pip install -r requirements_rocm.txt

# Windows / DirectML
pip install -r requirements_directml.txt

# CPU / Apple Silicon
pip install -r requirements.txt

Then:

python client.py

For the automatic installer, see docs/easy_install.md.


🧠 Contribute

Training data is curated through pull requests.

See docs/DATA.md to contribute.


crowdgpt.net · Architecture · Data

来源:GitHub · github.com