GitHub·· 8 天前AI 评分36
CrowdGPT v0.5 发布:用众包算力训练大语言模型
Vxtzq/CrowdGPT
AI 导读
CrowdGPT v0.5 发布,该项目通过志愿者贡献的算力分布式训练任意规模的大语言模型,无需资金、API key 或中心化 GPU 集群。新版本增强了 GUI,coordinator 迁移至 https,并支持一条命令快速安装。训练数据通过 pull request 提交审核。
正文
Website · Architecture · Training Data
The best 0$ AI.
🥳🥳🥳 CrowdGPT v0.5 released 🥳🥳🥳
Key changes
- Enhanced GUI version
- Migrated to https for coordinator
- Easy install
What is CrowdGPT?
CrowdGPT is a project for training arbitrary big LLMs using volunteered compute.
Instead of one datacenter doing all the work, CrowdGPT distributes training across participating machines.
All of this working without money, API keys or any centralized GPU clusters.
How it works
See ARCHITECTURE.md
⚡ Quick instalation (one command)
For Linux/MacOS
curl -sSL https://raw.githubusercontent.com/Vxtzq/CrowdGPT/main/install.sh | bashFor Windows
iwr -useb https://raw.githubusercontent.com/Vxtzq/CrowdGPT/main/install.bat -OutFile install.bat; .\install.bat
⏳ Legacy installation (deprecated)
git clone https://github.com/Vxtzq/CrowdGPT.git
cd CrowdGPTInstall the dependencies for your hardware:
# NVIDIA pip install -r requirements_cuda.txt # AMD pip install -r requirements_rocm.txt # Windows / DirectML pip install -r requirements_directml.txt # CPU / Apple Silicon pip install -r requirements.txt
Then:
python client.py
For the automatic installer, see docs/easy_install.md.
🧠 Contribute
Training data is curated through pull requests.
See docs/DATA.md to contribute.
来源:GitHub · github.com