跳到正文
RadarAI· X:阶跃星辰 StepFun (@StepFun_ai)·· 2 天前AI 评分58

阶跃星辰发布 Step 5 Preview,获 NVIDIA Day-0 支持

阶跃星辰 Step 5 Preview 发布并获 NVIDIA Day-0 支持

AI 导读

阶跃星辰发布 Step 5 Preview,支持用 vLLM 或 SGLang 提供 OpenAI 兼容 API,也可用 Transformers 离线推理,并适配多种芯片平台和推理框架。

正文 · 原文

StepFun· @StepFun_ai · X·2026-10-15 21:00· 2 小时前AI 评分62

AI 导读

阶跃星辰宣布 Step 5 Preview 支持多种部署方式,可通过 vLLM 或 SGLang 提供 OpenAI 兼容 API,也可用 Transformers 离线推理,并适配多种芯片平台和推理框架。

正文

Run it your way:

  • Serve an OpenAI-compatible API with vLLM or SGLang
  • Run offline inference with Transformers
  • Adapted for multiple chip platforms and inference frameworks

Day-0 support from @NVIDIAAI:
try it on https://build.nvidia.com/stepfun-ai/step-5-preview,
fine-tune with NeMo AutoModel https://github.com/NVIDIA-NeMo/Automodel/blob/main/docs/model-coverage/llm/stepfun-ai/step-5-preview.mdx,
deploy with model-free NIM https://catalog.ngc.nvidia.com/orgs/nim/nvidia/containers/vllm-model-free-nim-experimental,
and run on Blackwell.

Also available on Day 0 with @FireworksAI_HQ, @togethercompute, @modal, @DeepInfra and @FeatherlessAI.

来源:StepFun · x.com

NVIDIA 英伟达部署工程产品更新

#产品更新#部署/工程

来源:RadarAI · aihot.news