DeepSeek 开源六个华为昇腾项目,矩阵内核达到芯片峰值速度的 99.8%。核心项目 TileLang 是 DeepSeek 编写自家 GPU 内核的编程语言,训练 V4 模型的大部分算子已用 TileLang 编写,现在每个都有昇腾版本,同一份源码可编译到华为芯片。
DeepSeek open-sourced six Huawei Ascend projects whose matrix kernels hit 99.8% of the chip's peak speed.
this will help reduce reliance on Nvidia further for them.
The headline project is TileLang, the programming language DeepSeek writes its own GPU kernels in.
Most of the operators that trained its V4 models are written in TileLang, and each now has an Ascend version. That means the same source code can compile for Huawei chips instead of Nvidia ones.
a 2nd repo, DeepGEMM-Ascend, does matrix multiplication and reports 431 BF16 TFLOPS against a 432 ceiling.
DeepEP-Ascend, which moves data between chips, shipped with no license file while the rest are MIT, so nobody can legally reuse it yet.
Liang Wenfeng told investors Huawei could start delivering training chips this quarter.
来源:Rohan Paul · x.com