DeepSeek开源周第二天,很高兴介绍 DeepEP - 第一个用于 MoE 模型训练和推理的开源 EP 通信库。
高效且优化的全对全通信
通过 NVLink 和 RDMA 支持节点内和节点间
用于训练和推理预填充的高吞吐量内核
用于推理解码的低延迟内核
原生 FP8 调度支持
灵活的 GPU 资源控制,用于计算通信重叠
DeepSeek开源周第二天,开源 EP通信库DeepEP
2025-02-25 02:42:18
Disclaimer:
1. The information provided does not constitute investment advice. Investors should make independent decisions and bear all risks themselves.
2. The copyright of this content belongs to the original author. The views expressed herein are solely those of the author and do not represent the stance or position of this website.
Next article:
萨尔瓦多今日增持7枚比特币