项目文件夹 工单

github-featured / deepspeedai--deepspeed

项目文件夹 工单

发布

0 发布 128 Git 标签

RSS 订阅源

• v0.12.6 c00388a2ef

  比较

  Mixtral FastGen Support (#4828)

  frostbyte_neo 发布于 2023-12-21 00:05:26 +00:00

  Adds support for Mixtral with FastGen. Key features implemented:

  1. Top-2 MoE support
  2. Better support for RoPE thetas
  3. The mistral model implementation

  ---

  Co-authored-by: Michael Wyatt michaelwyatt@microsoft.com

  下载附件

  • 源代码 (ZIP)
  • 源代码 (TAR.GZ)