github-featured / deepspeedai--deepspeed

发布

v0.16.7 c66fdaf3c9

比较
Make sure it's not None before offloading contiguous_grad_buffer (#7227)

frostbyte_neo 发布于 2025-04-18 06:49:51 +00:00

Resolves #7223

When DeepCompile is enabled in ZeRO-3, contiguous_grad_buffer is
released, so we should check and make sure it's not None before we
continue.

https://github.com/deepspeedai/DeepSpeed/blob/227a60c0c412ddf4619401b5d8d9d1674aee17b5/deepspeed/compile/init_z3.py#L22-L25

Signed-off-by: Hollow Man hollowman@opensuse.org
Co-authored-by: Masahiro Tanaka 81312776+tohtana@users.noreply.github.com
下载附件
- 源代码 (ZIP)
- 源代码 (TAR.GZ)