deepspeedai--deepspeed

Files

T

History

Olatunji Ruwase c952d92a51 Add compile.offload_activation_pin_memory for DeepCompile activation offload (#8258 )

## Summary
- Add `compile.offload_activation_pin_memory` (default `true`) on
`CompileConfig` and wire it into DeepCompile C++ `offloadTensor` via
`at::TensorOptions().pinned_memory(...)`.
- Document honestly: the offload pass is not in the default schedule
(`offload_activation` alone does nothing); pinning here uses ATen/Torch
host pin and does **not** consult `DS_PIN_MEMORY_BACKEND`.

## Test plan
- [ ] `pre-commit run --files` on touched paths (already run locally)
- [ ] Rebuild deepcompile extension and confirm default still pins host
offload buffers when the offload pass is scheduled
- [ ] With a custom schedule that includes activation offload,
`offload_activation_pin_memory: false` yields pageable host buffers

Signed-off-by: Olatunji Ruwase <tunji.ruwase@snowflake.com>
Co-authored-by: Cursor <cursoragent@cursor.com>

2026-08-16 05:13:40 +00:00

adagrad

Fix Type Name Inconsistency & Typo in cpu_adam (#6732 )

2024-11-11 23:31:45 +00:00

adam

feat(zenflow): run the overlapped CPU optimizer in a native process (#8058 )

2026-07-07 02:40:28 +00:00

aio

Split native host pinning into standalone pin_memory op (#8236 )

2026-08-09 13:15:28 +00:00

compile

Add compile.offload_activation_pin_memory for DeepCompile activation offload (#8258 )