-
[CI/Build] Add comprehensive test for layerwise KV transfer (#1822)
frostbyte_neo 发布于
2025-10-20 21:10:28 +00:00 - Add layerwise test
Signed-off-by: Shaoting-Feng shaotingf@uchicago.edu
- Fix get_kv_cache_torch_dtype
Signed-off-by: Shaoting-Feng shaotingf@uchicago.edu
- Revert cdiv change
Signed-off-by: Shaoting-Feng shaotingf@uchicago.edu
- Fix utils.py
Signed-off-by: Shaoting-Feng shaotingf@uchicago.edu
- Rerun again
Signed-off-by: Shaoting-Feng shaotingf@uchicago.edu
- Add piecewise cuda graph
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu
- Remove useless info
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu
- Tune the gain
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu
- Debug PD
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu
- Add back all test cases
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu
- Add back all test cases
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu
Signed-off-by: Shaoting-Feng shaotingf@uchicago.edu
Signed-off-by: Shaoting Feng shaotingf@uchicago.edu下载附件