-
Disable chunked prefill and/or prefix caching when MLA is enabled (#12642)
frostbyte_neo 发布于
2025-02-01 07:46:57 +00:00 | 15232 次提交 在此版本后已推送到 mainFrom @mgoin in https://github.com/vllm-project/vllm/pull/12638
I cannot push to that branch, therefore a new PR to unblock release.
Signed-off-by: mgoin michael@neuralmagic.com
Signed-off-by: simon-mo simon.mo@hey.com
Co-authored-by: mgoin michael@neuralmagic.com下载附件