-
MLX: wire up scheduler selected context size for ps (#16918)
发布于
2026-06-26 15:47:03 +00:00 | 106 次提交 在此版本后已推送到 mainIn the PS output, expose the scheduler selected size (clamped by model context size) instead of always reporting the model max context. This will help provide a hint to clients to keep the context size below this value to avoid paging and poor performance on smaller VRAM systems.
下载附件