github-featured / kvcache-ai--ktransformers

发布

0 发布 40 Git 标签

RSS 订阅源
  • v0.7.0 e80614fc2d
    比较

    [feat](kt-sft): Activation reuse & Int8 kernel refactor & native block-FP8 LoRA SFT (#2141)

    frostbyte_neo 发布于 2026-08-17 08:25:14 +00:00 | 27 次提交 在此版本后已推送到 main

    • feat(sft): support distributed activation reuse policies

    • feat(sft): add frozen-base INT8 LoRA training

    • fix(sft): make INT8 expert LoRA rank-zero authoritative

    • fix(sft): preserve DeepSeek router LoRA routing

    • feat(sft): enable persistent INT8 LoRA training

    • perf(sft): accelerate INT8 VNNI with oneDNN BRGEMM

    • perf(int8): fuse oneDNN compensation into backward repack

    • [feat]: support BF16 expert LoRA training

    • [fix]: honor forwarded activation policy in SFT workers

    • feat(sft): add native block-FP8 routed expert LoRA

    • feat(sft): expose explicit expert placeholder ownership

    • fix(sft): publish fused adapter artifacts atomically

    • feat(sft): own artifact and adapter lifecycle contracts

    • fix(sft): harden artifact and rank-local contracts

    • fix(sft): auto-adapt owner before adapter restore

    • style(sft): keep lifecycle comments concise

    • fix(sft): require fused adapter manifests

    • test(sft): use spawn for distributed workers

    • fix(sft): preserve runtime checkpoint metadata

    • fix(sft): validate wrapped runtime configuration

    • fix(sft): preserve expert format provenance

    • fix(sft): own routed experts during device dispatch

    • test(sft): lock explicit quantization conflict

    • fix(cpu): make shared memory buffers lifetime-safe

    • release: prepare v0.7.0

    下载附件