发布

  • convert: convert bf16 vision weights to fp16 (#12324)

    frostbyte_neo 发布于 2025-09-18 00:43:17 +00:00

    This change moves back to converting bf16 vision weights to fp16,
    specifically if they start with the name "v." (such as v.blk.0.attn_k.weight).

    This fixes a bug where converted images are failing because they are trying
    to call im2col which doesn't have a bf16 kernel in ggml.

    下载附件