发布

  • fix: model load for unsupported embedding models (#12311)

    frostbyte_neo 发布于 2025-09-18 23:11:08 +00:00

    with #12181, there's now support for embeddings in ollama engine.
    this is done by mutating the architecture and adding _embed when it
    detects an embedding model. however this introduced a bug where if
    an embedding model was run based on an existing ollama engine model
    without an embedding implementation, e.g. llama4, it will pass the
    initial arch support check but fail when actually loaded.

    there's currently two entrypoints to creating a model. previously this
    second entrypoint was necessary because calling model.New would also
    load the model. since #11818, this is no longer th case so merge them
    to reduce complexity

    下载附件