github-featured / mudler--localai

发布

0 发布 177 Git 标签

RSS 订阅源
  • v4.6.0 38350d363e
    比较

    fix(backends): enable ROCm/HIP GPU offload for ggml audio backends (#10666) (#10667)

    frostbyte_neo 发布于 2026-07-04 07:08:20 +00:00 | 1007 次提交 在此版本后已推送到 master

    qwen3-tts-cpp, omnivoice-cpp, acestep-cpp and vibevoice-cpp shipped
    rocm-* variants that silently ran on CPU ([Load] backend: CPU). Two
    coupled defects:

    • The Makefiles passed -DGGML_HIPBLAS=ON, but the vendored ggml only
      understands -DGGML_HIP=ON (GGML_HIPBLAS was removed upstream), so the
      ggml-hip backend target was never created and no GPU code was built.
    • The CMake foreach that links the ggml GPU backends into the module
      listed blas/cuda/metal/vulkan but not hip, so even a built ggml-hip
      would not have been linked and its static backend registration would
      never run.

    CUDA users were unaffected because cublas passes the correct GGML_CUDA=ON
    and the foreach already links cuda. Mirror the proven llama-cpp hipblas
    block (ROCm clang CC/CXX + AMDGPU_TARGETS) and add hip to each foreach.
    Upstream picks the best device via ggml_backend_init_best(), so no
    runtime flag is needed once HIP is compiled and linked.

    Assisted-by: Claude:claude-opus-4-8[1m] [Claude Code]

    Signed-off-by: Ettore Di Giacinto mudler@localai.io
    Co-authored-by: Ettore Di Giacinto mudler@localai.io

    下载附件