14 Commits

Author SHA1 Message Date
zhifu gao 62b784b2b9 docs: surface llama.cpp runtime v0.2.0 (#3484)
Signed-off-by: LauraGPT <18321252+LauraGPT@users.noreply.github.com>
2026-08-11 14:17:59 +08:00
zhifu gao 6c3b47c2e5 docs: publish runtime v0.1.9 download links (#3399) 2026-07-23 19:38:51 +08:00
zhifu gao 9b918d74d7 feat(runtime): publish Windows Vulkan binary (#3398)
Build llama.cpp runtime binaries / build-linux-x64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-x64-avx2 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-avx2 (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-arm64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-macos-arm64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-vulkan (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-cuda (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-x64-vulkan (push) Has been cancelled
Build llama.cpp runtime binaries / release (push) Has been cancelled
* feat(runtime): add Windows Vulkan release asset

* fix(ci): install SPIR-V headers for Windows Vulkan

* fix(runtime): make Windows Vulkan package standalone
2026-07-23 18:49:28 +08:00
zhifu gao 5882f3cf79 docs: surface Vulkan llama.cpp runtime in README
Expose the v0.1.8 Linux Vulkan runtime asset in the top-level README docs.
2026-07-22 19:25:17 +08:00
zhifu gao c7f6edb9e6 docs(runtime): mention Vulkan asset in release notes
Build llama.cpp runtime binaries / build-linux-x64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-x64-avx2 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-avx2 (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-arm64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-macos-arm64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-cuda (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-x64-vulkan (push) Has been cancelled
Build llama.cpp runtime binaries / release (push) Has been cancelled
Keep generated runtime release notes aligned with the new Linux Vulkan asset.
2026-07-22 18:44:03 +08:00
zhifu gao e3327be1bd feat(runtime): add Vulkan llama.cpp backend packaging
Add Linux Vulkan packaging and runtime selection for the FunASR llama.cpp SenseVoice GGUF backend.
2026-07-22 18:40:34 +08:00
zhifu gao b798e2679f feat(runtime): add GGUF HTTP transcription wrapper
Expose the llama.cpp/GGUF command-line binaries through a lightweight OpenAI-compatible transcription endpoint.
2026-07-22 18:16:22 +08:00
zhifu gao a2a6ba3ddf docs: clarify Windows CUDA GPU architecture support
Document the current sm_86 Windows CUDA prebuilt limit and direct RTX 50 / Blackwell users to CPU binaries or source builds with CMAKE_CUDA_ARCHITECTURES=120 until a dedicated asset is available.
2026-07-19 18:39:13 +08:00
zhifu gao f1e287edc2 Add Windows CUDA llama.cpp release asset
Build llama.cpp runtime binaries / build-linux-x64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-x64-avx2 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-avx2 (push) Has been cancelled
Build llama.cpp runtime binaries / build-linux-arm64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-macos-arm64 (push) Has been cancelled
Build llama.cpp runtime binaries / build-windows-x64-cuda (push) Has been cancelled
Build llama.cpp runtime binaries / release (push) Has been cancelled
Adds a Windows x64 CUDA release asset for the llama.cpp SenseVoice runtime, with CUDA Toolkit setup, architecture-86 build flags, focused SenseVoice target packaging, docs, and workflow regression tests. Manual workflow dispatch 29656771776 passed all build matrix jobs including build-windows-x64-cuda.
2026-07-19 03:24:07 +08:00
zhifu gao 57721fc8ce Add SenseVoice llama.cpp backend selector (#3247) 2026-07-18 19:16:03 +08:00
zhifu gao 68a21aafbb docs(llama.cpp): fix default GGUF quickstart (#3234)
* docs(llama.cpp): fix default GGUF quickstart

Signed-off-by: 游雁 <zhifu.gzf@alibaba-inc.com>

* fix(llama.cpp): make release quickstart executable

Signed-off-by: 游雁 <zhifu.gzf@alibaba-inc.com>

* fix(llama.cpp): validate Windows release layout

Signed-off-by: 游雁 <zhifu.gzf@alibaba-inc.com>

* test(llama.cpp): require runnable quickstart lines

Signed-off-by: 游雁 <zhifu.gzf@alibaba-inc.com>

---------

Signed-off-by: 游雁 <zhifu.gzf@alibaba-inc.com>
2026-07-15 20:15:07 +08:00
游雁 916c175ec9 test(llama.cpp): validate downloader failure paths 2026-07-15 04:35:18 +00:00
游雁 9c17931645 fix(llama.cpp): download one GGUF variant by default 2026-07-15 04:28:57 +00:00
zhifu gao 3610b759ce test: numerical regression harness (frozen golden vs ggml/VAD/CIF/CTC output) (#3003)
* test: numerical regression harness (frozen golden vs ggml/VAD/CIF/CTC output)

Adds tests/ — runs each runtime tool on a fixed 6 s clip and diffs against frozen
golden output, catching regressions in the ggml graphs, the FSMN-VAD state machine,
the CIF predictor and CTC decode.

- tests/run_regression.sh: auto-detects which tools are built; VAD model is auto-fetched
  (1.7 MB), ASR GGUFs tested when present or with RUN_FULL=1 (downloads from HF).
  Non-zero exit on any mismatch. BIN_DIR/MODELS_DIR overridable.
- tests/sample.wav (~6 s) + tests/golden/*.txt: golden captured on Linux x86-64 with the
  f16 GGUFs from FunAudioLLM/*-GGUF.

Verified locally: all present tools PASS; default mode fetches VAD + skips absent models.

* test: golden as text (binaries now detok in-process; merge after in-binary-detok)

* test: fix sensevoice golden (correct transcription text)
2026-06-20 16:12:24 +08:00