7b9167eaad
* fix(config): do not read a TTS speaker-encoder mmproj as vision support Qwen3-TTS on llama-cpp ships an mmproj holding the speaker encoder and code predictor. VisionSupported() treated any non-empty MMProj as proof of image input, so every such model would be advertised as vision-capable. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(llama-cpp): add TTS request option parsing helper Validates text and speaker reference presence and strictly parses the top_k / top_p per-request params, in a header with no llama.cpp or gRPC dependencies so the standalone C++ unit test gate picks it up. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(llama-cpp): range-check the TTS top_k and top_p request params Format validation alone let NaN, infinity and out-of-range values through. The consumer copies both values into the audio generation input unconditionally and only guards its separate sampler assignment with "> 0", a test NaN also fails, so a NaN reached llama.cpp with the guard never firing. top_k must now be >= 0 and top_p must fall within 0.0 to 1.0 inclusive, with the bound written as a negated in-range test so NaN is rejected rather than silently accepted. Also cover the two checks the suite could not previously kill: the whole-string check in the float parser and the int32 range check. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(llama-cpp): bump pin to f9e832c10 and carry the TTS server task Picks up ggml-org/llama.cpp#26254 (Qwen3-TTS via mtmd) and #26536 (the short-input audio chunk fix). Adds 0002-add-server-task-type-tts.patch, the server-side half of the still-draft #26603, so TTS runs through the slot scheduler instead of racing it. Remove that patch when #26603 merges. The patch is rebased on top of the score patch: its tokenize-switch hunk collided with the SERVER_TASK_TYPE_SCORE case, and its lone SRV_WRN call passes no variadic argument, which the macro cannot expand. The score patch itself needed no refresh. Also fixes fallout from the bump in grpc-server.cpp: upstream dropped the per-slot n_ctx argument from server_schema::eval_llama_cmpl_schema. Only the schema branch loses it, since forks predating the server-schema split still expect the old argument list. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(llama-cpp): implement the TTS and TTSStream RPCs Both were declared in backend.proto but unimplemented. They now submit a SERVER_TASK_TYPE_TTS task and drain the response reader, the same shape PredictStream uses. The streaming path emits a leading sample_rate message and then raw PCM, because ModelTTSStream builds the WAV header itself; the non-streaming path emits a complete WAV to the requested dst. The streamed samples are converted from the pipeline's float32 to signed 16-bit first. MTMD_HELPER_GEN_AUDIO_OUTTYPE_PCM hands back floats, while the header ModelTTSStream writes announces 16-bit samples, so shipping the floats verbatim would decode as noise. prepare.sh and CMakeLists.txt now stage tts_request_options.h alongside the other grpc-server helpers, and register its standalone test with ctest the way passthrough_options_test is registered. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(llama-cpp): mask non-codec tokens for Qwen3-TTS generation The Qwen3-TTS gen-audio pipeline maps a sampled backbone token to a codebook row with an unchecked subtraction, in mtmd-helper-gen.cpp: inp.code0 = sampled - codec_0; For ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF the vocab is 155008 tokens, <|codec_0|> is 151936 and the codec codes end at 153983. The model's own tokenizer.ggml.suppress_tokens holds 1023 ids covering 153984..155007, every special above the codec range except <|codec_eos_token|> (154086) which stays reachable as the stop token. Nothing masks the text range 0..151935, so the backbone can sample a text token at any step, the subtraction goes negative, and ggml_compute_forward_get_rows aborts the whole backend process on GGML_ASSERT(i01 >= 0 && i01 < ne01). Complete the mask upstream started: bias every token below <|codec_0|> to -INFINITY for TTS tasks so only codec codes and the codec EOS remain reachable. The biases are appended to task.params.sampling.logit_bias, which common_sampler_init already merges with the model's suppress tokens into one llama_sampler_init_logit_bias, so no sampler is added to the chain. Measured cost is 0.082 ms per sampled token and 1.16 MB, set against a forward pass in the multi-millisecond range. It lands in launch_slot_with_task rather than in a route handler so that llama.cpp's own POST /tts and LocalAI's TTS/TTSStream RPCs are both covered, and <|codec_0|> is resolved from the vocab rather than hardcoded so a model without it is left alone. This is reproducible with upstream's own llama-tts and no LocalAI code loaded, aborting at frame 55 on Q4_K_M and frame 71 on Q8_0, so it is neither a quantization artifact nor an artifact of the gRPC adapter. Two further defects in the same draft pipeline still prevent end-to-end audio; they are independent of this one and are recorded in the task report for an upstream bug report. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(llama-cpp): bump pin to 9de0fcf2b and drop the TTS codec mask Upstream fixed the Qwen3-TTS abort in ggml-org/llama.cpp c8e03ce81 ("mtmd/ggml: add ggml_build_forward_order", #26649), landed one hour after the previous pin. ggml_build_forward_expand marks a tensor and all its ancestors for compute, so using it as a pure ordering hint defeated ggml_build_forward_select and made GEN_WAV calls execute the GEN_CODE branch against a stale inp_code0, hitting the get_rows bound assert in ggml_compute_forward_get_rows. That single defect accounts for every abort seen on this model, so 0003-mask-non-codec-tokens-for-tts.patch is removed rather than rebased. The mask changed the observed behavior, but it was perturbing a graph ordering bug rather than fixing a sampling one: at the new pin the whole path works without it. Keeping it would have meant carrying a 152k-entry logit bias, and rebasing it on every pin bump, for no benefit. Verified at 9de0fcf2b with only 0001 and 0002 applied, which both apply clean with no fuzz and needed no rebase: non-streaming HTTP 200, 410924 bytes, 8.56 s RIFF (little-endian) data, WAVE audio, Microsoft PCM, 16 bit, mono 24000 Hz streaming HTTP 200, 560684 bytes, 11.68 s, exactly one RIFF at byte 0, same format, which also exercises the float32-to-s16 conversion at runtime for the first time Pristine unpatched llama-tts at the same pin now also completes, 130 frames to a valid WAV, where it aborted at frame 55 before. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(llama-cpp): clear the TTS slot sequence between requests Only the first TTS request in a backend process succeeded. Every later one failed instantly, in about 0.13 s, with "TTS prompt processing failed" from step_prompt, regardless of streaming or non-streaming and regardless of the text. With LOCALAI_SINGLE_ACTIVE_BACKEND=true the process is kept alive between requests, so a deployment would have served exactly one utterance per backend start. The cause is missing KV hygiene, not anything in the gRPC adapter. TTS slots never enter the shared batch: pre_decode() returns early for them and process_tts_slots() drives them instead, so they skip the prompt-cache bookkeeping that clears a slot's sequence between requests. Nothing in the gen-audio path makes up for it: mtmd_helper_gen_audio_reset only clears host-side buffers, and the pipeline always decodes from position 0 into the sequence identified by slot.id. So the second task on a slot writes positions 0..N over the first task's tokens and llama_decode fails. Fix is one call to slot.prompt_clear(), the same helper the normal path uses, in the SERVER_TASK_TYPE_TTS branch of launch_slot_with_task before set_input. It goes into 0002 rather than a new patch file because it is a defect in the code that patch introduces, and the header now records it as ours so we know whether it still needs carrying if #26603 merges without it. Verified in one backend process, different text on every request: three consecutive non-streaming requests, three consecutive streaming requests, and an interleaved non-streaming, streaming, non-streaming, streaming run. All ten returned HTTP 200 with RIFF ... WAVE audio, Microsoft PCM, 16 bit, mono 24000 Hz, the streamed ones carrying exactly one RIFF header at byte 0, and every output measured as real speech rather than silence or a truncated fragment. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(llama-cpp): expose max_frames for TTS requests The Qwen3-TTS backbone does not always emit <|codec_eos_token|>, and when it does not, generation runs to upstream's 512-frame n_predict default. At the model's 12.5 Hz frame rate that is 40.96 s of audio, which a short input can trigger: one request in this session produced 40.96 s for a ten-word sentence. prepareTTSTask hardcoded n_predict to -1, so callers had no way to bound it. Add a max_frames key alongside top_k and top_p, parsed with the same strict whole-string parsing so a typo is an error rather than a silently truncated value, and rejected with a field-naming message when negative. 0 keeps the existing sentinel convention and means unset, so a request that omits it behaves exactly as before. Named max_frames rather than n_predict because frames are what the parameter means at a TTS endpoint: one frame is 0.08 s of audio. The 512-frame default is deliberately unchanged. Lowering it would truncate legitimately long inputs, which is a worse failure than an occasionally overlong one. Verified end to end on one text of thirty words: max_frames=25 HTTP 200, 96044 bytes, 2.00 s, exactly 25 frames max_frames=50 HTTP 200, 192044 bytes, 4.00 s, exactly 50 frames no max_frames HTTP 200, 572204 bytes, 11.92 s, stopped at its own codec EOS after 149 frames, unchanged behavior max_frames=-1 InvalidArgument "max_frames must be >= 0, got \"-1\"" max_frames=many InvalidArgument "max_frames must be an integer, got \"many\"" Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(llama-cpp): send the TTS sample rate up front, and tidy three review items Four items from the Task 4 review. Streaming first-byte latency. TTSStream sent the sample-rate reply only once the first audio result arrived, and a chunk needs a whole 72-frame window, roughly 5.8 s of audio and far longer in wall time on CPU. The Go side blocks on that reply before it can emit the WAV header, so a streaming client sat at zero bytes for the whole stretch. The rate is a property of the loaded model and is available synchronously from mtmd_gen_audio_get_info, so it now goes out immediately after post_task and the rate_sent bookkeeping is gone. Measured on a warm model, first byte drops from 30.48 s to 0.014 s, and the output is still a valid WAV with exactly one RIFF header at byte 0. Unchecked close. The non-streaming path ignored ofstream::close(), so a failure that only surfaces on flush was reported as success while leaving a truncated file at dst. It now returns INTERNAL like the other write failures. Wrong comment on set_lang. gen_audio::inp::get() already maps a stored blank to nullptr, so our guard is behavior-preserving, not behavior-fixing. The comment claimed otherwise; the code was right. Repetition penalty. penalty_last_n = -1 is inert at this pin, because llama_sampler_init_penalties clamps it with std::max(penalty_last_n, 0) and then builds a disabled sampler, so the 1.05 penalty never applies. Upstream's README attributes looping to a missing repeat_penalty, so it was worth testing as a root-cause fix for the model running to the frame cap. Dropping the line lets the sampling default of 64 apply, which was confirmed in the sampler chain trace as penalty_last_n = 64 with repeat_penalty = 1.050. Over 15 uncapped short requests each way it did not help: 0 of 15 ran to the cap with the penalty inert, 1 of 15 with it active. Both lines are therefore kept for parity with upstream's draft, and a comment now records that the pair is inert and why, so the next reader does not believe a penalty is applied. max_frames remains the way to bound output. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * build(llama-cpp): let unpatched forks opt out of the TTS task turboquant and bonsai copy grpc-server.cpp into llama.cpp forks that do not carry our patches. disable-tts-task.sh injects the same kind of preprocessor switch disable-score-task.sh already uses, so those builds answer UNIMPLEMENTED rather than failing to compile. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(config): keep a TTS speaker-encoder projector out of vision detection Task 1 exempted a declared-TTS model's mmproj from VisionSupported, but the first real gallery entry with an mmproj still came back vision-capable through two paths the earlier fix did not close. GuessUsecases has no FLAG_VISION branch, so it falls through to true for any chat-ish model. That is not just a wrong answer at the call site: syncKnownUsecasesFromString rewrites KnownUsecaseStrings from HasUsecases, and the loader calls it more than once per config file, so the guessed FLAG_VISION is written out and parsed back into KnownUsecases as if the operator had declared it. Give GuessUsecases a FLAG_VISION branch that defers to the same explicit signals VisionSupported uses. Second, llama.cpp builds an mtmd context for the speaker-encoder projector and reports its media marker on the first chat probe, which resurrected vision after the model had been used once. Apply the same declared-TTS exemption to MediaMarker that the mmproj check already had. Verified against the qwen3-tts-llamacpp-q4 gallery entry: no vision capability and no image input modality, before load, after a TTS request, and after a chat probe. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(gallery): add Qwen3-TTS entries for the llama-cpp backend Two entries over upstream's own GGUF conversion, Q8_0 and Q4_K_M, each pairing a backbone with the Q8_0 projector. Named to sit alongside the existing qwen3-tts-cpp entries rather than replace them. Also tags the llama-cpp backend text-to-speech / TTS so the backend browser surfaces the capability. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs: cover Qwen3-TTS on the llama-cpp backend Adds the gallery variants, the two-file mmproj configuration, the required voice reference, and the language and sampling knobs. Also corrects the streaming-support list, which named only voxcpm. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(config): register llama-cpp as a TTS and voice-cloning backend The branch taught the llama-cpp backend to serve Qwen3-TTS and shipped two gallery entries for it, but never told the capability table. llama-cpp still declared only the text RPCs and usecases, so: - VoiceCloningForModel returned nil at the capability check, before it ever reached the model's own tts.voice_cloning override, and /tts answered 400 "selected model does not support reference-audio voice cloning" for any localai://voice-profiles/... voice. No model YAML could opt back in. - GET /api/backends/usecases did not list tts for llama-cpp, so the gallery greyed out the TTS filter for the entries this branch adds. - The React TTS page saw voice_cloning: null and kept both models out of the Voice Library. Add the TTS RPCs and usecase, and the reference-audio contract. The contract needs narrowing, because the per-backend switch in VoiceCloningForModel ends in a permissive default: an unnarrowed entry would have advertised reference-audio cloning on every GGUF chat model in the gallery. Narrow on the declared TTS usecase rather than the model name. The TTS checkpoints are the only llama-cpp models carrying known_usecases: [tts]; name matching would have to guess at third-party repacks, and "base", the substring the neighbouring Qwen and vLLM cases key on, is a routine word in text-model names. The check reads the declared bit directly instead of going through HasUsecases, which falls through to GuessUsecases and would hand the decision to a heuristic that never had a llama.cpp TTS model in mind. DefaultUsecases stays [chat]: a bare GGUF served by llama.cpp is a chat model, and both the gallery filter and the importer read that field. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(gallery): declare what nemotron-3-nano-omni actually accepts The entry is backend: vllm-omni with known_usecases: [chat, completion], no mmproj and no media marker, so it used to report vision only through the blanket GuessUsecases fallthrough that the vision branch in this branch removed. Nemotron 3 Nano Omni is a multimodal understanding model: image, video and audio in, text out. Declaring that is what the sibling vllm-omni-qwen3-omni-30b already does. known_usecases gains vision only. FLAG_VIDEO is video GENERATION, an output modality, and this model generates none; video and audio input belong in known_input_modalities, which is where AudioInputSupported and VideoInputSupported read them from. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(importers): import a Qwen3-TTS GGUF repo as TTS, not chat The llama-cpp importer hardcodes known_usecases: [chat] and assigns any mmproj-matching file as a vision projector, so ggml-org/Qwen3-TTS-12Hz-1.7B- Base-GGUF imported as a chat model with vision. Both fields were wrong, and the model was unreachable from /tts and from the Voice Library. Filenames cannot fix this. A Qwen3-TTS repo has the exact shape of a vision repo, one backbone GGUF plus one mmproj-*.gguf, so the projector's own header is the only honest signal: mtmd writes clip.has_gen_audio_encoder for the projectors it can drive as a speech pipeline and refuses to build one without it. Probe the selected mmproj for that flag, reusing the range-fetch the MTP detection already does, and declare tts when it is set. The mmproj assignment then stops reading as vision on its own, since a declared-TTS model already exempts its projector from vision detection. The probe is best-effort like the MTP one: a network blip leaves the chat default in place rather than failing the import. Verified against the real artifacts on disk: the Qwen3-TTS projector reports gen-audio, its backbone does not. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(llama-cpp): stop non-TTS models crashing on the new pin Two regressions, both hit every ordinary llama-cpp model and neither was caught locally because every test on this branch loaded a TTS model. The first is a null dereference. server_slot::tts_ctx::reset() called mtmd_helper_gen_audio_reset() unconditionally, but the gen-audio pipeline is only allocated for models carrying a gen-audio mmproj, and upstream's implementation reads ctx->pipeline before null-checking anything. Since server_slot::reset() runs during slot initialization for every model, any non-TTS model segfaulted the backend the moment it loaded. Guard the call on the is_supported() predicate already defined beside it, and keep the plain field resets unconditional. The second is unrelated to TTS and came in with the pin bump. PredictOptions.Penalty is a bare proto float, so a caller that names no repetition penalty sends 0 rather than omitting the field. Since 9de0fcf2b, common_sampler_init() rejects a non-positive penalty_repeat outright because it would divide logits by zero, turning every such request into "Failed to initialize samplers". Treat 0 as unset and leave llama.cpp's own neutral default in place. Verified with the same suite CI runs, which is what caught both: tests/e2e-backends passes 6 of 6 including the load and predict specs that were red. Qwen3-TTS still synthesises on both paths, 24 kHz mono 16-bit WAV with exactly one RIFF header on the streamed output. Assisted-by: Claude:claude-fable-5 [Claude Code] Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
210 lines
9.2 KiB
C++
210 lines
9.2 KiB
C++
// SPDX-License-Identifier: MIT
|
|
|
|
#include <cstdio>
|
|
#include <map>
|
|
#include <string>
|
|
|
|
#include "tts_request_options.h"
|
|
|
|
static int failures = 0;
|
|
|
|
static void check(bool ok, const char * name) {
|
|
if (!ok) {
|
|
++failures;
|
|
std::fprintf(stderr, "FAIL: %s\n", name);
|
|
}
|
|
}
|
|
|
|
static void test_accepts_a_minimal_valid_request() {
|
|
const auto opts = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "en", {});
|
|
|
|
check(opts.ok, "minimal request is accepted");
|
|
check(opts.error.empty(), "minimal request has no error");
|
|
check(opts.text == "Hello world", "text passes through");
|
|
check(opts.voice_path == "/models/voices/ref.wav", "voice path passes through");
|
|
check(opts.language == "en", "language passes through");
|
|
check(opts.top_k == 0, "top_k defaults to the unset sentinel");
|
|
check(opts.top_p == 0.0f, "top_p defaults to the unset sentinel");
|
|
check(opts.max_frames == 0, "max_frames defaults to the unset sentinel");
|
|
}
|
|
|
|
static void test_rejects_empty_text() {
|
|
const auto opts = llama_grpc::parse_tts_request_options(
|
|
"", "/models/voices/ref.wav", "en", {});
|
|
|
|
check(!opts.ok, "empty text is rejected");
|
|
check(opts.error.find("text") != std::string::npos, "empty-text error names the field");
|
|
}
|
|
|
|
static void test_rejects_missing_speaker_reference() {
|
|
// Qwen3-TTS Base has no built-in speaker; without a reference it produces
|
|
// an arbitrary voice, so this must be a hard error rather than a surprise.
|
|
const auto opts = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "", "en", {});
|
|
|
|
check(!opts.ok, "missing voice is rejected");
|
|
check(opts.error.find("voice") != std::string::npos, "missing-voice error names the field");
|
|
}
|
|
|
|
static void test_parses_sampling_params() {
|
|
const std::map<std::string, std::string> params{
|
|
{"top_k", "40"},
|
|
{"top_p", "0.85"},
|
|
};
|
|
const auto opts = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", params);
|
|
|
|
check(opts.ok, "sampling params are accepted");
|
|
check(opts.top_k == 40, "top_k is parsed");
|
|
check(opts.top_p > 0.849f && opts.top_p < 0.851f, "top_p is parsed");
|
|
check(opts.language.empty(), "absent language stays empty");
|
|
}
|
|
|
|
static void test_rejects_malformed_sampling_params() {
|
|
const auto bad_top_k = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_k", "forty"}});
|
|
check(!bad_top_k.ok, "non-numeric top_k is rejected");
|
|
check(bad_top_k.error.find("top_k") != std::string::npos, "top_k error names the field");
|
|
|
|
const auto bad_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", ""}});
|
|
check(!bad_top_p.ok, "empty top_p is rejected");
|
|
|
|
const auto trailing = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_k", "40abc"}});
|
|
check(!trailing.ok, "top_k with trailing garbage is rejected");
|
|
|
|
const auto trailing_float = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "0.8abc"}});
|
|
check(!trailing_float.ok, "top_p with trailing garbage is rejected");
|
|
|
|
// std::stol returns a long, which is wider than int32_t on 64-bit hosts, so
|
|
// an in-range-for-long value still has to be caught before the narrowing.
|
|
const auto overflow_top_k = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_k", "99999999999"}});
|
|
check(!overflow_top_k.ok, "top_k beyond int32 range is rejected");
|
|
check(overflow_top_k.error.find("top_k") != std::string::npos,
|
|
"top_k overflow error names the field");
|
|
}
|
|
|
|
static void test_rejects_out_of_range_sampling_params() {
|
|
// These reach mtmd_helper::gen_audio::inp unconditionally downstream, where
|
|
// the "> 0" sampler guard does not screen them, so they must die here.
|
|
const auto negative_top_k = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_k", "-5"}});
|
|
check(!negative_top_k.ok, "negative top_k is rejected");
|
|
check(negative_top_k.error.find("top_k") != std::string::npos,
|
|
"negative top_k error names the field");
|
|
|
|
const auto negative_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "-0.1"}});
|
|
check(!negative_top_p.ok, "negative top_p is rejected");
|
|
check(negative_top_p.error.find("top_p") != std::string::npos,
|
|
"negative top_p error names the field");
|
|
|
|
const auto large_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "1.5"}});
|
|
check(!large_top_p.ok, "top_p above 1.0 is rejected");
|
|
|
|
// NaN survives a naive "p < 0.0f || p > 1.0f" range test because every
|
|
// comparison against NaN is false. This case pins the correct form.
|
|
const auto nan_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "nan"}});
|
|
check(!nan_top_p.ok, "NaN top_p is rejected");
|
|
|
|
const auto inf_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "inf"}});
|
|
check(!inf_top_p.ok, "infinite top_p is rejected");
|
|
}
|
|
|
|
static void test_accepts_sampling_param_boundaries() {
|
|
const auto zero_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "0.0"}});
|
|
check(zero_top_p.ok, "top_p of 0.0 is accepted");
|
|
check(zero_top_p.top_p == 0.0f, "top_p of 0.0 round-trips");
|
|
|
|
const auto one_top_p = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_p", "1.0"}});
|
|
check(one_top_p.ok, "top_p of 1.0 is accepted");
|
|
check(one_top_p.top_p == 1.0f, "top_p of 1.0 round-trips");
|
|
|
|
const auto zero_top_k = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_k", "0"}});
|
|
check(zero_top_k.ok, "top_k of 0 is accepted");
|
|
}
|
|
|
|
static void test_parses_max_frames() {
|
|
// The consumer maps a positive value onto n_predict and leaves upstream's
|
|
// 512-frame default in place when it is unset, so the sentinel matters as
|
|
// much as the parsed value.
|
|
const auto opts = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", "120"}});
|
|
|
|
check(opts.ok, "max_frames is accepted");
|
|
check(opts.max_frames == 120, "max_frames is parsed");
|
|
|
|
const auto absent = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"top_k", "40"}});
|
|
check(absent.ok, "a request without max_frames is accepted");
|
|
check(absent.max_frames == 0, "absent max_frames leaves the unset sentinel");
|
|
|
|
const auto zero = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", "0"}});
|
|
check(zero.ok, "max_frames of 0 is accepted");
|
|
check(zero.max_frames == 0, "max_frames of 0 means unset");
|
|
}
|
|
|
|
static void test_rejects_malformed_max_frames() {
|
|
const auto negative = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", "-1"}});
|
|
check(!negative.ok, "negative max_frames is rejected");
|
|
check(negative.error.find("max_frames") != std::string::npos,
|
|
"negative max_frames error names the field");
|
|
|
|
const auto non_numeric = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", "many"}});
|
|
check(!non_numeric.ok, "non-numeric max_frames is rejected");
|
|
check(non_numeric.error.find("max_frames") != std::string::npos,
|
|
"non-numeric max_frames error names the field");
|
|
|
|
const auto trailing = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", "120abc"}});
|
|
check(!trailing.ok, "max_frames with trailing garbage is rejected");
|
|
|
|
const auto empty = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", ""}});
|
|
check(!empty.ok, "empty max_frames is rejected");
|
|
|
|
const auto overflow = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"max_frames", "99999999999"}});
|
|
check(!overflow.ok, "max_frames beyond int32 range is rejected");
|
|
}
|
|
|
|
static void test_ignores_unknown_params() {
|
|
// Unknown keys are backend-specific knobs meant for other TTS engines. A
|
|
// request routed here must not fail just because it carries them.
|
|
const auto opts = llama_grpc::parse_tts_request_options(
|
|
"Hello world", "/models/voices/ref.wav", "", {{"exaggeration", "0.7"}});
|
|
|
|
check(opts.ok, "unknown params are ignored, not rejected");
|
|
}
|
|
|
|
int main() {
|
|
test_accepts_a_minimal_valid_request();
|
|
test_rejects_empty_text();
|
|
test_rejects_missing_speaker_reference();
|
|
test_parses_sampling_params();
|
|
test_rejects_malformed_sampling_params();
|
|
test_rejects_out_of_range_sampling_params();
|
|
test_accepts_sampling_param_boundaries();
|
|
test_parses_max_frames();
|
|
test_rejects_malformed_max_frames();
|
|
test_ignores_unknown_params();
|
|
|
|
if (failures == 0) {
|
|
std::printf("tts_request_options_test: all checks passed\n");
|
|
}
|
|
return failures;
|
|
}
|