11 Commits

Author SHA1 Message Date
knowhy 5a77bf175f feat(llmtr): complete chat-route coverage with 27 remaining models (#4817)
* feat(llmtr): complete chat-route coverage with 27 remaining models

Adds the LLMTR chat routes not covered by #3038. Provider entries are
override-only on top of models/ lab metadata; six lab entries are added
where the underlying model had no models/<lab>/ file yet.

Costs and context windows come from https://llmtr.com/api/models.
reasoning_options were measured against POST /v1/chat/completions rather
than inferred: the gateway reports its per-model thinking control in the
400 body for an unsupported reasoning_effort value.

Models whose lab facts could not be established from the lab's own
documentation or an existing first-party entry are deliberately left out.

* fix(llmtr): re-measure reasoning controls across every request surface

Review feedback: reasoning_effort is only one of the surfaces this gateway
forwards, so an effort-only probe cannot justify reasoning_options = [].
Re-probed every entry across nine request shapes (reasoning_effort top-level
and nested, reasoning true/false, :think and :fast suffixes,
reasoning.max_tokens, thinkingConfig.thinkingBudget, thinking_budget,
enable_thinking, thinking.type), temperature 0, each result reproduced.

The real control on Qwen routes is Alibaba's native enable_thinking, which the
gateway forwards. Seven routes previously marked [] are genuine toggles:
qwen-plus, qwen-flash, qwen3-vl-plus, qwen3.5-plus, qwen3.5-397b-a17b,
qwen3.6-plus and qwen3-max. qwen3-max additionally overrides reasoning = true,
since it emits reasoning on demand despite the base entry saying otherwise.

gemini-2.5-flash-lite, mimo-v2.5, mimo-v2.5-pro and sonar-deep-research keep []
after testing all nine surfaces; each now records that evidence in its header.
The perplexity low|medium|high|fast|pro|auto suffixes are search_type controls,
not reasoning - the gateway names the parameter in its own rejection.

Wire-path comments moved into the leading header block on all ten files that
carry reasoning_options, since sync strips mid-file comments.

Drops qwen3.6-27b-free: its reasoning surface could not be measured because the
key's daily free-model quota was exhausted, and an unverified [] is exactly what
this change is correcting.

* llmtr: align solar-pro2 reasoning effort with the Upstage baseline

* llmtr: align solar-pro3 reasoning effort with the Upstage baseline

* llmtr: add measured thinking_budget control to qwen/qwen-flash

* llmtr: add measured thinking_budget control to qwen/qwen-plus

* llmtr: add measured thinking_budget control to qwen/qwen3-max

* llmtr: add measured thinking_budget control to qwen/qwen3-vl-plus

* llmtr: add measured thinking_budget control to qwen/qwen3.5-397b-a17b

* llmtr: add measured thinking_budget control to qwen/qwen3.5-plus

* llmtr: add measured thinking_budget control to qwen/qwen3.6-flash

* llmtr: add measured thinking_budget control to qwen/qwen3.6-plus

* llmtr: add measured thinking_budget control to qwen/qwen3.7-plus

* llmtr: align solar-pro4 effort wire comment with the measured field
2026-08-16 16:00:40 -05:00
Faisal 345f14a096 feat(provider): add IBM watsonx.ai catalog (#4379)
Add the native watsonx.ai provider and its active token-priced model metadata.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-08 20:45:06 -05:00
Samrath 43ff4ad9b5 feat(pioneer): add 26 models (Kimi K3, Claude Opus 5, GPT-5.6) (#3814)
* fix(pioneer): filter API alias dupes, derive cost, honor base-model reasoning

Pioneer /v1/models returns each served model twice: once under its real
id and once under a duplicate "anthropic/pioneer/<id>" alias. Drop the
aliases so the sync no longer authors phantom "anthropic/pioneer/*" TOMLs.

Also derive cost from the API's per-1M-token prices for newly created
models (previously cost was only preserved from an existing file), and
trust the base model's authored reasoning flag instead of Pioneer's
boilerplate reasoning levels, which are identical for every model and
were wrongly marking non-reasoning models (e.g. Pixtral) as reasoning.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* feat(pioneer): add frontier and open models via base_model inheritance

Add 26 Pioneer models, each inheriting provider-agnostic facts through
base_model rather than duplicating them inline.

New model metadata entries:
- anthropic/claude-opus-5 (released 2026-07-24)
- alibaba/qwen2.5-coder-0.5b, alibaba/qwen3-235b-a22b-instruct-2507
- deepseek/deepseek-v3, deepseek/deepseek-v3.1
- meta/llama-3.2-1b, meta/llama-3.2-3b
- mistral/codestral-22b-v0.1, mistral/magistral-small-2506,
  mistral/ministral-8b-instruct-2410

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

* fix(qwen): set tool_call=false for Qwen2.5-Coder-0.5B base model

The served id and weights are the base (pretrained) checkpoint, not the
Instruct variant. The Qwen model card states base models are not
recommended for conversation and documents no tool/function calling, so
tool_call=true was inaccurate. Matches the Llama base entries in this PR.

---------

Co-authored-by: Samrath <samrath@Samraths-MacBook-Pro-6.local>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-05 15:19:10 -05:00
opencode-agent[bot] 92d9a6d051 feat: expand benchmarks for current major models (#3989)
* feat: add Gemini 3.6 Flash and Kimi K3 benchmarks

* feat: expand current model benchmark coverage

---------

Co-authored-by: Aiden Cline <rekram1-node@users.noreply.github.com>
2026-08-03 10:04:20 -05:00
github-actions[bot] 042b0c773c fix: #3025 2026-07-04 08:51:58 +00:00
Adam 5c281e4feb feat: model descriptions 2026-07-01 14:16:49 -05:00
Houtan Bastani 61a153e6bb Update Mistral Large 2411 release date
Set mistral-large-2411 release_date and last_updated  metadata to 2024-11-18.

Evidence:

https://github.com/mistralai/platform-docs-public/blob/main/src/schema/models/models/mistral-large-2-1-24-11.ts#L9
2026-06-12 11:35:43 +02:00
Aiden Cline 4bbb2c486f Merge pull request #1986 from anomalyco/feat/mistral-reasoning-options
feat(mistral): add reasoning effort options
2026-06-04 14:24:57 -05:00
Aiden Cline 5fe04aee59 fix(mistral): correct medium latest alias 2026-06-04 14:13:20 -05:00
Adam c8a52d19c1 feat(models): add coding benchmarks and weights (#2000)
* feat(models): add coding benchmarks and weights

* feat(models): add more coding benchmarks

* feat(models): add agent benchmark scores

* feat(models): normalize benchmark metadata
2026-06-04 11:09:53 -05:00
Adam f6c6f04367 feat(models): add model metadata (#1974)
* feat(models): add model metadata

* feat(models): rename model metadata namespaces
2026-06-03 15:13:54 -05:00