-
[NA] [SDK] [GHA] test: stabilize Gemini + agentic-judge integration tests (#7405)
frostbyte_neo 发布于
2026-07-08 18:39:59 +00:00 Three related changes to stop provider-driven flakiness in the real-model
integration suites:- Agentic LLM-judge tests: run the Anthropic lanes against claude-sonnet-4-6
instead of claude-haiku-4-5. On the agentic path (tools in the request, so
response_format is best-effort) Haiku wrapped verdicts in prose/```json
fences; Sonnet follows the structured-output contract reliably (the one-shot
suite already used Sonnet). - GenAI + ADK test matrices: run only the oldest and newest supported Python
versions (3.10, 3.14). These suites make live Vertex AI calls against the
shared opik-sdk-tests GCP project; the full 3.10-3.14 matrix re-multiplied
those calls into 429 RESOURCE_EXHAUSTED. Endpoints cover version-specific
breakage at a fraction of the request volume; max-parallel cap kept. - Remove the broken GenAI rate-limit retry helpers: _is_rate_limit_error
checked exception.response.status_code, which raises AttributeError on
google-genai's ClientError (no such attribute), so the retry crashed instead
of retrying. With the matrix trim as the 429 mitigation, the dead helper and
its decorators are removed rather than repaired.
Co-authored-by: Claude Opus 4.8 (1M context) noreply@anthropic.com
下载附件
- Agentic LLM-judge tests: run the Anthropic lanes against claude-sonnet-4-6