-
[OPIK-5878] [SDK] [FE] [BE] fix: sync LLM judge prompt across TS SDK, FE, and BE with Python SDK (#6246)
frostbyte_neo 发布于
2026-04-14 12:33:54 +00:00 - [OPIK-5878] [SDK] [FE] [BE] fix: sync LLM judge prompt across TS SDK, FE, and BE with Python SDK
Align the test suite LLM judge user prompt template across all components
to match the Python SDK (source of truth). Adds BEGIN/END delimiters for
input, output, and assertions sections, and replaces the simpler
assertions instructions with richer evaluation criteria guidance.
Also changes reasoning language requirement from "same language as
assertion text" to English.Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- docs: add OPIK-5735 comments noting serialized prompts are ignored by backend
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- docs: clarify that no consumer reads serialized prompt messages
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- docs: clarify messages are unused for test suites, required by schema
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- test(python-sdk): update LLM judge test to expect English reasoning language
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
Co-authored-by: Claude Opus 4.6 (1M context) noreply@anthropic.com
下载附件