-
[issue-2528] [SDK] Add Structured Output Compliance evaluation metric (#2554)
frostbyte_neo 发布于
2025-09-05 13:27:41 +00:00 -
add evaluation structure output compliance
-
update doc
-
Update sdks/python/examples/metrics.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update sdks/python/src/opik/evaluation/metrics/llm_judges/structure_output_compliance/template.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update apps/opik-documentation/documentation/fern/docs/evaluation/metrics/structure_output_compliance.mdx
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update apps/opik-documentation/documentation/fern/docs/evaluation/metrics/structure_output_compliance.mdx
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update sdks/python/src/opik/evaluation/metrics/llm_judges/structure_output_compliance/parser.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
-
add unit test for genrate function
-
Integrate unit test for structured compliances
-
move template test to test_templat.py
-
fix linter issue
-
Update sdks/python/tests/unit/evaluation/metrics/llm_judges/structure_output_compliance/test_template.py
Co-authored-by: Iaroslav Omelianenko yaric_mail@yahoo.com
-
moveclass to scehma.py
-
Update sdks/python/src/opik/evaluation/metrics/llm_judges/structure_output_compliance/schema.py
Co-authored-by: Iaroslav Omelianenko yaric_mail@yahoo.com
- Update sdks/python/src/opik/evaluation/metrics/llm_judges/structure_output_compliance/schema.py
Co-authored-by: Iaroslav Omelianenko yaric_mail@yahoo.com
-
fix minor error
-
fixed integration test failing
-
fix parser unit test failing
-
Add New integration test to validate json schema format in strucutre compliance metric
-
move StructuredOutputComplianceResponseFormat class from metric.py to schema.py
Co-authored-by: Vincent Koc vincentk@comet.com
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
Co-authored-by: Iaroslav Omelianenko yaric_mail@yahoo.com下载附件
-