-
[issue-2520] [SDK] Added Sycophancy Evaluation Metric (#2624)
frostbyte_neo 发布于
2025-11-10 02:01:54 +00:00 -
Added Sycophancy Evaluation Metric in SDK, FE, Docs
-
Added unit tests, fixed reviews
- Implemented suggestions from reviews on the previous commit and made
necessary changes. - Added unit tests for the sycophancy_evaluation_metric just like how
it is applied for the other metrics
- Fixed reviews on added tests.
Moved test for invalid score into the unit tests as it uses a dummy
model and doesnt need to be in integration tests. removed unnecessary
@model_parametrizer from the same test.-
Resolving merge conflicts and improving tests from feedback
-
Updating default rebuttal model for LiteLLM compatibility
-
Added explanations in examples
-
Update test_evaluation_metrics.py for formatting after new stuff from main
-
Update test_evaluation_metrics.py
-
Update sdks/python/src/opik/evaluation/metrics/llm_judges/syc_eval/metric.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update sdks/python/src/opik/evaluation/metrics/llm_judges/syc_eval/metric.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update sdks/python/src/opik/evaluation/metrics/llm_judges/syc_eval/metric.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update sdks/python/src/opik/evaluation/metrics/llm_judges/syc_eval/metric.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
-
Update sycophancy_evaluation.mdx
-
Update metric.py
-
Update llm.ts
-
Update llm.ts
-
Update __init__.py
-
Update metric.py
-
chore: lint
-
Update sdks/python/examples/metrics.py
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
- Update apps/opik-documentation/documentation/fern/docs/evaluation/metrics/sycophancy_evaluation.mdx
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com
-
Update parser.py
-
Update parser.py
Co-authored-by: Iaroslav Omelianenko yaric_mail@yahoo.com
Co-authored-by: Vincent Koc vincentk@comet.com
Co-authored-by: Vincent Koc vincentkoc@ieee.org
Co-authored-by: Copilot 175728472+Copilot@users.noreply.github.com下载附件
-