-
[OPIK-5795][OPIK-5796][OPIK-5797][OPIK-5798] [BE][FE][SDK] feat: rename evaluation_suite to test_suite across the entire codebase (#6197)
frostbyte_neo 发布于
2026-04-14 15:10:28 +00:00 - [OPIK-5795] [BE] feat: rename evaluation_suite to test_suite in backend APIs and models
Rename all backend references from evaluation_suite to test_suite:
- Java enums (DatasetType, EvaluationMethod)
- Service/DAO SQL string literals
- Class renames (EvalSuite* -> TestSuite*)
- Config key (evalSuite -> testSuite)
- Metadata keys (eval_suite_* -> test_suite_*)
- DB migrations for enum value changes
- All test files updated
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- chore(codegen): regenerate OpenAPI spec and Fern SDK types
Fern codegen picks up the evaluation_suite → test_suite enum rename
from the backend. Updates generated REST types in both Python and
TypeScript SDKs, plus both OpenAPI spec copies.Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- [OPIK-5798] [SDK] feat: rename evaluation_suite to test_suite in TypeScript SDK
Rename all hand-written TypeScript SDK references:
- EvaluationSuite -> TestSuite (class, types, tests)
- evaluateSuite -> evaluateTestSuite (function, tests)
- Updated all exports, imports, and examples
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- [OPIK-5797] [SDK] feat: rename evaluation_suite to test_suite in Python SDK
Rename all hand-written Python SDK references:
- EvaluationSuite -> TestSuite (class, types)
- EvaluationSuiteResult -> TestSuiteResult
- Client methods: create/get/get_or_create_evaluation_suite -> test_suite
- REST operations: create/update_evaluation_suite_dataset -> test_suite
- Report directory: opik_evaluation_suite_reports -> opik_test_suite_reports
- Updated all imports, exports, tests, and .gitignore
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- fix(backend): update missed comment in ExperimentAggregatesDAO
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- [OPIK-5796] [FE] feat: rename evaluation_suite to test_suite in frontend
Rename all frontend references from evaluation_suite to test_suite:
- Component files and directories (v1 and v2)
- Route paths (/evaluation-suites -> /test-suites)
- Enum values (DATASET_TYPE.TEST_SUITE, EVALUATION_METHOD.TEST_SUITE)
- UI strings ("Evaluation Suite" -> "Test Suite")
- Store, hooks, and type definitions
- E2E test references
- Documentation references
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- fix(python-sdk): rename evaluate_suite to evaluate_test_suite
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- style(python-sdk): apply ruff format fixes
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- fix: correct grammar "an test suite" to "a test suite"
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- style(python-sdk): apply ruff format to test_test_suite files
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- fix(migration): add intermediate step for MySQL enum rename
MySQL MODIFY COLUMN fails with "Data truncated" when existing rows
contain the old enum value. Fix by first adding the new value, then
updating rows, then removing the old value.Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- fix(migration): normalize changeset author to danield
Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com
- [OPIK-5795] [FE] fix: align DATASET_TYPE and EVALUATION_METHOD enum values to 'evaluation_suite'
The DB migration from 'evaluation_suite' to 'test_suite' hasn't run yet,
so the backend still serializes TEST_SUITE as 'evaluation_suite'. Align
frontend enum values to match, and replace hardcoded "test_suite" string
in checkIsTestSuite() with the EVALUATION_METHOD enum constant.- [OPIK-5795] [FE] fix: rename remaining 'evaluation' labels to 'test suite'
- 'Edit evaluation item' -> 'Edit test suite item'
- 'Select evaluation type' -> 'Select test type'
-
[OPIK-5795] [FE] fix: remove unused Plus import, add missing buildDocsUrl import, fix isEvalSuite → isTestSuite rename
-
[OPIK-5795] [SDK] chore: regenerate OpenAPI specs and SDK types after evaluation_suite → test_suite rename
-
[OPIK-5795] [SDK] fix: use evaluation_suite DB value for dataset type and evaluation method in Python and TypeScript SDKs
-
[OPIK-5795] [SDK] fix: use ExperimentWriteEvaluationMethod constant to satisfy TypeScript type checker
-
[OPIK-5795] [SDK] fix: update test assertions to expect 'evaluation_suite' instead of 'test_suite'
-
[OPIK-5795] [SDK] fix: update Python unit test assertions to expect 'evaluation_suite' not 'test_suite'
-
[OPIK-5795] [SDK] Fix evaluation_method literal and restore dropped test
- Revert incorrect rename of "evaluation_suite" → "test_suite" in evaluation_method Literal (backend API value must stay as-is)
- Restore test_run_tests__explicit_client__propagated_to_worker_threads that was lost during merge conflict resolution
- [OPIK-5795] [SDK] Delete outdated compatibility_v1 test_test_suite
File was intentionally deleted in main; kept by mistake during merge
conflict resolution. Coverage exists in tests/e2e/evaluation/test_test_suite.py.- [OPIK-5795] [FE] Fix lint errors in TestSuiteItemsTab
- Remove unused noDataText variable
- Fix prettier formatting on inline ternary
- [OPIK-5795] [FE] Fix remaining lint errors in TestSuiteItemsTab
- Remove unused deletedIds, itemLabel variables and useDeletedIds import
- Remove stray blank line
Co-authored-by: Claude Opus 4.6 (1M context) noreply@anthropic.com
Co-authored-by: Thiago Hora thiagoh@comet.com下载附件