-
[OPIK-4961] [OPIK-5207] [P SDK] [M2] Python SDK: Add project_name parameter to dataset, prompt, and experiment methods (#5684)
发布于
2026-03-25 14:15:47 +00:00 - [OPIK-4961] Add
project_namefield toDatasetand update related tests
- Introduced the
project_namefield in theDatasetclass to associate datasets with specific projects. - Updated dataset initialization in tests and CLI to include the new
project_nameparameter when creating datasets. - Added a corresponding
project_nameproperty with getter functionality in theDatasetclass.
- [OPIK-4961] Add
project_namesupport across SDK modules and update related tests
- Introduced the
project_nameparameter throughout SDK methods for dataset, experiment, evaluation suite, and prompt operations. - Updated retrieval, creation, and search functions to handle
project_namecorrectly. - Added missing TODO comments to integrate
project_namewith the backend when applicable. - Synchronized test cases to validate new
project_namebehavior.
- [OPIK-4961] Refactor
project_namehandling in dataset and experiment methods
- Adjusted method parameter order to make
project_nameoptional and consistent with SDK conventions. - Added
project_nameresolution logic for improved dataset ID retrieval.
-
[OPIK-4961] Updated Fern code
-
[OPIK-4961] Updated Fern code
-
[OPIK-4961] Add
project_namesupport todelete_datasetand dataset streaming methods
- Updated
delete_datasetto accept an optionalproject_nameparameter, with default resolution logic. - Extended dataset streaming and related classes to handle
project_name. - Added unit tests to validate
project_namebehavior indelete_dataset.
- [OPIK-4961] Add
project_namesupport to prompt creation, retrieval, and search methods
- Updated prompt creation, retrieval, and history functions (
create_prompt,get_prompt,get_prompt_history) to includeproject_namehandling. - Extended ChatPrompt methods with
project_namesupport. - Refactored relevant classes and tests to validate
project_nameresolution and propagation.
- [OPIK-4961] Extend
project_namesupport to chat prompts and update relevant tests
- Added
project_nameparameter to chat prompt creation, retrieval, search, and history methods (create_chat_prompt,get_chat_prompt,get_chat_prompt_history,search_prompts). - Updated chat prompt-related tests to validate
project_namepropagation. - Fixed typos in code examples for
get_prompt_historyandget_chat_prompt_history.
- [OPIK-4961] Add
project_namesupport to dataset creation, filtering, and version view methods
- Updated dataset creation, filtering, and version view methods (
create_dataset,get_items,get_version_view) to includeproject_namehandling. - Extended E2E tests to validate
project_namepropagation and expected behavior. - Added assertions for
project_namecomparison in dataset verifications.
- [OPIK-4961] Expand
project_namesupport across evaluation suites, experiments, and verifiers
- Added
project_namehandling to evaluation suite creation, retrieval, and propagation methods. - Updated experiments, verifiers, and rest operations to support
project_name. - Enhanced E2E tests to validate
project_namepropagation and assertions within evaluation scenarios.
- [OPIK-4961] Add
project_nameparameter to evaluation test cases
- Updated various unit tests to include
project_namein evaluation suite, experiment, and dataset setups. - Added mock
project_nameinitialization for dataset tests to ensure proper test coverage.
- [OPIK-4961] Add
project_nameto evaluation and prompt test cases
- Incorporated
project_nameparameter across evaluation and prompt test suites. - Updated test cases to validate
project_namepropagation for datasets, experiments, and prompts. - Enhanced verifications and assertions to include
project_nameconsistency checks.
- [OPIK-4961] Add
project_nametostream_experimentsin REST operations
- Updated
rest_operations.stream_experimentsto includeproject_nameparameter. - Ensured proper propagation of
project_nameto REST client calls.
-
[OPIK-4961] Resolved merge conflicts and updated
-
[OPIK-4961] Resolved merge conflicts and updated
-
[OPIK-4961] Fixed flacky tests
-
[OPIK-4961] Remove unused
_resolve_project_idmethod fromopik_client -
[OPIK-4961] Update test cases to include
project_namein experiment and suite retrievals
- Added
project_nameparameter to experiment and evaluation suite retrievals in test cases. - Ensured consistency of verifications and assertions with
project_nameusage.
- [OPIK-4961] Implemented backward compatibility E2E tests for OPIK v1.x
- Set default value for the
project_nameparameter toNonein dataset verification utility. - Introduced extensive compatibility tests for evaluation APIs, covering dataset versioning, assertions, execution policies, and pass/fail logic.
- Enhanced validation checks for persistence, retrieval, and consistency of evaluation suite configurations.
-
[OPIK-4961] Fixed prompts test to avoid flakiness
-
[OPIK-4961] Add Python SDK Compatibility V1.x E2E tests
- Introduced a new GitHub Actions workflow for Python SDK Compatibility V1.x End-to-End tests.
- Updated existing E2E test workflow to ignore compatibility V1 tests.
- [OPIK-4961] Remove default value for
project_nameinget_experiment_with_unique_namefunction
下载附件
- [OPIK-4961] Add