github-featured / comet-ml--opik

发布

0 发布 8,340 Git 标签

RSS 订阅源
  • 1.10.44-4559 8ecc79c78d
    比较

    [OPIK-4449] eval suites (#5367)

    frostbyte_neo 发布于 2026-03-19 10:43:36 +00:00

    • OPIK-4449 initial

    • OPIK-4449 experiment unnified, removed FF

    • OPIK-4449 execution policy + evaluators

    • OPIK-4449 fix linter

    • OPIK-4449 fix deps circular issue

    • OPIK-4449 fix description column accessor and polish eval suite UI

    Fix table column reading description from row.data.description instead of
    row.description. Also remove card shadows, reduce textarea min rows, and
    clean up editItem merge logic in draft store.

    • OPIK-4449 fix toggling off item-level execution policy override

    Stop stripping undefined values in the draft store so that
    execution_policy: undefined is preserved as an explicit "clear override"
    signal. Use the in operator in UI components to distinguish absent keys
    from explicit undefined, and emit clear_execution_policy flag in the
    save payload for the backend.

    • OPIK-4449 rename remaining "dataset" labels to "evaluation suite" in UI

    • OPIK-4449 generate descriptions and assertions when expanding eval suite items with AI

    Enhance the "Expand with AI" feature to automatically generate item-level
    descriptions and LLM judge assertions for evaluation suite items. The prompt
    now requests _opik_description and _opik_evaluator_assertions magic keys in
    the generated JSON, which are extracted and converted to proper item fields
    before adding to the draft store. Suite-level evaluator assertions are
    included in the prompt context to avoid duplication. The generated samples
    preview dialog now shows descriptions and assertions inline.

    • OPIK-4449 fix prettier lint in ExecutionPolicyCell

    • OPIK-4449 experiment updates

    • OPIK-4449 merge fixes

    • refactor

    • OPIK-4449 open full panel with all fields when creating eval suite item

    Wire "Create evaluation suite item" button to create a draft item in
    the store and open EvaluationSuiteItemPanel instead of the legacy
    AddDatasetItemSidebar/AddEditDatasetItemDialog. The panel detects new
    items via draftStatus and adjusts UI accordingly (title, dropdown,
    navigation). Regular datasets keep the existing flow unchanged.

    • [OPIK-4449] Rename internal evaluator references to assertion

    Rename evaluator-converters.ts to assertion-converters.ts and update
    all internal function names and imports to use assertion-centric naming.
    Rename OPIK_EVALUATOR_ASSERTIONS_FIELD constant to OPIK_ASSERTIONS_FIELD.
    API-facing field names (evaluators on DatasetItem/DatasetVersion) are
    preserved unchanged.

    • OPIK-4449 new Figma updates

    • Fix lint issues: remove unused useMemo import and fix prettier formatting

    • Fix prettier formatting in remaining eval suite files

    • OPIK-4449 refactoring

    • OPIK-4449 fix issues

    • OPIK-4449 experiment UI updates

    • OPIK-4449 pass rate

    • OPIK-4449 merge main

    • [OPIK-5030] [FE] Fix UI crash on unfinished eval suite experiments

    Guard pass_rate with isNumber() before assigning to scores object,
    preventing null/undefined from propagating into chart tick calculator.
    Harden useChartTickDefaultConfig to filter non-finite values and
    bail early in generateNiceTicks, avoiding infinite loop and RangeError.

    • OPIK-4449 fix issues

    • [OPIK-5039] [FE] Fix view evaluation item button and lint

    • OPIK-4449 add type for create modal

    • OPIK-4449 remove internal plan/design docs from branch

    • OPIK-4449 fix prettier formatting issues

    下载附件