-
[NA] [QA] test(e2e): add Optimization Studio E2E coverage (#7477)
frostbyte_neo 发布于
2026-07-16 12:10:43 +00:00 Adds an end-to-end suite for Optimization Studio (v2), driving the studio UI
to launch real optimization runs and asserting they complete healthily:- form renders + Optimize enable-gating (no LLM run)
- GEPA + Equals launch → completed, with structural health checks
(num_trials, objective, scores in range — never "improved"), the detail-page
Trials tab (Best row) + Best-trial-config panel, and the studio logs read
path (presigned URL + gunzip) - Hierarchical Reflective variant
New POM (pom/optimization-studio.page.ts), backend-client methods
(getOptimization, pollOptimizationStatus, deleteOptimization,
getOptimizationLogs) + OptimizationRef, and the pollOptimizationStatus helper.Tagged @t2-cuj + @t1-stsaas (kept out of plain @t1-smoke). Adds a
test:t1-stsaas script (@t1-smoke + @t1-stsaas) so customer/stsaas regression
runs can include the studio checks.Notes on the fragile bits, baked into the assertions:
- a healthy run can score 0 (weak model ≠ exact-match), so we assert scores
present + in [0,1], not improvement - the studio-logs presigned URL is only client-reachable on real object stores
(cloud/self-hosted), not local MinIO's internal host; the log content check
is enforced on non-oss deployments and skipped-with-warning on local oss - selectors tolerate the "Select item source" vs "Select a dataset" rename
Co-authored-by: Claude Opus 4.8 noreply@anthropic.com
下载附件