-
[OPIK-7083] test: harden Ollie/Agent-Playground local-runner E2E against prod latency (#7225)
frostbyte_neo 发布于
2026-06-25 09:43:15 +00:00 - [OPIK-7083] [QA] test: harden Ollie/Agent-Playground local-runner E2E against prod latency
Two t3-nightly tests fail only on production while passing on staging:
- Agent Playground: page.goto used waitUntil networkidle, which never
settles because the page embeds the Ollie assistant iframe (open
streaming connection) — the goto hung to the 300s test timeout. Drop
networkidle; readiness is already asserted by waitForHeading + the
Connected badge. - Ollie /improve: the agentic loop is slower on a cold prod assistant
pod, so the greeting action buttons can render after the 60s budget.
Raise the improveButton visibility wait to 150s (the POM's cold-pod
tolerance); the test's overall budget is 600s.
Both validated as passing on staging (25s / 1.9m).
Implements OPIK-7083: Harden E2E Ollie/Agent-Playground local-runner tests against production latency
Co-Authored-By: Claude Opus 4.8 noreply@anthropic.com
- test(agent-playground): wait for the input field, not just the panel label
Addresses PR review: the "Test input" panel label and Connected badge render
before the runner's introspected input form mounts, so assert the actual
"Enter query..." field is visible in the connected-state step before fillInput
runs. Validated on staging (~20s).Co-Authored-By: Claude Opus 4.8 noreply@anthropic.com
Co-authored-by: Claude Opus 4.8 noreply@anthropic.com
下载附件