-
[NA] [BE] Seed test suite, prompt, agent configs, and experiments in demo data (#6426)
frostbyte_neo 发布于
2026-04-22 13:35:08 +00:00 - [NA] [BE] Seed test suite, agent configs, prompt, and experiments in demo data
Extends the post-signup demo data generator so the demo workspace showcases
the full regression-testing story end-to-end: an evaluation suite with 20
items, a shared system prompt with two versioned commits, two agent-config
blueprints tagged prod/staging pinning those commits, and two experiments
(80% prod / 100% staging) with realistic agent-style span trees and
assertion results carrying proper names + pass/fail reasons.Also removes 8 orphan spans from demo_data.py whose parent trace was missing,
which was causing 404s when opening those spans in the UI.Co-Authored-By: Claude Opus 4.7 (1M context) noreply@anthropic.com
- [NA] [BE] Gate test-suite seed on fresh chatbot project to preserve idempotency
create_demo_chatbot_project now returns True when it writes fresh data and
False when it short-circuits on a 409 (project already exists). create_demo_data
only runs create_demo_test_suite_and_experiments when the chatbot seed ran —
so a re-invocation of the signup hook against a populated workspace is a
true no-op, which is what test_create_demo_data_idempotence expects.Co-Authored-By: Claude Opus 4.7 (1M context) noreply@anthropic.com
Co-authored-by: Claude Opus 4.7 (1M context) noreply@anthropic.com
下载附件