-
fix(ci): perf job gates on the real frame-budget guard, not TDD stubs (#915)
frostbyte_neo 发布于
2026-06-02 16:31:55 +00:00 After #914 fixed collection, the perf job actually ran the suite and
exposed that test_api_throughput.py / test_inference_speed.py are TDD
red-phase stubs (every test suffixed_should_fail_initially) that time
a mock that sleeps — not a real perf signal. They carry machine-
dependent wall-clock asserts (actual_rps >= 40, batch_time < individual_time)
that are inherently flaky on shared CI runners, plus a cross-class
fixture-scope bug (fixture 'standard_model' not found). Result: 3 failed,
10 errored — by design, not a regression.Forcing those green would manufacture a false signal. Instead, gate only
on test_frame_budget.py, which times the real CSIProcessor pipeline
against the ADR 50 ms per-frame budget (single-frame, p95/100-frames,
+Doppler) — a genuine regression guard. Verified locally: 3 passed.The stub files remain in-repo for local TDD; they re-enter CI when their
features are implemented and the mock-timing asserts are made deterministic.下载附件