feat(executor): add TTFT tracking and reporting for enhanced performance metrics
frostbyte_neo
发布于
2026-05-27 18:59:24 +00:00
| 759 次提交 在此版本后已推送到 main
- Introduced Time-To-First-Token (TTFT) measurement and reporting across major executors.
- Added TTFT calculation to
UsageReporter, including support for HTTP clients and WebSocket communication.
- Updated tests to validate TTFT tracking in streamed and non-streamed scenarios.
- Ensured integration with
usage plugin and augmented usage records with TTFT data.
下载附件