-
[OPIK-2125] Python scoring performance Optimization part 2 (#2966)
frostbyte_neo 发布于
2025-08-08 14:29:23 +00:00 - OPIK-2125: Optimize Python scoring performance with lazy imports and enhanced Docker execution
- Implement optimized scoring_runner.py with lazy opik imports and python -S
- Enhance Docker container execution with simplified error handling
- Remove legacy baseline mode and standardize on optimized commands
- Achieve 6.3% faster baseline performance (555ms vs 620ms)
- Maintain 100% reliability under concurrent load testing
- OPIK-2125: Upgrade Python runtime to 3.13 for enhanced performance
- Upgrade base image from python:3.12.9-slim to python:3.13-slim
- Update site-packages path for Python 3.13 compatibility
- Performance results show 7.8% improvement in light load scenarios
- Maintains 100% reliability across all load testing scenarios
- Python 3.13.5 brings latest interpreter optimizations
-
Fix tests
-
Fix tests
-
Fix tests
-
Fix tests
-
Fix tests
-
Fix tests
-
OPIK-2125: Fix stacktrace slicing to match test expectations
- Updated stacktrace slicing from [3:] to [1:] in all scoring components
- Ensures error messages include the full File line as expected by tests
- All evaluator tests now pass (30 passed, 2 skipped)
- Fixed API consistency between ProcessExecutor and DockerExecutor
- Both executors now return identical error formats with proper code fields
-
Fix imports
-
PreWarm up
-
Fix setup
-
Fix docker images
-
Fix tests
下载附件