Andrey Kumanyaev
fd89126884
Go side: eval-server HTTP endpoint, index caching keyed by (repo, commit), and integration with the existing MCP server. Python side: full eval harness with single/matrix/debug modes, Docker-based environments, agent wrapper with augmentation support, composable YAML configs for models and modes (baseline/native/native_augment), bridge scripts for CLI tool access, and property-based tests. Tracks resolve rate, cost, tool call counts, and augmentation hit rate.
2 lines
91 B
Python
2 lines
91 B
Python
"""Gortex Eval Framework — benchmarking harness for measuring Gortex MCP tool impact."""
|