AgentEvalTool/backend/agenteval/evaluation
sinohqb 782916a283 refactor(metrics): type Run summary and converge cross-run aggregation
Give EvalRun.summary a typed RunSummary value (unified RunError, lenient
legacy parsing) so readers stop reaching into a schemaless dict, and route
every cross-run rollup — dashboard, scenario ranking, trend, campaign
report — through one aggregate_runs seam. Fixes the divergence where
stats averaged pass_rate over completed-only runs while the campaign
report counted faults as 0.0. Cross-run rule (ADR-0004): genuine faults
count 0.0, user-cancelled runs are excluded from both denominators.
2026-07-31 01:57:56 +08:00
..
rules feat(models): add centralized model configuration 2026-07-17 20:02:43 +08:00
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
campaign_runner.py feat(campaigns): durable scheduler loop with restart recovery and cancel 2026-07-30 13:33:10 +08:00
campaign_scheduler.py feat(campaigns): add scheduling decision and child-Run spawning 2026-07-30 12:06:31 +08:00
engine.py feat(campaigns): dual-axis periodic report (time trend + capability) 2026-07-30 13:55:32 +08:00
judgement.py refactor(judgement): converge case-pass decision into one deep module 2026-07-29 19:45:02 +08:00
metrics.py refactor(metrics): type Run summary and converge cross-run aggregation 2026-07-31 01:57:56 +08:00
report.py refactor(metrics): type Run summary and converge cross-run aggregation 2026-07-31 01:57:56 +08:00