solahqb/AgentEvalTool
1
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases 1 Wiki Activity
51d97694dc
AgentEvalTool/backend/agenteval/evaluation
History
sinohqb bf1ec16ef6 perf(eval): case/rule/campaign 并发执行 
- EvalEngine case 循环改 asyncio.gather + semaphore（默认 3 并发）
- 规则评估并行（默认 5 并发），LLM 评分耗时从串行求和降为最慢一条
- _resolve_model 改 async + 双重检查锁，保护共享模型缓存
- _case_errors / case_outcomes 并发写入加状态锁
- Campaign occurrence 派生并行（默认 2 并发），claim 拒绝时提前收敛
- 新增配置：max_concurrent_cases=3 / max_concurrent_rules=5 / max_concurrent_runs=2

SQLite StaticPool 单连接下 DB 写入仍天然串行，并行收益集中在
channel I/O 与 LLM 调用的等待重叠。
2026-08-24 23:18:11 +08:00
..
rules feat(models): add centralized model configuration 2026-07-17 20:02:43 +08:00
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
analysis.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
campaign_lifecycle.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
campaign_read_model.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
campaign_runner.py perf(eval): case/rule/campaign 并发执行 2026-08-24 23:18:11 +08:00
campaign_scheduler.py refactor(campaign): move tick decisions into the pure scheduler seam 2026-07-31 02:20:14 +08:00
case_verdict.py refactor(case-verdict): extract build_case_evidence as single evidence-construction seam 2026-08-04 11:23:56 +08:00
comparison.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
engine.py perf(eval): case/rule/campaign 并发执行 2026-08-24 23:18:11 +08:00
implicit_rules.py refactor(engine): thin _run_case and _save_rule_results 2026-07-31 14:59:50 +08:00
intelligence_jobs.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
judgement.py refactor(judgement): converge case-pass decision into one deep module 2026-07-29 19:45:02 +08:00
metrics.py refactor(metrics): extract dashboard aggregation to compute_dashboard 2026-08-04 11:36:55 +08:00
report_render.py feat(exploration): findings flow into report, analysis and export 2026-08-03 19:16:33 +08:00
report.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
run_summary.py refactor(engine): extract build_run_summary pure seam 2026-07-31 14:20:51 +08:00