AgentEvalTool/backend/agenteval/evaluation
sinohqb 15c542d92c feat(analysis): two-phase campaign analysis agent with storage and API
Add the analysis role's execution path: a two-phase orchestration
(per-scenario diagnosis gathered in parallel, then a synthesis pass)
that reads the existing campaign report aggregation plus capped failure
samples, validates the LLM's JSON against the report schema, and strips
fabricated run/scenario references before persisting. Results upsert one
row per campaign (generating/completed/failed) with the model config
snapshot; GET/POST /api/campaigns/{id}/analysis expose the state machine,
guarding non-terminal campaigns and missing analysis models with 400s.
2026-08-03 02:06:29 +08:00
..
rules feat(models): add centralized model configuration 2026-07-17 20:02:43 +08:00
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
analysis.py feat(analysis): two-phase campaign analysis agent with storage and API 2026-08-03 02:06:29 +08:00
campaign_runner.py refactor(campaign): type Campaign.summary as CampaignSummary VO 2026-07-31 15:09:10 +08:00
campaign_scheduler.py refactor(campaign): move tick decisions into the pure scheduler seam 2026-07-31 02:20:14 +08:00
case_verdict.py refactor(verdict): unify read path on authoritative case_outcomes 2026-07-31 14:11:58 +08:00
engine.py refactor(engine): thin _run_case and _save_rule_results 2026-07-31 14:59:50 +08:00
implicit_rules.py refactor(engine): thin _run_case and _save_rule_results 2026-07-31 14:59:50 +08:00
judgement.py refactor(judgement): converge case-pass decision into one deep module 2026-07-29 19:45:02 +08:00
metrics.py refactor(metrics): type Run summary and converge cross-run aggregation 2026-07-31 01:57:56 +08:00
report_render.py refactor(report): split report generation from pure rendering 2026-07-31 10:19:04 +08:00
report.py feat(campaign): add per-Run timeline seam + endpoint 2026-07-31 16:49:04 +08:00
run_summary.py refactor(engine): extract build_run_summary pure seam 2026-07-31 14:20:51 +08:00