solahqb/AgentEvalTool
1
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases 1 Wiki Activity
ef27d2260e
AgentEvalTool/backend/agenteval/evaluation
History
sinohqb 2f09ee2bfc
All checks were successful
CI / test (pull_request) Successful in 3m58s
Details
refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 
- 报告渲染 Go/No-Go 上线评估横幅（HTML 彩色 banner + Markdown 引用块）
- 抽取 scored_llm 共享模块：llm_score / fluency 直连调用与评分解析收敛
- 网关新增 chat_with_usage / embed_with_usage，规则按次归集 llm_usage
- 引擎分岗位用量归集（judge/generator/embedding/moderation）写入
  RunSummary.eval_usage_by_purpose，并发下不做总量差值
- cost_tracking 重构：data/model_pricing.json 覆盖 + 默认计价表，
  删除从未有数据支撑的 Turn 维度成本函数（偏差说明见 PR）
- 报告 summary 增加 eval_cost 分岗位成本段并在 Markdown 渲染
2026-08-26 01:59:20 +08:00
..
rules refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 2026-08-26 01:59:20 +08:00
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
analysis.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
campaign_lifecycle.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
campaign_read_model.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
campaign_runner.py perf(eval): case/rule/campaign 并发执行 2026-08-24 23:18:11 +08:00
campaign_scheduler.py refactor(campaign): move tick decisions into the pure scheduler seam 2026-07-31 02:20:14 +08:00
case_verdict.py refactor(case-verdict): extract build_case_evidence as single evidence-construction seam 2026-08-04 11:23:56 +08:00
comparison.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
cost_tracking.py refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 2026-08-26 01:59:20 +08:00
engine.py refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 2026-08-26 01:59:20 +08:00
go_no_go.py feat(report): 上线验收报告 go/no-go 结论 2026-08-25 14:28:55 +08:00
implicit_rules.py refactor(engine): thin _run_case and _save_rule_results 2026-07-31 14:59:50 +08:00
intelligence_jobs.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
judgement.py feat(v1.3.1): Phase 2 让成本/放弃率/Go-No-Go 基础设施真正生效 2026-08-25 18:38:18 +08:00
metrics.py refactor(metrics): extract dashboard aggregation to compute_dashboard 2026-08-04 11:36:55 +08:00
report_render.py refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 2026-08-26 01:59:20 +08:00
report.py refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 2026-08-26 01:59:20 +08:00
run_summary.py refactor(v1.3.1): Phase 3 报告横幅、评分逻辑收敛与成本闭环 2026-08-26 01:59:20 +08:00