AgentEvalTool

solahqb/AgentEvalTool

Fork 0

Commit Graph

Author	SHA1	Message	Date
sinohqb	c956da7686	feat(v1.3.1): Phase 2 让成本/放弃率/Go-No-Go 基础设施真正生效 All checks were successful CI / test (pull_request) Successful in 4m3s Details - token 用量接入：ModelGateway 经 adapter.parse_usage 累计评测侧 LLM 调用的 token 消耗，引擎写入 run.summary.eval_token_usage，报告透出 - 放弃率落地：CaseOutcome 新增 abandoned 标记（对话中途发送/接收失败）， build_run_summary 统计 abandoned_cases / abandonment_rate - Go/No-Go 可配置：Scenario 新增 acceptance_criteria 字段（DB 列 + 幂等迁移），报告按场景标准出 verdict，缺省回退全局默认；标准变更不触发考纲升版	2026-08-25 18:38:18 +08:00
sinohqb	cc79d3a625	feat(models): support mainstream model protocols	2026-07-17 20:58:27 +08:00
sinohqb	470ff5875f	feat(models): add centralized model configuration	2026-07-17 20:02:43 +08:00

Author

SHA1

Message

Date

sinohqb

c956da7686

feat(v1.3.1): Phase 2 让成本/放弃率/Go-No-Go 基础设施真正生效

CI / test (pull_request) Successful in 4m3s

Details

- token 用量接入：ModelGateway 经 adapter.parse_usage 累计评测侧 LLM 调用的
  token 消耗，引擎写入 run.summary.eval_token_usage，报告透出
- 放弃率落地：CaseOutcome 新增 abandoned 标记（对话中途发送/接收失败），
  build_run_summary 统计 abandoned_cases / abandonment_rate
- Go/No-Go 可配置：Scenario 新增 acceptance_criteria 字段（DB 列 + 幂等迁移），
  报告按场景标准出 verdict，缺省回退全局默认；标准变更不触发考纲升版

2026-08-25 18:38:18 +08:00

sinohqb

cc79d3a625

feat(models): support mainstream model protocols

2026-07-17 20:58:27 +08:00

sinohqb

470ff5875f

feat(models): add centralized model configuration

2026-07-17 20:02:43 +08:00

3 Commits