solahqb/AgentEvalTool
1
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases 1 Wiki Activity
c956da7686
AgentEvalTool/tests/unit
History
sinohqb c956da7686
All checks were successful
CI / test (pull_request) Successful in 4m3s
Details
feat(v1.3.1): Phase 2 让成本/放弃率/Go-No-Go 基础设施真正生效 
- token 用量接入：ModelGateway 经 adapter.parse_usage 累计评测侧 LLM 调用的
  token 消耗，引擎写入 run.summary.eval_token_usage，报告透出
- 放弃率落地：CaseOutcome 新增 abandoned 标记（对话中途发送/接收失败），
  build_run_summary 统计 abandoned_cases / abandonment_rate
- Go/No-Go 可配置：Scenario 新增 acceptance_criteria 字段（DB 列 + 幂等迁移），
  报告按场景标准出 verdict，缺省回退全局默认；标准变更不触发考纲升版
2026-08-25 18:38:18 +08:00
..
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
mock_channel.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_analysis_default_migration.py feat(models): add analysis-default flag for campaign intelligence 2026-08-03 01:46:51 +08:00
test_build_run_summary.py refactor(engine): extract build_run_summary pure seam 2026-07-31 14:20:51 +08:00
test_campaign_analyses_migration.py feat(analysis): two-phase campaign analysis agent with storage and API 2026-08-03 02:06:29 +08:00
test_campaign_analysis_model_migration.py feat(campaign): support per-campaign analysis model override 2026-08-03 01:53:13 +08:00
test_campaign_analysis.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_campaign_cancel_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_campaign_comparison.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_complete_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_campaign_lifecycle.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_narrow_updates.py refactor(repository): narrow atomic updates for patrol/cancel/scheduler writes 2026-08-04 03:39:42 +08:00
test_campaign_period_comparisons_migration.py feat(comparison): v0.8 周期对比 — 计划指纹自动基线配对、机械指标 diff 与 LLM 演进叙述 2026-08-03 13:32:48 +08:00
test_campaign_read_model.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_recovery.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_report_format.py test(report): aggregation edge cases and output format validation 2026-08-03 19:03:44 +08:00
test_campaign_report_loader.py refactor(report): unify campaign report loading behind one read model 2026-08-04 03:30:29 +08:00
test_campaign_report.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_run_claim.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_campaign_run_identity_migration.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_campaign_scheduler.py refactor(campaign): move tick decisions into the pure scheduler seam 2026-07-31 02:20:14 +08:00
test_campaign_start_lifecycle.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_summary.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_timeline.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_view.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_cascade.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_case_verdict.py refactor(case-verdict): extract build_case_evidence as single evidence-construction seam 2026-08-04 11:23:56 +08:00
test_channel_contract.py fix(architecture): enforce lifecycle consistency 2026-08-07 10:59:27 +08:00
test_comparison_read_model.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_config_snapshot.py feat(intelligent-eval): implement config snapshot management (ticket 05) 2026-08-12 10:19:07 +08:00
test_cost_tracking.py feat: 成本效率跟踪基础设施 2026-08-25 16:07:08 +08:00
test_dashboard_metrics.py refactor(metrics): extract dashboard aggregation to compute_dashboard 2026-08-04 11:36:55 +08:00
test_engine.py fix(architecture): enforce lifecycle consistency 2026-08-07 10:59:27 +08:00
test_exploration_budget.py feat(campaigns): exploration seed set and budget config per campaign 2026-08-03 17:52:25 +08:00
test_exploration_judge.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_exploration_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_exploration_summary.py fix(exploration): include all judge findings instead of poor-only 2026-08-04 02:45:41 +08:00
test_file_repository.py refactor(files): harden storage and split frontend 2026-07-17 17:41:19 +08:00
test_file_service.py test: 完整测试覆盖补全（+163 用例） 2026-08-24 15:56:09 +08:00
test_go_no_go.py feat(report): 上线验收报告 go/no-go 结论 2026-08-25 14:28:55 +08:00
test_http_channel_and_rules.py fix(review): address release correctness findings 2026-08-09 03:20:40 +08:00
test_implicit_rules.py refactor(engine): thin _run_case and _save_rule_results 2026-07-31 14:59:50 +08:00
test_intelligence_jobs_settlement_characterization.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_intelligent_eval_decision.py feat(intelligent-eval): implement decision logic and e2e flow (ticket 04) 2026-08-12 10:10:42 +08:00
test_intelligent_eval_domain.py refactor(intelligent-eval): drop ADR-0008 transitional wrappers, callers use domain 2026-08-21 03:50:44 +08:00
test_intelligent_eval_lifecycle_transitions.py test: 完整测试覆盖补全（+163 用例） 2026-08-24 15:56:09 +08:00
test_intelligent_eval_model.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_intelligent_eval_read_model.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_intelligent_eval_report.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_intelligent_eval_scheduler.py test(scheduler): 补全触发失败落账与错误路径测试（+9 用例） 2026-08-24 17:18:52 +08:00
test_intelligent_eval_task_queue.py refactor(intelligent-eval): drop ADR-0008 transitional wrappers, callers use domain 2026-08-21 03:50:44 +08:00
test_intelligent_eval_watchdog_characterization.py refactor(intelligent-eval): unify watchdog failures behind fail_eval seam 2026-08-21 03:35:05 +08:00
test_judgement.py refactor(judgement): converge case-pass decision into one deep module 2026-07-29 19:45:02 +08:00
test_llm_score_multi_dimension.py fix(rules): 修复代码审查发现的三处规则层缺陷 2026-08-25 18:13:11 +08:00
test_llm_score.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_llm_task_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分（Phase 2 + 3） 2026-08-24 05:50:27 +08:00
test_metrics.py refactor(metrics): type Run summary and converge cross-run aggregation 2026-07-31 01:57:56 +08:00
test_migrate_model_configs.py feat(models): add centralized model configuration 2026-07-17 20:02:43 +08:00
test_model_configs.py feat(models): add analysis-default flag for campaign intelligence 2026-08-03 01:46:51 +08:00
test_model_gateway.py feat(models): support mainstream model protocols 2026-07-17 20:58:27 +08:00
test_model_metadata_migration.py feat(models): add model capability metadata 2026-07-17 21:41:32 +08:00
test_model_runtime_integration.py feat(v1.3.1): Phase 2 让成本/放弃率/Go-No-Go 基础设施真正生效 2026-08-25 18:38:18 +08:00
test_orphan_runs.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_phase2_wiring.py feat(v1.3.1): Phase 2 让成本/放弃率/Go-No-Go 基础设施真正生效 2026-08-25 18:38:18 +08:00
test_production_entrypoint.py fix(review): address release correctness findings 2026-08-09 03:20:40 +08:00
test_proxy.py test: 完整测试覆盖补全（+163 用例） 2026-08-24 15:56:09 +08:00
test_report_render.py feat(exploration): findings flow into report, analysis and export 2026-08-03 19:16:33 +08:00
test_report.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_repository.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_response_time_extended.py fix(rules): 修复代码审查发现的三处规则层缺陷 2026-08-25 18:13:11 +08:00
test_s2_rules_and_logic.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_safety_extended.py fix(rules): 修复代码审查发现的三处规则层缺陷 2026-08-25 18:13:11 +08:00
test_scenarios.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_settings.py feat(engine): make poll_reply timeout configurable via env 2026-07-30 09:58:08 +08:00
test_target_repository.py test: 完整测试覆盖补全（+163 用例） 2026-08-24 15:56:09 +08:00
test_task_queue_attempts_migration.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_task_queue_requeue.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_task_registry.py refactor(tasks): unify run/campaign task registries into TaskRegistry 2026-07-31 03:39:03 +08:00
test_user_experience.py feat: 用户体验指标（放弃率+流畅度评估） 2026-08-25 16:36:28 +08:00
test_utils_llm.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_webhook.py style(tests): ruff 全量清理 — 49 项修复，backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_websocket.py test: 完整测试覆盖补全（+163 用例） 2026-08-24 15:56:09 +08:00