AgentEvalTool/tests/unit
sinohqb a29f78ff4b
All checks were successful
CI / test (pull_request) Successful in 4m9s
feat(llm_score): 支持多维度独立评分
扩展 llm_score 规则,支持通过 dimensions 参数配置多个评分维度,
每个维度独立评分 0-10 分。

- RuleResult 新增 details 字段存储结构化多维度分数
- 向后兼容:原有 criteria 单维度模式继续有效
- 多维度模式下各维度并行调用 LLM,返回平均分和明细
- 新增 4 项单元测试

Closes #19
2026-08-25 14:17:49 +08:00
..
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
mock_channel.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_analysis_default_migration.py feat(models): add analysis-default flag for campaign intelligence 2026-08-03 01:46:51 +08:00
test_build_run_summary.py refactor(engine): extract build_run_summary pure seam 2026-07-31 14:20:51 +08:00
test_campaign_analyses_migration.py feat(analysis): two-phase campaign analysis agent with storage and API 2026-08-03 02:06:29 +08:00
test_campaign_analysis_model_migration.py feat(campaign): support per-campaign analysis model override 2026-08-03 01:53:13 +08:00
test_campaign_analysis.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_campaign_cancel_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_campaign_comparison.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_complete_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_campaign_lifecycle.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_narrow_updates.py refactor(repository): narrow atomic updates for patrol/cancel/scheduler writes 2026-08-04 03:39:42 +08:00
test_campaign_period_comparisons_migration.py feat(comparison): v0.8 周期对比 — 计划指纹自动基线配对、机械指标 diff 与 LLM 演进叙述 2026-08-03 13:32:48 +08:00
test_campaign_read_model.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_recovery.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_report_format.py test(report): aggregation edge cases and output format validation 2026-08-03 19:03:44 +08:00
test_campaign_report_loader.py refactor(report): unify campaign report loading behind one read model 2026-08-04 03:30:29 +08:00
test_campaign_report.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_run_claim.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_campaign_run_identity_migration.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_campaign_scheduler.py refactor(campaign): move tick decisions into the pure scheduler seam 2026-07-31 02:20:14 +08:00
test_campaign_start_lifecycle.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_summary.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_timeline.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_view.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_cascade.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_case_verdict.py refactor(case-verdict): extract build_case_evidence as single evidence-construction seam 2026-08-04 11:23:56 +08:00
test_channel_contract.py fix(architecture): enforce lifecycle consistency 2026-08-07 10:59:27 +08:00
test_comparison_read_model.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_config_snapshot.py feat(intelligent-eval): implement config snapshot management (ticket 05) 2026-08-12 10:19:07 +08:00
test_dashboard_metrics.py refactor(metrics): extract dashboard aggregation to compute_dashboard 2026-08-04 11:36:55 +08:00
test_engine.py fix(architecture): enforce lifecycle consistency 2026-08-07 10:59:27 +08:00
test_exploration_budget.py feat(campaigns): exploration seed set and budget config per campaign 2026-08-03 17:52:25 +08:00
test_exploration_judge.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_exploration_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_exploration_summary.py fix(exploration): include all judge findings instead of poor-only 2026-08-04 02:45:41 +08:00
test_file_repository.py refactor(files): harden storage and split frontend 2026-07-17 17:41:19 +08:00
test_file_service.py test: 完整测试覆盖补全(+163 用例) 2026-08-24 15:56:09 +08:00
test_http_channel_and_rules.py fix(review): address release correctness findings 2026-08-09 03:20:40 +08:00
test_implicit_rules.py refactor(engine): thin _run_case and _save_rule_results 2026-07-31 14:59:50 +08:00
test_intelligence_jobs_settlement_characterization.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_intelligent_eval_decision.py feat(intelligent-eval): implement decision logic and e2e flow (ticket 04) 2026-08-12 10:10:42 +08:00
test_intelligent_eval_domain.py refactor(intelligent-eval): drop ADR-0008 transitional wrappers, callers use domain 2026-08-21 03:50:44 +08:00
test_intelligent_eval_lifecycle_transitions.py test: 完整测试覆盖补全(+163 用例) 2026-08-24 15:56:09 +08:00
test_intelligent_eval_model.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_intelligent_eval_read_model.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_intelligent_eval_report.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_intelligent_eval_scheduler.py test(scheduler): 补全触发失败落账与错误路径测试(+9 用例) 2026-08-24 17:18:52 +08:00
test_intelligent_eval_task_queue.py refactor(intelligent-eval): drop ADR-0008 transitional wrappers, callers use domain 2026-08-21 03:50:44 +08:00
test_intelligent_eval_watchdog_characterization.py refactor(intelligent-eval): unify watchdog failures behind fail_eval seam 2026-08-21 03:35:05 +08:00
test_judgement.py refactor(judgement): converge case-pass decision into one deep module 2026-07-29 19:45:02 +08:00
test_llm_score_multi_dimension.py feat(llm_score): 支持多维度独立评分 2026-08-25 14:17:49 +08:00
test_llm_score.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_llm_task_lifecycle.py refactor(evaluation/storage): 结算统一与 repository 拆分(Phase 2 + 3) 2026-08-24 05:50:27 +08:00
test_metrics.py refactor(metrics): type Run summary and converge cross-run aggregation 2026-07-31 01:57:56 +08:00
test_migrate_model_configs.py feat(models): add centralized model configuration 2026-07-17 20:02:43 +08:00
test_model_configs.py feat(models): add analysis-default flag for campaign intelligence 2026-08-03 01:46:51 +08:00
test_model_gateway.py feat(models): support mainstream model protocols 2026-07-17 20:58:27 +08:00
test_model_metadata_migration.py feat(models): add model capability metadata 2026-07-17 21:41:32 +08:00
test_model_runtime_integration.py refactor(metrics): type Run summary and converge cross-run aggregation 2026-07-31 01:57:56 +08:00
test_orphan_runs.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_production_entrypoint.py fix(review): address release correctness findings 2026-08-09 03:20:40 +08:00
test_proxy.py test: 完整测试覆盖补全(+163 用例) 2026-08-24 15:56:09 +08:00
test_report_render.py feat(exploration): findings flow into report, analysis and export 2026-08-03 19:16:33 +08:00
test_report.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_repository.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_s2_rules_and_logic.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_scenarios.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_settings.py feat(engine): make poll_reply timeout configurable via env 2026-07-30 09:58:08 +08:00
test_target_repository.py test: 完整测试覆盖补全(+163 用例) 2026-08-24 15:56:09 +08:00
test_task_queue_attempts_migration.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_task_queue_requeue.py feat(intelligent-eval): terminal-state discipline watchdogs (ADR-0011) 2026-08-20 14:34:17 +08:00
test_task_registry.py refactor(tasks): unify run/campaign task registries into TaskRegistry 2026-07-31 03:39:03 +08:00
test_utils_llm.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_webhook.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_websocket.py test: 完整测试覆盖补全(+163 用例) 2026-08-24 15:56:09 +08:00