AgentEvalTool/tests/integration
sinohqb 2e7d419f05 feat(intelligent-eval): implement monitoring and alerting (ticket 07)
- Add metrics.py with pool utilization, task backlog, stuck rate, avg processing time, eval completion rate
- Add alerts.py with alert rules (pool utilization > 90%, task backlog > 50, stuck rate > 10%)
- Implement alert history and webhook notifications
- Add metrics and alerts APIs
- Add database migration for alert history table
- Add 11 unit tests for metrics, 10 unit tests for alerts, 8 integration tests
- Update migration tests to include new alert history table

All 853 tests passing.
2026-08-12 10:41:15 +08:00
..
__init__.py v0.2.0-dev: 文件管理 + 页面布局统一 + 6 个 bug 修复 2026-07-16 15:25:22 +08:00
test_auth_api.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_campaign_analysis_api.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_analysis_auto_trigger.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_comparison_api.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_comparison_auto_trigger.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_runner.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaign_scheduler_loop.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_campaigns_api.py feat(intelligent-eval): implement monitoring and alerting (ticket 07) 2026-08-12 10:41:15 +08:00
test_config_snapshot_api.py feat(intelligent-eval): implement config snapshot management (ticket 05) 2026-08-12 10:19:07 +08:00
test_cron_pool_api.py feat(intelligent-eval): implement cron pool management (ticket 02) 2026-08-12 09:47:04 +08:00
test_exploration_api.py feat(intelligent-eval): implement monitoring and alerting (ticket 07) 2026-08-12 10:41:15 +08:00
test_exploration_patrol_api.py feat(intelligent-eval): implement monitoring and alerting (ticket 07) 2026-08-12 10:41:15 +08:00
test_exploration_settlement.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_fault_tolerance_e2e.py feat(intelligent-eval): implement fault tolerance and recovery (ticket 06) 2026-08-12 10:30:05 +08:00
test_files_api.py feat(files): improve category and location layout 2026-07-17 18:13:43 +08:00
test_intelligent_eval_e2e.py feat(intelligent-eval): implement decision logic and e2e flow (ticket 04) 2026-08-12 10:10:42 +08:00
test_intelligent_eval_task_queue_api.py feat(intelligent-eval): add cron pool data model and task queue API 2026-08-12 02:13:21 +08:00
test_intelligent_evals_api.py refactor(architecture): deepen evaluation lifecycle and read model 2026-08-07 03:11:37 +08:00
test_metrics_alerts_api.py feat(intelligent-eval): implement monitoring and alerting (ticket 07) 2026-08-12 10:41:15 +08:00
test_migration_roundtrip.py refactor(architecture): deepen campaign runtime modules 2026-08-11 13:18:48 +08:00
test_model_config_migration.py feat(models): add centralized model configuration 2026-07-17 20:02:43 +08:00
test_model_configs_api.py feat(models): add analysis-default flag for campaign intelligence 2026-08-03 01:46:51 +08:00
test_reports_api.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_runs_api.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_scenario_version_migration.py feat(run): snapshot scenario version at run creation (ticket 04) 2026-07-29 10:59:44 +08:00
test_scenarios_api.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_stats_api.py style(tests): ruff 全量清理 — 49 项修复,backend 与 tests 全绿 2026-08-03 15:13:24 +08:00
test_worker_skill_api.py feat(intelligent-eval): implement worker skill and APIs (ticket 03) 2026-08-12 10:01:56 +08:00