solahqb/AgentEvalTool
1
0
Fork 0
Code Issues 1 Pull Requests Actions Packages Projects Releases 1 Wiki Activity

fix(rules): v1.3.1 Phase 1 修复规则层三处缺陷 #33

Merged
solahqb merged 1 commits from fix/v1.3.1-phase1-rule-bugfixes into main 2026-08-25 10:22:52 +00:00
Conversation 0 Commits 1 Files Changed 6 +108 -5
solahqb commented 2026-08-25 10:20:01 +00:00
Owner
Copy Link

Summary

  • response_time: 仅配置 max_ms 时恢复 v0.3 评分语义（最后一轮评分 + 超限线性惩罚）；配置扩展指标（avg_latency_max_ms / throughput_min）时才使用均值评分
  • safety: 移除 moderation API 的黑名单命中跳过守卫，两层安全检查独立执行、发现均上报
  • llm_score: 多维度评分添加 Semaphore 并发上限（5），防止维度数多时无限扇出模型请求

来源：v1.3.0 代码审查（PR #27-#32）Standards 轴 3 个 hard violations。

Test plan

  • 新增 6 个回归测试（超限惩罚、最后一轮决定评分、混合指标均值评分、黑名单+moderation 双命中、并发上限）
  • pytest tests/unit/ 692 passed
  • ruff check backend/ 全绿
## Summary - **response_time**: 仅配置 `max_ms` 时恢复 v0.3 评分语义（最后一轮评分 + 超限线性惩罚）；配置扩展指标（avg_latency_max_ms / throughput_min）时才使用均值评分 - **safety**: 移除 moderation API 的黑名单命中跳过守卫，两层安全检查独立执行、发现均上报 - **llm_score**: 多维度评分添加 Semaphore 并发上限（5），防止维度数多时无限扇出模型请求 来源：v1.3.0 代码审查（PR #27-#32）Standards 轴 3 个 hard violations。 ## Test plan - [x] 新增 6 个回归测试（超限惩罚、最后一轮决定评分、混合指标均值评分、黑名单+moderation 双命中、并发上限） - [x] `pytest tests/unit/` 692 passed - [x] `ruff check backend/` 全绿
solahqb added 1 commit 2026-08-25 10:20:01 +00:00
fix(rules): 修复代码审查发现的三处规则层缺陷
All checks were successful
CI / test (pull_request) Successful in 4m5s
Details
c1a3cdbaa9 
- response_time: 仅配置 max_ms 时恢复 v0.3 评分语义（最后一轮评分 + 超限线性惩罚），扩展指标共存时才用均值评分
- safety: 移除 moderation API 的黑名单命中跳过守卫，两层安全检查独立执行、发现均上报
- llm_score: 多维度评分添加 Semaphore 并发上限（5），防止维度数多时无限扇出模型请求
solahqb merged commit 64ed534426 into main 2026-08-25 10:22:52 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
priority:P0

   
priority:P1

   
priority:P2

   
wayfinder:grilling

   
wayfinder:map

   
wayfinder:prototype

   
wayfinder:research

   
wayfinder:task
No Label
priority:P0
priority:P1
priority:P2
wayfinder:grilling
wayfinder:map
wayfinder:prototype
wayfinder:research
wayfinder:task
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: solahqb/AgentEvalTool#33
No description provided.
Delete Branch "fix/v1.3.1-phase1-rule-bugfixes"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?