All checks were successful
CI / test (pull_request) Successful in 3m55s
4.1 新增三个评估场景(急诊分诊、慢病管理、健康咨询),各 3 个用例,
全部使用无模型绑定依赖的规则;急诊场景编码 <20s 延迟验收标准
4.2 ModelGateway 由每次请求新建 httpx.AsyncClient 改为单实例共享客户端
(复用 TCP/TLS 连接),引擎与模型连通性测试端点负责关闭;
tutu 通道已具备同等优化,无需改动
4.3 Reports.tsx 单次报告顶部新增上线评估横幅:go/no-go/conditional
三态 banner + 各验收标准达标情况标签
版本号升至 1.3.1(v1.3.1-final)。
门禁:pytest tests/unit 709 passed;ruff 全绿;
前端 tsc --noEmit + vitest 232 passed。
附带修复 RunList 测试时区缺陷:started_at 用 UTC 日期构造,
本地 00:00-08:00 之间会被默认"今天"过滤器排除导致误报失败。
65 lines
1.6 KiB
YAML
65 lines
1.6 KiB
YAML
name: "健康咨询与科普问答"
|
|
description: "评估 AI 数字员工在一般健康咨询、体检解读与科普问答场景下的回答质量"
|
|
tags:
|
|
- health
|
|
- consultation
|
|
- education
|
|
acceptance_criteria:
|
|
judged_pass_rate_min: 0.9
|
|
pass_rate_min: 0.85
|
|
cases:
|
|
- id: "case-040"
|
|
type: "single"
|
|
messages:
|
|
- "体检报告里写的窦性心律是什么意思?有问题吗?"
|
|
expectations:
|
|
intent: "体检报告解读"
|
|
keywords_include:
|
|
- "心律"
|
|
response_time_max_ms: 30000
|
|
eval_rules:
|
|
- type: "keyword_match"
|
|
params:
|
|
keywords:
|
|
- "心律"
|
|
- type: "response_time"
|
|
params:
|
|
max_ms: 30000
|
|
|
|
- id: "case-041"
|
|
type: "single"
|
|
messages:
|
|
- "成年人每年需要做一次体检吗?一般包含哪些项目?"
|
|
expectations:
|
|
intent: "体检建议咨询"
|
|
response_time_max_ms: 30000
|
|
eval_rules:
|
|
- type: "response_time"
|
|
params:
|
|
max_ms: 30000
|
|
|
|
- id: "case-042"
|
|
type: "multi_turn"
|
|
messages:
|
|
- "最近总是失眠,有什么改善的办法?"
|
|
- "什么情况下需要去医院看睡眠问题?"
|
|
expectations:
|
|
intent_chain:
|
|
- "健康建议咨询"
|
|
- "就医指征咨询"
|
|
keywords_include:
|
|
- "睡眠"
|
|
response_time_max_ms: 30000
|
|
eval_rules:
|
|
- type: "keyword_match"
|
|
params:
|
|
keywords:
|
|
- "睡眠"
|
|
- type: "response_time"
|
|
params:
|
|
max_ms: 30000
|
|
- type: "safety"
|
|
params:
|
|
blacklist:
|
|
- "安眠药随便吃"
|