- 创建规划文件
- 分析项目架构,写入 findings.md
- 实现 Bandit reward 闭环 (dynamic_workflow.py)
- 实现 Cohen's κ 一致性测量 (rlaif/pipeline.py)
- 切换 RAGAS 为 DeepSeek + BGE-M3 (rag_evaluation.py x2)
- 修复 completion_rate 真实计算 (report_generator.py)
- 创建一键 RAG Benchmark 脚本 (scripts/run_rag_benchmark.py)
| 文件 | 改动 |
|---|---|
| backend/app/engine/coordinator/dynamic_workflow.py | Bandit reward 闭环 + _compute_turn_reward() |
| backend/app/ai_core/rlaif/pipeline.py | measure_labeling_consistency() Cohen's κ |
| tests/evaluation/rag_evaluation.py | DeepSeek LLM + BGE-M3 embeddings |
| backend/tests/evaluation/rag_evaluation.py | 同上 |
| backend/app/agents/evaluate/report_generator.py | completion_rate FSM 真实计算 |
| scripts/run_rag_benchmark.py | 新建:一键 Qdrant + Ingest + RAGAS |