You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/agent-architecture-improvement-plan.md
+24Lines changed: 24 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -503,12 +503,36 @@ Turn the architecture review into an executable backlog for Funplay's local agen
503
503
|---|---|---|---|---|
504
504
| P65-1 | Add lazy supporting-file listing and reading for Skill packages. | Completed | Registered `list_agent_skill_files` and `read_agent_skill_file` as read-only Native tools. Supporting-file reads are scoped to the selected Skill package, reject path traversal and symlinks, skip `SKILL.md`, reject binary-like files, and cap file size/content. |`npm run agent:skills-v2-benchmark`; `npm run build`; `npm run test:runtime`; `npm run agent:roadmap-audit`|
505
505
506
+
## Phase 66: Skills v2 Trust And Permission Boundaries
507
+
508
+
| ID | Requirement | Status | Implementation Notes | Verification |
509
+
|---|---|---|---|---|
510
+
| P66-1 | Add Skill trust, source verification, permission policy, and script execution boundaries. | Completed | Filesystem Skills now expose trust level, verification status, content SHA-256, permission policy, script policy, and declared scripts. Approval-required or untrusted Skills are excluded from metadata auto-activation, and declared scripts are metadata only: execution must go through ordinary Agent tools and the existing permission broker. Native/Claude prompts and skill tools surface these boundaries. |`npm run agent:skills-v2-benchmark`; `npm run build`; `npm run agent:roadmap-audit`|
511
+
512
+
## Phase 67: Claude SDK Skills Integration
513
+
514
+
| ID | Requirement | Status | Implementation Notes | Verification |
515
+
|---|---|---|---|---|
516
+
| P67-1 | Integrate Claude SDK native Skills support where available. | Completed | Claude SDK options now apply Skills-aware `settings`: inactive Skills are hidden from model auto-selection, inactive user-invocable Skills remain slash-visible, and inline Skill shell execution is disabled. When a Claude SDK AgentDefinition is active, Funplay attaches active filesystem Skill names to that agent's `skills` allowlist. |`npm run agent:skills-v2-benchmark`; `npm run build`; `npm run agent:roadmap-audit`|
517
+
518
+
## Phase 68: Skills v2 Observability
519
+
520
+
| ID | Requirement | Status | Implementation Notes | Verification |
521
+
|---|---|---|---|---|
522
+
| P68-1 | Add Skill activation runtime events, replay export, and transcript visibility. | Completed | Active filesystem Skill selections now persist as `skill_activation` runtime events, appear in replay metrics and Agent Core debugger parts, and render in completed chat transcripts from structured Agent Core system parts. The Skills v2 benchmark includes these observability checks. |`npm run agent:skills-v2-benchmark`; `npm run build`; `npm run agent:roadmap-audit`|
523
+
506
524
## Phase 69: Skills v2 Benchmark Gate
507
525
508
526
| ID | Requirement | Status | Implementation Notes | Verification |
509
527
|---|---|---|---|---|
510
528
| P69-1 | Add deterministic Skills v2 benchmark coverage. | Completed | Added `scripts/agent-skills-v2-benchmark.mjs` and `npm run agent:skills-v2-benchmark`, covering registry discovery, metadata context, explicit and automatic activation, supporting-file reads, and read-only tool-boundary checks. The main deterministic `agent:benchmark` now includes this Skills v2 slice. |`npm run agent:skills-v2-benchmark`; `npm run build`; `npm run test:runtime`; `npm run agent:benchmark`; `npm run agent:roadmap-audit`|
511
529
530
+
## Phase 70: Skills v2 Settings UI
531
+
532
+
| ID | Requirement | Status | Implementation Notes | Verification |
533
+
|---|---|---|---|---|
534
+
| P70-1 | Mature the Settings UI for source precedence, conflicts, updates, and project overrides. | Completed | Added a main-process filesystem Skill registry IPC endpoint and rendered it in Project Settings. The Skills page now shows source precedence, same-name override conflicts, trust/verification status, permission policy, script policy, and suggested tools alongside existing catalog sync/update and custom project Skill override controls. |`npm run agent:skills-v2-benchmark`; `npm run build`; `npm run agent:roadmap-audit`|
535
+
512
536
## Next Roadmap: Claude Code MCP Platform Parity
513
537
514
538
This draft section is intentionally not encoded as audited implementation rows. Convert each item into a numbered phase row only when that item enters active implementation.
| SK69-1 | Add deterministic and live Skill benchmark gates. | Completed |
32
-
| SK70-1 | Mature the Settings UI for source precedence, conflicts, updates, and project overrides. |Not started|
32
+
| SK70-1 | Mature the Settings UI for source precedence, conflicts, updates, and project overrides. |Completed|
33
33
34
34
## Phase 61 Verification
35
35
@@ -65,8 +65,40 @@ Funplay Skills v2 should behave like a platform capability, not a large prompt f
65
65
- Supporting file reads are scoped to the selected Skill directory, skip symlinks, reject path traversal and binary-like files, and cap file size/content.
66
66
- Regression checks: `npm run agent:skills-v2-benchmark`, `npm run build`, `npm run test:runtime`
67
67
68
+
## Phase 66 Verification
69
+
70
+
- Filesystem Skills now carry trust level, source verification status, content SHA-256, permission policy, script policy, and declared script metadata.
71
+
- Project/user/plugin Skills receive local provenance; user/plugin sources can be trusted, while catalog/custom sources default to unverified approval-required handling.
72
+
- Skills marked approval-required or untrusted are not auto-activated by metadata matching; explicit invocation and read tools still surface the policy.
73
+
- Declared scripts are metadata only and never execute through the Skill system directly; they must go through normal host tools and permission broker checks.
74
+
- Native and Claude prompts, `list_agent_skills`, and `read_agent_skill` now show trust, verification, permission, and script boundaries.
75
+
- Regression checks: `npm run agent:skills-v2-benchmark`, `npm run build`
76
+
77
+
## Phase 67 Verification
78
+
79
+
- Claude SDK sessions now receive Skills-aware settings when filesystem Skills exist.
80
+
- Inactive Skills are hidden from model auto-selection with `skillOverrides`, while user-invocable inactive Skills remain slash-visible.
81
+
- Skill inline shell execution is disabled through SDK settings.
82
+
- When the caller uses a Claude SDK AgentDefinition, active Funplay Skills are attached to that agent's `skills` allowlist.
83
+
- Regression checks: `npm run agent:skills-v2-benchmark`, `npm run build`
84
+
85
+
## Phase 68 Verification
86
+
87
+
- Active filesystem Skill selections now persist as first-class `skill_activation` runtime events.
88
+
- Agent replay exports include Skill activation metrics and convert persisted activations into structured Agent Core system parts.
89
+
- Completed chat transcript rendering now shows activated Skills from Agent Core parts without parsing assistant pseudo text.
90
+
- The Skills v2 benchmark now includes activation-event, replay, and transcript visibility checks.
91
+
- Regression checks: `npm run agent:skills-v2-benchmark`, `npm run build`
92
+
68
93
## Phase 69 Verification
69
94
70
95
- Added `npm run agent:skills-v2-benchmark` with focused registry, activation, supporting-file, and read-only tool-boundary checks.
71
96
- The deterministic `npm run agent:benchmark` suite now includes the Skills v2 platform slice.
72
97
- Regression checks: `npm run agent:skills-v2-benchmark`, `npm run build`, `npm run test:runtime`, `npm run agent:roadmap-audit`, `npm run agent:benchmark`
98
+
99
+
## Phase 70 Verification
100
+
101
+
- Project Settings now loads the filesystem Skill registry through a main-process IPC path.
102
+
- The Skills settings view shows source precedence, same-name override conflicts, trust/verification status, permission policy, script policy, and suggested tools.
103
+
- Existing catalog sync/update and project custom Skill override controls remain available beside the Claude Code filesystem registry view.
104
+
- Regression checks: `npm run agent:skills-v2-benchmark`, `npm run build`
`Permission policy: ${skill.permissionPolicy} (skill metadata does not grant tool permission)`,
124
+
`Script policy: ${skill.scriptPolicy}${skill.declaredScripts?.length ? ` · ${skill.declaredScripts.length} declared script(s), run only through normal host tool permission` : ''}`,
0 commit comments