Skip to content

Add webpilot skill — CDP-free browser automation#243

Open
hugopalma17 wants to merge 5 commits intoopenai:mainfrom
hugopalma17:add-webpilot-skill
Open

Add webpilot skill — CDP-free browser automation#243
hugopalma17 wants to merge 5 commits intoopenai:mainfrom
hugopalma17:add-webpilot-skill

Conversation

@hugopalma17
Copy link

@hugopalma17 hugopalma17 commented Mar 9, 2026

Summary

  • Adds the webpilot skill for Codex CLI and compatible agent platforms
  • CDP-free browser automation — no Playwright, no Puppeteer, no detectable debugging port
  • Drives a real browser through a Chrome extension + WebSocket bridge
  • Ships two npm packages: h17-webpilot (runtime + CLI) and webpilot-mcp (MCP adapter)

What the skill teaches

  • The inspect → act → verify operating loop
  • DOM-first page inspection (html, discover, q) before acting — not screenshots
  • Full CLI shorthand surface (click, type, html, discover, ss, etc.)
  • Raw WebSocket protocol for advanced use cases
  • MCP server setup for Claude Desktop, Cursor, Windsurf

Install

```bash
npm install -g h17-webpilot
```

```bash
npx h17-webpilot start
npx h17-webpilot -c 'go example.com'
npx h17-webpilot -c 'discover'
npx h17-webpilot -c 'click h1'
```

Links

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new curated webpilot skill to the skills catalog, intended to enable CDP-free browser automation via a Chrome extension + WebSocket runtime and expose it to compatible agent platforms.

Changes:

  • Added webpilot OpenAI agent manifest referencing an MCP tool.
  • Added SKILL.md with usage guidance, operating loop, and MCP setup instructions.
  • Added an Apache 2.0 LICENSE.txt for the skill.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
skills/.curated/webpilot/agents/openai.yaml Declares the skill’s agent manifest and MCP dependency wiring.
skills/.curated/webpilot/SKILL.md Documents Webpilot runtime usage, CLI command surface, and MCP server configuration.
skills/.curated/webpilot/LICENSE.txt Adds licensing text for the new curated skill.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +2 to +5
name: Webpilot
description: CDP-free browser automation — drive a real browser via Chrome extension + WebSocket. No Playwright, no Puppeteer, no detectable debugging port.
policy:
invocation: implicit
Copy link

Copilot AI Mar 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

agents/openai.yaml doesn’t match the repo’s OpenAI agent YAML schema: other skills use interface.display_name, interface.short_description, and almost always include interface.default_prompt. Using interface.name/interface.description will likely be ignored or break downstream tooling (see skills/.system/skill-creator/scripts/generate_openai_yaml.py). Also, policy.invocation: implicit doesn’t match the existing policy.allow_implicit_invocation: true convention used in curated skills.

Suggested change
name: Webpilot
description: CDP-free browser automation — drive a real browser via Chrome extension + WebSocket. No Playwright, no Puppeteer, no detectable debugging port.
policy:
invocation: implicit
display_name: Webpilot
short_description: CDP-free browser automation — drive a real browser via Chrome extension + WebSocket. No Playwright, no Puppeteer, no detectable debugging port.
default_prompt: CDP-free browser automation — drive a real browser via Chrome extension + WebSocket. No Playwright, no Puppeteer, no detectable debugging port.
policy:
allow_implicit_invocation: true

Copilot uses AI. Check for mistakes.
Comment on lines +8 to +9
- type: mcp
name: webpilot
Copy link

Copilot AI Mar 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The MCP dependency block uses different keys than the other curated skills (name vs value, unquoted type, and no transport/url/description fields). For consistency with existing skill manifests (e.g. skills/.curated/figma/agents/openai.yaml), switch to the same dependencies.tools[*] shape so the MCP server is discoverable by the host runtime.

Suggested change
- type: mcp
name: webpilot
- type: "mcp"
value: webpilot

Copilot uses AI. Check for mistakes.
Comment on lines +179 to +191
Copyright 2025 Hugo Palma

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
Copy link

Copilot AI Mar 9, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This Apache 2.0 license text deviates from the standard template used by other curated skills: it omits the “APPENDIX: How to apply the Apache License to your work” section and replaces the placeholder copyright line with a specific copyright statement. If the repo expects the standard Apache 2.0 template (see e.g. skills/.curated/aspnet-core/LICENSE.txt), consider aligning this file to that same template for consistency/compliance checks.

Suggested change
Copyright 2025 Hugo Palma
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
APPENDIX: How to apply the Apache License to your work
To apply the Apache License to your work, attach the following
boilerplate notice, with the fields enclosed by brackets "[]"
replaced with your own identifying information. (Don't include
the brackets!) The text should be enclosed in the appropriate
comment syntax for the file format. We also recommend that a
file or class name and description of purpose be included on the
same "printed page" as the copyright notice for easier
identification within third-party archives.
Copyright [yyyy] [name of copyright owner]
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

Copilot uses AI. Check for mistakes.
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

…mand

Adds installation verification step and switches from npx h17-webpilot
to bare webpilot command (global install) matching the current skill.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants