feat(plugins): computer-use bundle - screenshot, click, and type over MCP - #5855
Draft
Hmbown wants to merge 1 commit into
Draft
feat(plugins): computer-use bundle - screenshot, click, and type over MCP#5855Hmbown wants to merge 1 commit into
Hmbown wants to merge 1 commit into
Conversation
… MCP First independent plugin creation on the bundle boundary: Agent Plugins v1.0.0 manifest plus sibling mcp.json (stdio server), a look-act-verify skill, and a /computer command. The server is stdlib-only Python speaking MCP 2024-11-05 with six tools (screen_size, screenshot, click, type_text, press_key, scroll); screenshots downscale to 1920px JPEG via sips/convert and coordinates scale back to display pixels. Routed tool names land in McpAction so every action prompts unless Always-approve. Receipts: 9/9 server protocol tests pass; live 1920x1080 JPEG screenshot captured over stdio on macOS; bundle validates through validate_from_path plus parse_mcp_json in bundled_computer_use_plugin_validates. Signed-off-by: CodeWhale Bot <bot@codewhale.net>
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
| assert_eq!(validated.manifest.plugin.name, "computer-use"); | ||
| assert_eq!(validated.inventory.skills, 1); | ||
| assert_eq!(validated.components.commands.len(), 1); | ||
| assert!(validated.warnings.is_empty(), "{:?}", validated.warnings); |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
First independent plugin creation on the bundle boundary (draft: live-install receipt pending the 0.9.12 rebuild). Bundle validates via validate_from_path + parse_mcp_json; 9/9 server protocol tests pass; live 1920px JPEG screenshot captured over stdio on macOS.
No-Issue: new plugin tracked in 0.9.12 goal; filing a tracking issue next.