ai/byre
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 6 Wiki Activity

browser integration

Browse Source
This commit is contained in:
Ian Gulliver
2026-10-18 07:47:10 -07:00
parent e7beca74f2
commit 1020d7eb15
4 changed files with 770 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
internal/agents/clients.go
+5 -4
View File
@@ -148,15 +148,16 @@ func (m *Manager) clientTools(l *live) []mcp.Tool {
},
{
Name: "client_hands",
Description: "Call one of your hands tools (screen_list, capture, ax_tree, act, browser) on a client Mac instead of the Mac byre runs on: " +
"tool is the tool's name and arguments exactly what that tool takes. Window ids, refs and displays are that Mac's, so start with screen_list there. " +
Description: "Call one of your hands tools (screen_list, capture, ax_tree, act, browser, chrome) on a client Mac instead of the Mac byre runs on: " +
"tool is the tool's name and arguments exactly what that tool takes. Window ids, refs, displays and Chrome tabs are that Mac's, so start with screen_list (or chrome tabs) there. " +
"Every agent using that Mac shares one set of refs, so read the tree again if another agent may have. " +
"A call fails until the human has given byre's app Screen Recording and Accessibility (and Automation of Orion, for browser) on that Mac; say so when it does.",
"A call fails until the human has given byre's app Screen Recording and Accessibility (and Automation of Orion, for browser) on that Mac; say so when it does. " +
"chrome needs Google Chrome installed on that Mac; its trace files are saved there, so fetch one with client_download.",
InputSchema: json.RawMessage(`{
"type": "object",
"properties": {
"client": {"type": "string", "description": "The client's name from list_clients."},
"tool": {"type": "string", "enum": ["screen_list", "capture", "ax_tree", "act", "browser"]},
"tool": {"type": "string", "enum": ["screen_list", "capture", "ax_tree", "act", "browser", "chrome"]},
"arguments": {"type": "object", "description": "The tool's arguments."}
},
"required": ["client", "tool"]