Repository navigation
Agentic Mode: talk to your crew from the iPhone; agents run xBot and the Mac - #49
Open
MasterYoav wants to merge 49 commits into
Open
MasterYoav wants to merge 49 commits into
MasterYoav wants to merge 49 commits into
Conversation
…me reminder, existing libraries count as done
…th sources) and AgentSetup's per-CLI states
…isk Access detection and polling, behind a probe
…he Full Disk Access guide panel
… › Welcome Tour; Home's Finish setting up row
…dy centred, close-only guide panel); a debug-only fake command to look at the install sheet
One clock per scene (30 fps TimelineView that stops under the motion gate and never starts under Reduce Motion, which draws the final frame), easing as functions of time, a stage that scales a 720x420 composition to its room, the founding crew's looks, a mock xBot window, the world's balloon and name tag.
Welcome (the crew walks into the village at dawn and greets; the mark settles), Crew (HeadMaster on top, a CTO jumps onto the tier below, Forge and Hawk walk in; a task travels down and Done comes back up), Worlds (five living postcards) and Ready (the crew gathered, a warm light, one hop each).
A mock xBot window: a folder drops in as a project, a tab opens, tool rows fold into one line and the reply streams in; a plan unfolds, a step is dragged up and the steps tick off; the inspector slides in with changes, a diff line turning green, a terminal running swift test and a pull request's checks.
Three cards flip in (a note writing itself, connectors switching on, an automation snapping together under a clock); Desktop, Documents and Downloads turn from locked to allowed in turn; a Mac draws its pairing code, an iPhone slides up, scans it and a pulse travels between them.
DEBUG only. XBOT_SCENE_SIZE=WxH sets the scene's size (default 720x420). The RootView change is the marked #if DEBUG branch at the top of body.
… file access), module map, changelog
…ne enlarged to fill it
…, unknown parts tolerated), ApprovalCenter, ExperienceStore
…s, decay of stale guesses, forget/restore/edit; kept beside the library (tests never touch the person's) and decayed when it opens
…ou've learnt", and turns with xBot's tools end with the reflection (instructions(for:toolsAttached:))
…nd Unix socket (client and listener)
…full access in the Inbox, photos saved as JPEGs ≤ 1600 px and attached by path, a lost session continues in a new thread
…AgenticDigest; RemoteHost+Agentic (approvals answered in the device's name; DEBUG demo cards)
…ttings ask; shell commands for the hook
…ols, PreToolUse hook via --settings), Codex (-c mcp_servers.xbot.*), Copilot (--additional-mcp-config); the token in the CLI's environment
…ed per binary, removable
… when learnt and uses; reword in place, forget with Undo (toast in the sheet), Forget everything… with a confirmation; a lessons chip by the name, and the count on the crew card
…0 px, key codes and CGEvent construction
…y xbot_* and mac_* tool through Workspace and MacControlling, RiskRules then approvals, xbot_ask; approval cards in the chat; tools, full access and guidance on thread turns; LiveMac, MacControlAccess, the PreToolUse hook's decision
…on quit), the permission guide for Accessibility and Screen Recording; debug-only XBOT_DEBUG_AGENTIC_PROMPT end-to-end turn
…nt's question while its turn waits, Settings › Agents › xBot tools (every chat, permissions, Antigravity), Accessibility and Screen Recording rows in the onboarding's files step
… and the hook's honest gap (security), the flow (architecture), per-CLI attachment with sources (providers), modules and tests, CLAUDE.md invariant 5, changelog
…lert in front was invisible to the agent; found in the live check)
…told to ask twice); window buttons named in mac_ui; the debug turn can answer xbot_ask
…rew, threads with bubbles, one activity line, Did N things, screenshot/approval/hand-off/lesson cards, dictation and photos
…Cards (approval, screenshot viewer, hand-off)
…ed), text either side of a tool as paragraphs, the agent's own notices folded into one line, back to the bottom when a turn starts or a card arrives
…imple for CI's Swift
…of the real tools from the phone
…e testAgenticRealTools waits for its own reply
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Agentic Mode
The iPhone gets a second mode. Settings › Mode: Developer / Agentic. Developer is today's app. Agentic is a Telegram-like chat with your crew: HeadMaster pinned on top, one thread per agent. The agents control xBot and the Mac through xBot's own MCP server.
Spec:
docs/superpowers/specs/2026-10-13-agentic-mode-design.md.iPhone
Mac
chats.thread, schema 7), in full access, in the Inbox. Photos are saved and attached by path. A lost session continues in a new thread that starts with recent messages.XBot --mcp: a headless MCP server (JSON-RPC over stdio). It reaches the running app over a 0600 Unix socket, with a per-turn token.xbot_ask,xbot_remember,xbot_lessons) and the Mac (mac_screenshotvia ScreenCaptureKit,mac_uivia Accessibility, click, type, keys, scroll, open, apps, quit).--mcp-config, plus a PreToolUse hook (XBot --hook) that also covers its own shell;-c mcp_servers.xbot.*;--additional-mcp-config;agy mcp add, once.xbot_remember;Tests
testAgenticMode: HeadMaster replies pong;testAgenticRealTools: a realmac_screenshotcard arrives on the phone; amac_quitapproval comes to the phone, is refused, and the agent carries on;testAgenticCards;testAgenticActivity;testNewChatRunsOnTheMac.xbot_crew,mac_appsand TextEdit control; the hook blocksgit pushwhen refused.Gaps