Copilot’s desktop-control preview requires opt-in access

The macOS and Windows preview lets Copilot use on-screen controls. Removing a saved approval does not revoke access already granted in a running session.

The macOS and Windows preview lets Copilot use on-screen controls. Removing a saved approval does not revoke access already granted in a running session.
GitHub has launched a public preview that lets Copilot CLI, its terminal-based tool, and its desktop app operate applications on macOS and Windows. According to The New Stack’s October 2 report, Copilot agents can read application content, click, type, scroll and drag. This extends their reach to older software that has only on-screen controls, without a programming interface or command-line access.
Computer use works in local sessions. Copilot reads an application through the operating system’s accessibility tree—a structured representation of its content and controls—and takes screenshots when it needs visual context. Enabling the feature in the CLI activates a bundled plugin with its own Model Context Protocol (MCP) server, a connection through which the agent can use tools.
GitHub recommends using direct tools instead wherever they can handle the task. An application programming interface (API), which lets software communicate directly, or an MCP server, terminal command, filesystem tool or dedicated browser tool typically gives more structured information and more predictable results than desktop interaction, the company says.
GitHub’s launch demonstration involved an expense report in Safari. The company also described possible uses such as summarizing information in a legacy application, updating a presentation and moving information between apps.
The preview is opt-in. Developers enable it with /computer on in Copilot CLI or through the desktop app’s Computer Use settings. On macOS, Copilot also needs Accessibility permission to operate controls and Screen Recording permission to inspect windows when visual context is needed.
The CLI session’s permission mode determines whether Copilot asks before accessing an application. Developers can check that mode with /permissions show. When prompted, they can approve access for the current session, choose “Always allow” for future sessions or decline. Saved CLI approvals also apply in the desktop app on the same computer. Deny rules override both automatic and saved approvals.
Removing an application from the always-allowed list clears approval for future sessions, but does not revoke access already granted in a running session. Stopping ongoing work requires a separate action: press Esc twice in the CLI, or click Stop or press Esc in the desktop app.
Enterprise-managed policy takes precedence over a developer’s local preference. If managed settings block computer use, Copilot CLI reports that the feature is unavailable. Enterprise owners can also use managed-settings.json to control whether developers may bypass approval prompts. That restriction applies across the Copilot app, CLI and VS Code.
The October 2 report says GitHub’s default-enablement policy for unconfigured Business and Enterprise features is scheduled to take effect on October 22. Preview features are excluded, so this computer-use preview remains opt-in.
GitHub warns that changes in timing or window state can cause Copilot to repeat an action or stall. The agent may choose the wrong control, type into the wrong field or struggle with interfaces that change and complex workflows.
GitHub also warns that unexpected on-screen content and ambiguous instructions can lead to actions affecting the user’s device, data or connected accounts. Sensitive information visible in an application window may become part of the context the agent uses.

Nordic Makers invested as co-founder Lasse Finderup took majority ownership. The new tool connects recordings with earlier interview material, according to the company.
2 min

The company says at least 26,000 SI agents scanned more than 25,000 assets for routes to a breach. Verification details and comparisons with other testing methods remain unclear.
2 min

MoArk says it is also adapting models for Chinese chips. Both domestic hubs have far fewer models than Hugging Face, which Chinese developers use to reach users worldwide.
3 min