Claude Cowork & Claude Code Can Now Control Your Mac — Setup and

Claude Can Now Operate Your Desktop

On March 23, 2026, Anthropic announced a major update: Claude Cowork and Claude Code can now directly control your Mac. This means Claude can click buttons, type text, open files, navigate browsers, and run development tools — all on your actual desktop.

Until now, Cowork worked primarily through text-based interactions, file generation, and MCP connectors. With computer use, Claude steps beyond the sandbox and into your real working environment. This guide walks you through what the feature does, how to set it up, and practical ways to use it in your daily workflow.

What Computer Use Actually Does

Beyond Text-Based Assistance

Previously, Claude Cowork could generate text and files, execute code in a sandboxed environment, and interact with external services through MCP connectors. Computer use adds a fundamentally different layer of capability.

With computer use enabled, Claude can take screenshots to understand what's on your screen, perform mouse actions like clicking, dragging, and scrolling, enter text and trigger keyboard shortcuts, and open and interact with applications such as Finder, browsers, and development tools.

How It Works Under the Hood

The process follows a straightforward loop. Claude receives your instruction and breaks it into steps. It takes a screenshot to understand the current screen state, performs the necessary action (a click, keystroke, or scroll), then takes another screenshot to verify the result before moving to the next step.

Your instruction
    ↓
Claude breaks down the task
    ↓
Takes a screenshot to read the screen
    ↓
Performs the required action (click, type, etc.)
    ↓
Verifies the result
    ↓
Moves to the next step or reports completion

An important design choice: Claude always tries to use MCP connectors first. If you have a Slack connector set up, Claude will send messages through the API rather than opening the Slack app and typing into it. Computer use serves as a fallback for tasks where no connector exists, ensuring the fastest and most reliable method is always used.

Setting Up Computer Use

Prerequisites

Before you begin, make sure you meet these requirements: you need to be running macOS (Windows x64 support is planned for a future update), you need a Claude Pro or Claude Max subscription, and you need the Claude desktop app installed.

Step 1: Update the Desktop App

Make sure your Claude desktop app is on the latest version.

# For Claude Code, check your version in the terminal
claude --version
claude update

For Cowork, check for updates through the desktop app's settings menu.

Step 2: Enable Computer Use

In Cowork, navigate to the settings panel to turn on computer use.

1. Open the Claude desktop app
2. Go to Settings → Desktop app
3. Toggle Computer use to on

For Claude Code, you can enable it in your settings file:

// ~/.claude/settings.json
{
  "permissions": {
    "computer_use": true
  }
}

Step 3: Grant Accessibility Permissions

macOS requires explicit accessibility permissions for any app that controls mouse and keyboard input.

1. Open System Settings → Privacy & Security → Accessibility
2. Add the Claude app to the list and toggle it on

Without this permission, Claude won't be able to interact with your screen.

Practical Use Cases

1. Automated File Organization

Let Claude sort through a messy folder for you:

You: Organize my Downloads folder. Move images to Pictures,
     PDFs to Documents, and delete any .tmp files.

Claude: I'll open your Downloads folder and get started.
        [Opens Finder, scans the folder]
        → Moved 15 image files to Pictures
        → Moved 8 PDF files to Documents
        → Deleted 3 .tmp files
        → Done. Would you like to see what's left?

2. Browser-Based Research

Claude can open a browser, navigate to websites, read content, and compile notes:

You: Research the new features in Next.js 16's App Router
     and summarize the key changes in a Markdown file.

Claude: I'll check the official documentation.
        [Opens Chrome, navigates to nextjs.org]
        [Reads the docs pages]
        → Created nextjs16-app-router-notes.md with the summary.

3. Development Workflow Automation (Claude Code)

With Claude Code, computer use extends to IDE and build tool interactions:

# Let Claude Code handle Xcode builds
claude "Open my Xcode project, run a build, and fix any errors"

Claude: Opening Xcode and building the project.
        [Launches Xcode, triggers build]
        → Found 3 build errors
        → Error 1: Type mismatch in ContentView.swift:42 → Fixed
        → Error 2: Unused import in AppDelegate.swift:3 → Removed
        → Error 3: Force unwrap in NetworkManager.swift:78 → Replaced with safe unwrap
        → Build succeeded.

4. Remote Control with Dispatch

Combine computer use with Dispatch to control your Mac from your phone. You can send instructions like "email that report to the team" while you're away from your desk, and Claude will handle it on your Mac.

For details on setting up Dispatch, see Claude Dispatch Guide — Remote Control for Cowork.

Security and Safety Considerations

Permission-Based Execution

Computer use operates on a permission model by default. Before performing sensitive actions like deleting files, installing software, or changing system settings, Claude asks for your approval.

Recommended Precautions

Anthropic recommends keeping a few things in mind. Avoid using computer use when passwords, API keys, or other sensitive information is visible on screen. Don't use it for financial transactions such as online banking or payment processing. When running tasks unattended (while you're away from the computer), clearly define the scope of what Claude should do.

Connector-First Design

As mentioned earlier, Claude prioritizes MCP connectors over computer use. If you want to post a message in Slack and you have the Slack connector configured, Claude will use the API directly rather than opening the Slack app in a browser. This design makes operations faster, more reliable, and reduces the chance of unintended screen interactions.

Computer Use vs. MCP Connectors — When to Use Which

MCP connectors are ideal for routine integrations with specific services, such as posting to Slack, saving files to Google Drive, or updating Asana tasks. They use direct API calls, so they're fast and reliable.

Computer use shines when there's no connector available for the app you need, or when a task requires GUI-only interactions, such as working with design tools, running desktop applications, or performing cross-app workflows that span multiple programs.

In practice, you rarely need to choose between them. Claude automatically selects the best approach for each step of a task, using connectors where available and falling back to computer use when needed.

Wrapping Up

Computer use for Claude Cowork and Claude Code is a meaningful step forward in what an AI assistant can do on your behalf. Moving beyond text and sandboxed code execution into real desktop control opens up workflows that simply weren't possible before.

Setup takes just a few minutes, and the best way to get started is with small, low-risk tasks — organizing files, researching a topic in the browser, or checking build outputs. As you get comfortable with the feature, you can gradually expand to more complex multi-app workflows.

For more on automating tasks with Cowork, see our Cowork Automation Skills Guide.