Open Computer Use MCP Server: Setup for Claude Code, Codex and Gemini CLI

• Lists the apps you have running or used lately

  Returns the apps that are running now, plus any used in the last 14 days with how often.

  Try: “Which apps do I have open?”

  Read · list_apps

• Looks at an app's window

  Starts a session with an app and returns a screenshot plus the window's accessibility tree. The assistant must call it once per turn before it acts on an app. On macOS it can also park the window on a hidden display so it keeps working.

  Try: “Look at what TextEdit is showing right now.”

  Read · get_app_state

• Finds controls in an app window (macOS)

  Searches the current window for buttons and other controls by text or role, without taking a full snapshot. Each match gets an index the click and value tools can use.

  Try: “Find the Save button in TextEdit.”

  Read · query

• Clicks an element or a point

  Clicks a control by its index or by screenshot coordinates. You can choose how the click is sent. The system-wide pointer path moves your real mouse and is off unless an environment setting allows it.

  Try: “Click the Save button.”

  Runs code · click

• Runs an extra action on a control

  Triggers a secondary accessibility action on an element, such as the actions a control offers beyond a plain click.

  Try: “Open the context menu for the selected file.”

  Runs code · perform_secondary_action

• Types text with the keyboard

  Types literal text into the app. The text goes to whichever field has focus.

  Try: “Type a short thank-you note.”

  Runs code · type_text

• Presses a key or shortcut

  Presses a key or key combination, including modifiers and navigation keys, in the xdotool key style.

  Try: “Press Cmd+S to save.”

  Runs code · press_key

• Sets the value of a field directly

  Writes a value into a control that accepts one, like a text field or slider, without typing.

  Try: “Set the zoom slider to 150%.”

  Runs code · set_value

• Selects text or places the cursor (macOS)

  Selects text inside a text element, or puts the cursor before or after it. Add surrounding text to pick between repeats.

  Try: “Select the word total in the second paragraph.”

  Runs code · select_text

• Scrolls an element

  Scrolls an element up, down, left or right by a number of pages. Fractions work.

  Try: “Scroll down half a page.”

  Runs code · scroll

• Drags from one point to another

  Drags using screenshot coordinates. By default events go straight to the app and your pointer stays put. Window moves and Finder drag-and-drop need the system-wide pointer setting.

  Try: “Drag the slider handle to the right.”

  Runs code · drag

Watch out for

• It can do anything you can do in an app

  It clicks, types and sets values in any app you name, so it can send messages, buy things or delete files. Run it where that is acceptable and approve actions you do not trust. github.com

• Screenshots of your apps go to your AI provider

  The tools return screenshots and window text to the model. Close apps that show private data first. The project says it does not upload them anywhere else. github.com

• Password managers are blocked, other apps are not

  A built-in list blocks 1Password, Bitwarden, Dashlane, LastPass, NordPass and Proton Pass. The project says it has no session approval yet. github.com

• Locked Use can unlock your Mac

  This opt-in macOS mode unlocks a locked Mac for the agent, behind an admin-installed service. The project marks it experimental. Leave it off unless you need it. github.com

• get_app_state can hide an app window

  With window placement set to agent_display on macOS, the tool moves the app's window to an invisible display. It disappears from your desktop until restore or until the process exits. github.com

Security advisories