---
title: "Computer use"
canonical: "https://canmyagentuse.com/features/computer-use"
contentKind: "feature"
locale: "en"
description: "Interact with a visual interface using screenshots, clicks, typing, and navigation."
llmSummary: "Computer use is screenshot-informed interaction with a graphical interface through input actions. Browser-only and general desktop control are recorded separately."
publishedAt: "2026-08-28T00:00:00.000Z"
updatedAt: "2026-08-28T00:00:00.000Z"
verifiedAt: "2026-08-28"
tags: ["runtime","browser","visual-interaction"]
---

# Computer use

Computer use is screenshot-informed interaction with a graphical interface through input actions. Browser-only and general desktop control are recorded separately.

- HTML: https://canmyagentuse.com/features/computer-use
- JSON: https://canmyagentuse.com/api/v1/features/computer-use.json
- Markdown: https://canmyagentuse.com/features/computer-use.md

Terminology basis: **Common product term** — https://help.openai.com/en/articles/20001280-using-cloud-browser-in-chatgpt.

## Current support at a glance

Computer use: 2 supported, 5 partial, 0 unsupported, 24 unreviewed across 31 cataloged products.

- Reviewed current products: 7 of 31
- Supported: 2
- Partial: 5
- Unsupported: 0
- Unreviewed: 24
- Not applicable: 0

Unknown or unreviewed means insufficient published evidence; it does not mean unsupported.

This row asks whether the exact harness can inspect a rendered visual state and perform direct input actions. It distinguishes broad computer or GUI control from a browser-only feedback loop.

That distinction matters: a coding harness can fully automate its integrated browser while leaving desktop applications and operating-system controls outside scope. Plan, region, policy, and runtime boundaries remain attached to each sourced cell.

## Catalog context

- Category: [runtime](/categories/runtime.md)
- Terminology basis: Common product term
- Aliases: GUI automation, visual browser, browser control

## Compatibility assertions

Unknown means insufficient published evidence; it does not mean unsupported.

### ChatGPT (web)

- Harness: [ChatGPT](/harnesses/chatgpt-web.md)
- current: **Partial**
  - Target: hosted-observation — 2026-08-28 ChatGPT Work documentation observation; observed 2026-08-28
  - Environment: hosted-default
  - Constraint (plan): paid ChatGPT plan required
  - Constraint (region): supported regions only
  - Constraint (policy): workspace permission and site restrictions apply
  - Evidence: [OpenAI — Using cloud browser in ChatGPT](https://help.openai.com/en/articles/20001280-using-cloud-browser-in-chatgpt) — documented; observed 2026-08-28
  - Qualification note 1: Evidence checked 2026-08-28: ChatGPT Work can use a separate cloud browser to read pages, click, enter form data, and continue supported tasks, but access varies by paid plan, region, rollout, and workspace permission.
- preview: **Unknown**

### Claude (web)

- Harness: [Claude](/harnesses/claude-web.md)
- current: **Unknown**
- preview: **Unknown**

### Gemini (web)

- Harness: [Gemini](/harnesses/gemini-web.md)
- current: **Unknown**
- preview: **Unknown**

### Copilot (web)

- Harness: [Copilot](/harnesses/copilot-web.md)
- current: **Unknown**
- preview: **Unknown**

### Grok (web)

- Harness: [Grok](/harnesses/grok-web.md)
- current: **Unknown**
- preview: **Unknown**

### Grok Bot (desktop)

- Harness: [Grok Bot](/harnesses/grok-bot-desktop.md)
- current: **Supported**
  - Target: hosted-observation — 2026-08-28 Grok Bot desktop documentation observation; observed 2026-08-28
  - Environment: hosted-default
  - Constraint (runtime): computer use runs on an account-scoped hosted Linux VM; all Bots for the account share its files, sessions, and credentials
  - Constraint (policy): one Bot can run one computer-use task on its screen at a time; sensitive steps should use operator takeover
  - Evidence: [xAI — Grok Bot computer and apps](https://docs.x.ai/grok-bot/computer-and-apps) — documented; observed 2026-08-28
  - Qualification note 5: Evidence checked 2026-08-28: Grok Bot exposes a persistent hosted computer with browser and desktop tools. The operator can watch clicks, typing, and navigation, take over sensitive steps, and let work continue after closing the preview.

### Perplexity (web)

- Harness: [Perplexity](/harnesses/perplexity-web.md)
- current: **Unknown**
- preview: **Unknown**

### Le Chat (web)

- Harness: [Le Chat](/harnesses/le-chat.md)
- current: **Unknown**
- preview: **Unknown**

### Devin (web)

- Harness: [Devin](/harnesses/devin-web.md)
- current: **Supported**
  - Target: dated-documentation — current Devin Computer Use documentation; observed 2026-08-28
  - Environment: hosted-default
  - Constraint (runtime): computer use runs inside Devin's hosted desktop environment rather than on the operator's local computer
  - Constraint (policy): authentication, MFA, and CAPTCHA steps can require operator takeover
  - Evidence: [Devin — Computer Use](https://docs.devin.ai/work-with-devin/computer-use) — documented; observed 2026-08-28
  - Qualification note 6: Evidence checked 2026-08-28: Devin's hosted session exposes a full desktop environment and native Computer Use for browser and desktop-app testing, including Electron applications.
- preview: **Unknown**

### Replit Agent (web)

- Harness: [Replit Agent](/harnesses/replit-agent.md)
- current: **Partial**
  - Target: dated-documentation — current Replit Agent App Testing documentation; observed 2026-08-28
  - Environment: hosted-default
  - Constraint (runtime): visual interaction is limited to the Replit project browser preview and does not include general desktop-app or operating-system control
  - Constraint (plan): App Testing is enabled for Economy or Power mode and disabled in Lite mode
  - Constraint (policy): currently limited to Full Stack JavaScript and Streamlit Python web applications
  - Evidence: [Replit — App Testing](https://docs.replit.com/features/agent/app-testing) — documented; observed 2026-08-28
  - Qualification note 7: Evidence checked 2026-08-28: Replit Agent visually clicks, navigates, enters mock data, and validates applications in a real browser preview; it does not establish general operating-system control.
- preview: **Unknown**

### ChatGPT (desktop)

- Harness: [ChatGPT](/harnesses/chatgpt-desktop.md)
- current: **Unknown**
- preview: **Unknown**

### Claude (desktop)

- Harness: [Claude](/harnesses/claude-desktop.md)
- current: **Unknown**
- preview: **Unknown**

### Cursor (desktop)

- Harness: [Cursor](/harnesses/cursor.md)
- current: **Partial**
  - Target: dated-documentation — current Cursor browser documentation; observed 2026-08-28
  - Environment: local-default
  - Constraint (runtime): integrated browser only
  - Constraint (policy): enterprise MCP origin policy can restrict access
  - Evidence: [Cursor — Browser tools](https://prod.cursor.com/docs/agent/tools/browser) — documented; observed 2026-08-28
  - Qualification note 2: Evidence checked 2026-08-28: Cursor Agent can navigate, click, type, scroll, and capture screenshots in its integrated browser; this is browser control, not general operating-system GUI control.
- preview: **Unknown**

### OpenWork Desktop (desktop)

- Harness: [OpenWork Desktop](/harnesses/openwork-desktop.md)
- current: **Partial**
  - Target: dated-documentation — current OpenWork Browser documentation; observed 2026-08-28
  - Environment: local-default
  - Constraint (runtime): first-party OpenWork Browser only; no general desktop-app control
  - Constraint (policy): OpenWork Browser extension must be enabled
  - Evidence: [OpenWork — Control the browser](https://openworklabs.com/docs/start-here/do-work-with-it/control-the-browser) — documented; observed 2026-08-28
  - Qualification note 4: Evidence checked 2026-08-28: OpenWork Desktop's first-party browser can open pages, click, fill forms, read page content, and take screenshots; OpenWork explicitly distinguishes this from general operating-system control.

### Copilot Chat (desktop)

- Harness: [Copilot Chat](/harnesses/vscode-copilot.md)
- current: **Partial**
  - Target: dated-documentation — current VS Code browser-tools documentation; observed 2026-08-28
  - Environment: local-default
  - Constraint (runtime): integrated browser only
  - Constraint (policy): organization policy can disable browser tools
  - Evidence: [Visual Studio Code — Use browser tools with agents](https://code.visualstudio.com/docs/agents/run/browser-tools) — documented; observed 2026-08-28
  - Qualification note 3: Evidence checked 2026-08-28: VS Code agents can navigate, read, screenshot, click, type, hover, drag, and handle dialogs in the integrated browser; organization policy can disable the tools.
- preview: **Unknown**

### Chrome WebMCP origin trial (desktop)

- Harness: [Chrome WebMCP origin trial](/harnesses/chrome-webmcp-preview.md)
- current: **Unknown**

### Windsurf (desktop)

- Harness: [Windsurf](/harnesses/windsurf.md)
- current: **Unknown**
- preview: **Unknown**

### Zed Agent (desktop)

- Harness: [Zed Agent](/harnesses/zed-agent.md)
- current: **Unknown**
- preview: **Unknown**

### Continue (desktop)

- Harness: [Continue](/harnesses/continue.md)
- current: **Unknown**
- preview: **Unknown**

### Cline (desktop)

- Harness: [Cline](/harnesses/cline.md)
- current: **Unknown**
- preview: **Unknown**

### JetBrains AI (desktop)

- Harness: [JetBrains AI](/harnesses/jetbrains-ai.md)
- current: **Unknown**
- preview: **Unknown**

### Warp (desktop)

- Harness: [Warp](/harnesses/warp.md)
- current: **Unknown**
- preview: **Unknown**

### Claude CLI (cli)

- Harness: [Claude CLI](/harnesses/claude-cli.md)
- current: **Unknown**
- preview: **Unknown**

### ChatGPT CLI (cli)

- Harness: [ChatGPT CLI](/harnesses/chatgpt-cli.md)
- current: **Unknown**
- preview: **Unknown**

### Codex CLI (cli)

- Harness: [Codex CLI](/harnesses/codex-cli.md)
- current: **Unknown**
- preview: **Unknown**

### OpenCode (cli)

- Harness: [OpenCode](/harnesses/opencode.md)
- current: **Unknown**
- preview: **Unknown**

### Gemini CLI (cli)

- Harness: [Gemini CLI](/harnesses/gemini-cli.md)
- current: **Unknown**
- preview: **Unknown**

### Aider (cli)

- Harness: [Aider](/harnesses/aider.md)
- current: **Unknown**
- preview: **Unknown**

### Goose (cli)

- Harness: [Goose](/harnesses/goose.md)
- current: **Unknown**
- preview: **Unknown**

### Copilot CLI (cli)

- Harness: [Copilot CLI](/harnesses/copilot-cli.md)
- current: **Unknown**
- preview: **Unknown**

### Amp (cli)

- Harness: [Amp](/harnesses/amp-cli.md)
- current: **Unknown**
- preview: **Unknown**