AI

Gemini on Mac can now use apps on its own and finish tasks in the background

The feature is rolling out only in English in the U.S., to Google AI Plus, Pro and Ultra subscribers

Image: Google

Google has introduced computer use in the Gemini app for Mac, which lets the assistant work across local files, desktop apps and the web on its own to complete multi-step tasks. Users just describe what they need, and according to Google, Gemini handles the clicking, typing, menus and forms.

Gemini does this in an isolated background window, with a live preview of each step right in the chat. The main screen and cursor stay free, so users can keep working on something else.

Users choose which apps Gemini can access, can pause it at any time and have to approve key actions before they happen. Google’s post doesn’t explain which actions it counts as key.

As examples, Google lists batch color-grading photos in design software, pulling details from local PDFs to request quotes for multi-box shipments and building a Google Slides presentation from metrics and screenshots. Gemini can also prepare listings for clothes on resale platforms, analyzing the photos and researching prices.

Competitors already offer something similar. In March, Anthropic let Claude control the computer, also starting on macOS, and in April OpenAI brought the same ability to Codex.

The Gemini app arrived on macOS in April and on Windows in September. Windows isn’t mentioned in the announcement, so it’s not known whether or when this feature will come there too.

The feature also lands before the release of macOS 27.3, in which Apple is tightening permissions for apps that control other apps and access data on the Mac. Google’s post doesn’t say which macOS permissions Gemini needs for this.

Apple is working on the same capabilities for Siri, according to a now removed job listing.

Computer use is rolling out in the U.S., in English only, for personal Google accounts of users 18 and older with a Google AI Plus, Pro or Ultra subscription. It requires a Mac with Apple Silicon running macOS Sequoia 15 or later, and Google doesn’t mention expanding it to other countries.