OpenAI Operator: AI Agent Web

Position: OpenAI Operator: A New AI Agent for the Web
Location: Willis

• OpenAI Operator: A New AI Agent for the Web

OpenAI Operator: A New AI Agent for the Web

ChatGPT Pro users get first shot at web-based agents for $200 a month

OpenAI has recently released a research preview of its new AI agent, Operator .

Operator is a web-based AI agent that can perform various tasks, such as filling out forms, ordering groceries, and making purchases.

It is powered by a new Computer-Using Agent (CUA) model, which uses GPT-4o’s vision capabilities with advanced reasoning through reinforcement learning.

Here’s the bottom line:
OpenAI is moving forward but won’t revolutionize your business.

It’s just another step forward. But it’s a foreshadowing of what is to come.

What is Operator?

Operator is a web-based AI agent that can perform various tasks, such as filling out forms, ordering groceries, and making purchases. It is powered by a new Computer-Using Agent (CUA) model , which combines GPT-4o’s vision capabilities with advanced reasoning through reinforcement learning. Operator is designed with safety and privacy in mind, with layers of safeguards to prevent abuse and ensure users are firmly in control.

This means that while it can perform tasks autonomously, it will stop and ask for user input should it run into something requiring human intervention.

How does Operator work?

Operator uses GPT-4o’s vision capabilities to understand the content of a webpage. It then uses advanced reasoning through reinforcement learning to determine the best course of action to complete the task. For example, if the user asks Operator to fill out a form, Operator will first identify the form fields and then use its knowledge of the form to fill them out correctly.

However, if it requires human intervention, it will prompt you to ask for more information.

The Use Cases for Operator

Find a recipe and order the ingredients to be delivered with Instacart. Since the NFL Playoffs are going on, I was thinking of hosting a party, so I asked the agent to look up a recipe for Buffalo Chicken Dip and order the ingredients.

Operator Ordering Food for a Recipe

Who is Operator Available to?

Operator is available to ChatGPT Pro users. This expensive premium subscription plan offers enhanced features and capabilities compared to the free version and even more features than ChatGPT Plus.

Currently, ChatGPT Pro costs $200 per month. OpenAI plans to expand Operator to other subscription plans in the future. However, compared to Claude's Computer Use, it’s pretty expensive, if that’s your deciding factor.

Here's a summary of what ChatGPT Pro offers:

Everything in ChatGPT Plus: This includes unlimited access to models like o1, o1-mini, GPT-4o, and advanced voice (audio only), higher limits for video and screen sharing in advanced voice, access to o1 pro mode (which uses more computing for the best answers to the most challenging questions),

Extended access to Sora video generation - Ability to generate videos up to 1080P and 20 seconds long. Unlimited video generation.

Priority Access: Pro users get priority access to ChatGPT, even during peak usage times. This ensures that you can always access the AI when you need it.

How does Operator compare to Google Mariner and Antropic computer use?

Operator (OpenAI): Leverages GPT-4 with vision capabilities, specifically their new Computer-Using Agent (CUA) model. Emphasis on reinforcement learning from human feedback to improve task execution.

Mariner (Google): Built on Gemini 2.0, Google's latest multimodal model. It incorporates Google's extensive knowledge graph and search capabilities for information retrieval.

Claude Computer Use (Anthropic): It uses Claude 3.5 Sonnet, designed with constitutional AI for safer, more aligned task completion. Focus on natural language understanding for the following instructions.

2. Capabilities and Focus:

Operator: Seems geared towards complex, multi-step tasks involving interaction with various web elements (forms, shopping carts, etc.). Aims to be a general-purpose web agent.

Claude Computer Use: Strong at following natural language instructions for more straightforward computer interactions, like "find a document" or "compose an email." Less emphasis on…