---
title: [In-Depth Explanation by a Patent Attorney] Decoding OpenAI’s “AI Agent That Learns from Videos” Patent US 11,887,367 B1 (VPT) | How to Create “Computer Use”
description: A patent attorney provides a thorough explanation of OpenAI’s registered patent US 11,887,367 B1 (VPT). A training method that uses inverse dynamics modeling (IDM) and non-causal pseudo-labeling to teach computer operations from unlabeled video data. Includes a citation of the original text of Claim
image: https://www.evorix.jp/hubfs/Gemini_Generated_Image_862ths862ths862t.jpg
---

[Skip to content](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#main-content)

- [English](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367)
- [Chinese](https://www.evorix.jp/zh/blog/openai-vpt-patent-us11887367)
- [Deutsch (German)](https://www.evorix.jp/de/blog/openai-vpt-patent-us11887367)
- [Español (Spanish)](https://www.evorix.jp/es/blog/openai-vpt-patent-us11887367)
- [Français (French)](https://www.evorix.jp/fr/blog/openai-vpt-patent-us11887367)
- [Português (Portuguese)](https://www.evorix.jp/pt/blog/openai-vpt-patent-us11887367)
- [한국어 (Korean)](https://www.evorix.jp/ko/blog/openai-vpt-patent-us11887367)
- [日本語 - 日本 (Japanese - Japan)](https://www.evorix.jp/blog/openai-vpt-patent-us11887367)

English

Show submenu for translations

[![知的財産事務所エボリクス/EVORIX/大阪/特許・商標・意匠登](https://www.evorix.jp/hs-fs/hubfs/%E7%9F%A5%E7%9A%84%E8%B2%A1%E7%94%A3%E4%BA%8B%E5%8B%99%E6%89%80%E3%82%A8%E3%83%9C%E3%83%AA%E3%82%AF%E3%82%B9%20(500%20%C3%97%20250%20px).png?width=500&height=250&name=%E7%9F%A5%E7%9A%84%E8%B2%A1%E7%94%A3%E4%BA%8B%E5%8B%99%E6%89%80%E3%82%A8%E3%83%9C%E3%83%AA%E3%82%AF%E3%82%B9%20(500%20%C3%97%20250%20px).png)](https://www.evorix.jp/)

- [Services](https://www.evorix.jp/en/contents)
  
  Show submenu for Services 
  
    - [Patent Filing](https://www.evorix.jp/en/patent-service)
    - [Trademark Registration](https://www.evorix.jp/en/trademark-service)
    - [Design Registration](https://www.evorix.jp/en/design-service)
    - [Copyright](https://www.evorix.jp/en/copyright-service)
    - [Unfair Competition](https://www.evorix.jp/en/unfair-competition)
    - [Patent Attorney Advisor](https://www.evorix.jp/en/komon)
- [International Filing](https://www.evorix.jp/en/international)
  
  Show submenu for International Filing 
  
    - [PCT International Patent](https://www.evorix.jp/en/pct)
    - [Madrid Protocol Trademark](https://www.evorix.jp/en/madrid-protocol-trademark)
    - [Hague Design Application](https://www.evorix.jp/en/hague-design-application)
    - [Global Patent Systems](https://www.evorix.jp/patent-world)
    - [Global Trademark Systems](https://www.evorix.jp/trademark-world)
    - [Global Design Systems](https://www.evorix.jp/design-world)
- [Industries](https://www.evorix.jp/en/industries)
  
  Show submenu for Industries 
  
    - [For Startups](https://www.evorix.jp/en/startup)
    - [For Manufacturing](https://www.evorix.jp/en/manufacturing)
    - [For IT Companies](https://www.evorix.jp/it-ip-portal)
- [About Us](https://www.evorix.jp/en/about)
  
  Show submenu for About Us 
  
    - [Firm Overview](https://www.evorix.jp/en/about)
    - [Philosophy & Vision](https://www.evorix.jp/philosophy)
    - [Our Patent Attorneys](https://www.evorix.jp/en/staff)
    - [Locations](https://www.evorix.jp/en/access)
    - [Seminars & Lectures](https://www.evorix.jp/en/seminar)
    - [Careers](https://www.evorix.jp/en/recruit)
- [Resources](https://www.evorix.jp/en/blog)
  
  Show submenu for Resources 
  
    - [Blog](https://www.evorix.jp/en/blog)
    - [FAQ](https://www.evorix.jp/en/faq)
    - [IP Glossary](https://www.evorix.jp/en/glossary)
    - [Foreign Filing Subsidy Guide](https://www.evorix.jp/%E3%82%B8%E3%82%A7%E3%83%88%E3%83%AD%E5%A4%96%E5%9B%BD%E5%87%BA%E9%A1%98%E5%8A%A9%E6%88%90%E9%87%91%E3%81%AE%E3%81%94%E6%A1%88%E5%86%85)
    - [AI Draft × Patent Attorney Check](https://www.evorix.jp/ai-draft-patent-lp)
- [Contact](https://www.evorix.jp/en/inquiry)
  
  Show submenu for Contact 
  
    - [Consultation Process](https://www.evorix.jp/en/consultation)
    - [Inquiry Form](https://www.evorix.jp/en/inquiry)

Open main navigation

Close main navigation

- [Services](https://www.evorix.jp/en/contents)
  
  Show submenu for Services 
  
    - [Patent Filing](https://www.evorix.jp/en/patent-service)
    - [Trademark Registration](https://www.evorix.jp/en/trademark-service)
    - [Design Registration](https://www.evorix.jp/en/design-service)
    - [Copyright](https://www.evorix.jp/en/copyright-service)
    - [Unfair Competition](https://www.evorix.jp/en/unfair-competition)
    - [Patent Attorney Advisor](https://www.evorix.jp/en/komon)
- [International Filing](https://www.evorix.jp/en/international)
  
  Show submenu for International Filing 
  
    - [PCT International Patent](https://www.evorix.jp/en/pct)
    - [Madrid Protocol Trademark](https://www.evorix.jp/en/madrid-protocol-trademark)
    - [Hague Design Application](https://www.evorix.jp/en/hague-design-application)
    - [Global Patent Systems](https://www.evorix.jp/patent-world)
    - [Global Trademark Systems](https://www.evorix.jp/trademark-world)
    - [Global Design Systems](https://www.evorix.jp/design-world)
- [Industries](https://www.evorix.jp/en/industries)
  
  Show submenu for Industries 
  
    - [For Startups](https://www.evorix.jp/en/startup)
    - [For Manufacturing](https://www.evorix.jp/en/manufacturing)
    - [For IT Companies](https://www.evorix.jp/it-ip-portal)
- [About Us](https://www.evorix.jp/en/about)
  
  Show submenu for About Us 
  
    - [Firm Overview](https://www.evorix.jp/en/about)
    - [Philosophy & Vision](https://www.evorix.jp/philosophy)
    - [Our Patent Attorneys](https://www.evorix.jp/en/staff)
    - [Locations](https://www.evorix.jp/en/access)
    - [Seminars & Lectures](https://www.evorix.jp/en/seminar)
    - [Careers](https://www.evorix.jp/en/recruit)
- [Resources](https://www.evorix.jp/en/blog)
  
  Show submenu for Resources 
  
    - [Blog](https://www.evorix.jp/en/blog)
    - [FAQ](https://www.evorix.jp/en/faq)
    - [IP Glossary](https://www.evorix.jp/en/glossary)
    - [Foreign Filing Subsidy Guide](https://www.evorix.jp/%E3%82%B8%E3%82%A7%E3%83%88%E3%83%AD%E5%A4%96%E5%9B%BD%E5%87%BA%E9%A1%98%E5%8A%A9%E6%88%90%E9%87%91%E3%81%AE%E3%81%94%E6%A1%88%E5%86%85)
    - [AI Draft × Patent Attorney Check](https://www.evorix.jp/ai-draft-patent-lp)
- [Contact](https://www.evorix.jp/en/inquiry)
  
  Show submenu for Contact 
  
    - [Consultation Process](https://www.evorix.jp/en/consultation)
    - [Inquiry Form](https://www.evorix.jp/en/inquiry)
- - [English](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367)
    - [Chinese](https://www.evorix.jp/zh/blog/openai-vpt-patent-us11887367)
    - [Deutsch (German)](https://www.evorix.jp/de/blog/openai-vpt-patent-us11887367)
    - [Español (Spanish)](https://www.evorix.jp/es/blog/openai-vpt-patent-us11887367)
    - [Français (French)](https://www.evorix.jp/fr/blog/openai-vpt-patent-us11887367)
    - [Português (Portuguese)](https://www.evorix.jp/pt/blog/openai-vpt-patent-us11887367)
    - [한국어 (Korean)](https://www.evorix.jp/ko/blog/openai-vpt-patent-us11887367)
    - [日本語 - 日本 (Japanese - Japan)](https://www.evorix.jp/blog/openai-vpt-patent-us11887367)
  
  
  
  
  English
  
  Show submenu for translations
- [Contact](https://www.evorix.jp/en/inquiry)

[Contact](https://www.evorix.jp/en/inquiry)

 2026/07/18

# \[In-Depth Explanation by a Patent Attorney\] Decoding OpenAI’s “AI Agent That Learns from Videos” Patent US 11,887,367 B1 (VPT) | How to Create “Computer Use”

![Picture of Takefumi Sugiura – Japanese Patent Attorney](https://app.hubspot.com/settings/avatar/4ef5aa3d824852243e3f9a0ef7c7a511) [Takefumi Sugiura – Japanese Patent Attorney](https://www.evorix.jp/en/blog/author/takefumi-sugiura-japanese-patent-attorney)

Share: [facebook-f icon](http://www.facebook.com/share.php?u=https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367) [linkedin-in icon](http://www.linkedin.com/shareArticle?mini=true&url=https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367) [Twitter icon](https://twitter.com/intent/tweet?url=https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367) [pinterest-p icon](http://pinterest.com/pin/create/link/?url=https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367) [envelope icon](mailto:?body=https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367)

![Gemini_Generated_Image_862ths862ths862t](https://www.evorix.jp/hs-fs/hubfs/Gemini_Generated_Image_862ths862ths862t.jpg?width=1376&height=768&name=Gemini_Generated_Image_862ths862ths862t.jpg)To “have an AI operate a computer,” you first need **to teach it “how to operate it.”**We’ve previously covered the patents underpinning Anthropic’s “Computer Use” in this series, but **how does OpenAI teach AI to operate a computer screen**? The answer lies in registered patent **US 11,887,367 B1**, which we’ll explore in depth in this article.

In a nutshell, OpenAI’s approach, as outlined in this patent, is **to “have the AI learn by watching a large number of videos of humans performing these operations.”** Moreover, it employs a sophisticated mechanism that automatically labels unlabeled videos using a proprietary method. This is a contrasting example that pursues the same goal **via a path entirely different** from Anthropic’s “Computer Use” patents.A patent attorney specializing in AI intellectual property will explain this while citing the actual claims.

**💡 Key Point:** This article is part of the AI Agent Patent Series. Anthropic’s contrasting approach is explained in<https://www.evorix.jp/blog/anthropic-computer-use-patent-us12430150>[the Data Flow Patent](https://www.evorix.jp/blog/anthropic-data-flow-patent-us20250299074) and [the Core Computer Use Patent](https://www.evorix.jp/blog/anthropic-computer-use-patent-us12430150).

Table of Contents

1. [30-Second Summary | AI That “Learns Operations by Watching Videos”](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#summary)
2. [Basic Information on the Patent](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#basic)
3. [Background | Creating “correct labels” for screen operations is costly](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#problem)
4. [Core Technology | Inverse Dynamics Model (IDM) and Pseudo-Labeling](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#idm)
5. [Key Innovation | “Non-causal (forecasting the future)” Prediction](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#noncausal)
6. [What Kind of Operations Are Outputted?](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#actions)
7. [A Clause-by-Clause Analysis of Independent Claim 1](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#claim1)
8. [Claim Structure | The Three-Part Set: Method, System, and Medium](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#structure)
9. [OpenAI vs. Anthropic | Two Paths to “Computer Use”](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#vs)
10. [Can Learning Methods Be Patented? Examination Practices in Japan, the U.S., and Europe](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#exam)
11. [Lessons for Your Own Applications](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#lessons)
12. [Frequently Asked Questions (FAQ)](https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367#faq)

## 30-Second Summary | AI That “Learns Operations by Watching Videos”

**● What the Patent Covers: A training method** for teaching AI to “automatically perform on-screen operations.”  
**● Key Points:** Train an “Inverse Dynamics Model (IDM)” using a small amount of labeled video → Automatically label (pseudo-label) a massive amount of unlabeled video → Train an operation model using that large dataset.  
**● Key Innovation:** The IDM uses **“non-causal” prediction**—**which can reference future frames**—resulting in high accuracy in operation estimation.  
**● Patent Holder:** OpenAI OpCo, LLC (developer of ChatGPT).  
**● Status: U.S**. **registered patent** (registered January 30, 2024; 20 claims in total). A method referred to by OpenAI as “VPT.”

## Basic Patent Information

| Item | Content |
| --- | --- |
| Patent Number | US 11,887,367 B1 |
| Title of the Invention | Using machine learning to train and use a model to perform automatic interface actions based on video and input datasets |
| Registration Date | January 30, 2024 |
| Filing Date / Priority Date | April 19, 2023 |
| Applicant | OpenAI OpCo, LLC |
| Inventors | Bowen Baker, Jeffrey Clune, et al. (9 in total) |
| Number of Claims | 20 (3 independent claims: Claims 1, 13, and 20) |
| Common Name | VPT (Video PreTraining) |
| Status | Granted Patent |

## Background | Creating “correct labels for screen operations” is costly

The most straightforward way to teach an AI screen operations is to provide it with a large amount of **correct data (labeled data)**—such as “Press this key when this screen appears”—and have it learn from that. However, manually annotating videos to indicate “when, which key, and which click was made” incurs enormous costs.

On the other hand, **there are countless** videos on the internet showing people operating software and games. The problem is that these videos lack operation labels. The technical challenge addressed by this patent is how to utilize this “**massive volume of unlabeled videos**.”

## Core Technology | Inverse Dynamics Model (IDM) and Pseudo-Labeling

At the core of this patent’s solution is **the Inverse Dynamics Model (IDM)**.

**What is IDM?** It is a model that estimates “**what actions were performed**” during a given time interval by analyzing **the screen (observations)** before and after that point. Whereas conventional AI (policy models) predicts “what to do next,” IDM performs what is essentially a reverse estimation—it “**retroactively infers what was done**.”

The processing flow is as follows.

\[VPT: Process for Learning Operations from Videos\] ① A small amount of labeled video (annotated by humans) │ Training ▼ ② Train the Inverse Dynamics Model (IDM) ・Enables estimation of “operations performed” from preceding and following frames │ Application ▼ ③ Apply the IDM to a massive amount of unlabeled video data ・Automatically estimate the action at each time step = Generate “pseudo-labels” │ ▼ ④ A large volume of pseudo-labeled video data is generated │ Training ▼ ⑤ Train the action model (agent) on a large scale

**💡 Key Point:** The key is **to use the IDM**—**created from a “small amount of ground-truth data”—as a “labeling machine” to instantly convert a massive amount of unlabeled video into training data**. This dramatically reduces the cost of manual annotation and paves the way for training computer-based agents at scale.

## The Key Innovation | “Non-Causal (Forward-Looking)” Prediction

Claim 1 explicitly states that the IDM’s predictions **are “based on a non-causal combination of past and future information.”** This is the technical highlight.

In reality, the “policy model” that the AI uses to make real-time decisions **can only see the past** (the future has not yet occurred = causal). However, since IDM is **a post-processing step for labeling**, it can **reference both the frames before and after** a given point in time**—including future frames**.

**💡 Key Point:** Thanks to the condition that it “can look into the future,” IDM **can predict “which action was performed at that moment” with far greater accuracy**.For example, based on future information such as “the cursor moved to the right in the next frame,” it can estimate with high accuracy that “the mouse was just moved to the right.” **Utilizing** this **“non-causality” for labeling** is the intellectual core of this invention.

## What Kind of Actions Are Generated?

According to the specification, the actions generated by the model (automatic interface actions) include **keystrokes, button presses, touchscreen inputs, joystick movements, mouse clicks, scrolling,** and **mouse movements**. Application areas cited include video games, various processing applications, web browsers, spreadsheets, and file explorers.

In other words, the goal is to enable AI to perform any operation a human would perform on a GUI **without human intervention**. This is precisely the foundational technology for “computer use” agents.

## Reading Independent Claim 1 Clause by Clause

US 11,887,367 B1 | Claim 1 (Original Text / English)

A method for training a machine learning model to perform automated actions, comprising: receiving unlabeled digital video data; generating pseudo-labels for the unlabeled digital video data, wherein the generating comprises: receiving labeled digital video data; training a first machine learning model including an inverse dynamics model (IDM) using the labeled digital video data; and generating at least one pseudo-label for the unlabeled digital video data, wherein: the at least one pseudo-label is based on a prediction, generated by the IDM, of one or more actions that mimic at least one timestep of the unlabeled digital video data, and the prediction of the one or more actions is generated based on a non-causal combination of past information and future information within the unlabeled digital video data, the past and future information being relative to one or more reference frames within the unlabeled digital video data; adding the at least one pseudo-label to the unlabeled digital video data to form pseudo-labeled digital video data; and further training the first machine learning model or a second machine learning model using the pseudo-labeled digital video data to generate at least one additional pseudo-label for the unlabeled digital video.

Reference Translation by a Patent Attorney (Japanese)

A method for training a machine learning model to perform automated actions, comprising

:・a step of receiving **unlabeled digital video data**; and・a step of **generating pseudo-labels** for the unlabeled digital video data (including the following):  
　- receiving labeled digital video data;  
- **training a first machine learning model**, **including an inverse dynamics model (IDM)**, using the labeled data;  
and - generating at least one pseudo-label for the unlabeled video.The pseudo-labels are based on predictions by the IDM of one or more actions that mimic at least one time point in the unlabeled video; said predictions are generated based on **a “non-causal” combination of past and future information** relative to a reference frame;  
・a step of adding the pseudo-labels to **form pseudo-labeled video data**;  
and ・a step of **further training** a first or second model using the pseudo-labeled data to generate additional pseudo-labels;

### Organization of Limitations Supporting the Claims

| Claims | Technical Meaning | Reason for Inclusion |
| --- | --- | --- |
| IDM (Inverse Dynamics Model) | Inferring User Actions from Previous and Next Screens | Moving Beyond Abstract Ideas to Concrete Algorithms |
| Non-causal (past + future) prediction | Referencing Future Frames to Improve Accuracy | The Core of the Invention’s Originality and Inventive Step |
| Pseudo-labeling | Converting Unlabeled Videos into Training Data | Solution to the Technical Challenge (Annotation Cost) |
| Further Training | Training the Operational Model Using Pseudo-Data | A Complete Processing Workflow as a Learning Method |

## Claim Structure | Three-Part Set: Method, System, and Medium

This patent consists of a total of 20 claims and follows the standard structure for software patents, with independent claims organized into three categories: **method (Claim 1)**, **system (Claim 13)**, **and non-transitory computer-readable medium (Claim 20)**.This structure **covers different potential infringers**: those who implement the method, those who manufacture or use the device, and those who distribute the program.

## OpenAI vs. Anthropic | Two Paths to “Computer Use”

Although both OpenAI and Anthropic share the same goal of “having AI operate a PC,” they have obtained **patents using different technical approaches**. A comparison of the patents from both companies, as examined in this series, clearly highlights their differing strategies.

|   | OpenAI (this article) | Anthropic (Previously Discussed) |
| --- | --- | --- |
| Representative Patents | US 11,887,367 B1 (VPT) | US 12,430,150 B1, among others |
| Subject of Protection | **Training Method for Learning Operations from Videos** | **Agent Execution Framework, DSL, and Data Flow** |
| Approach | Large-scale unlabeled video data + automatic labeling via IDM | Runtime Architecture and Dedicated Language |
| Technical Origins | In-house Research (VPT) | Acquisition of Adept |
| Analogy | Mastering “How to Teach (Learning Methods)” | Mastering “How to Operate (Execution System)” |

**💡 Key Point:** OpenAI focuses on patenting **“how to train (training methods and data)**,**”** while Anthropic focuses on **“how to operate (execution architecture)**.”**This is** a prime example of how companies in the same product sector **secure patents based on** their **respective areas of strength**. When filing your own patent applications, it’s crucial to determine “which layer to compete in.”

## Can Learning Methods Be Patented? Examination in Japan, the U.S., and Europe

### United States (USPTO)

Since machine learning training methods can be viewed as abstract mathematical techniques, the Alice/Mayo test becomes a key issue.Since this case involves **specific algorithms**—such as IDM, non-causal prediction, and pseudo-labeling—along with **specific actions** like keystrokes and mouse operations, it is easier to argue that it provides a “concrete solution to a technical problem,” and the patent is currently registered.

### Japan (JPO)

In Japan, as well, training methods and pre-trained models are patentable. However, according to the Japan Patent Office’s AI case law, “simply replacing human work with AI” is deemed to lack inventive step.This case features **a** clear **technical innovation—"utilizing non-causality for labeling"—**and a clear benefit—"a dramatic reduction in annotation costs," making it easy to argue for inventive step.

### Europe (EPO)

While mathematical methods themselves are excluded, this application clearly demonstrates a technical contribution to the technical challenge of “efficiently converting unlabeled video into training data,” and its structure makes it easy to evaluate as a technical feature even under the COMVIK approach.

A detailed comparison of examination practices for AI agent patents in Japan, the U.S., and Europe is provided in [“Patent Cases and Examination Practices in Japan, the U.S., and Europe.”](https://www.evorix.jp/blog/ai-agent-patent-cases-japan-us-europe)

## Lessons for Your Own Applications

**① Patent the training methods and data creation processes.** Not only the model itself, but also “how to train it” and “how to create training data” can form the basis of strong patents.

**② Highlight your unique technical ingenuity.** Place specific ideas that effectively solve problems—such as “the use of non-causal prediction”—at the center of your claims.

**③ Move away from abstract mathematics.** Describe specific algorithms and specific outputs (such as mouse and keyboard operations) to ensure patent eligibility.

**④ Compete at the level where your company excels.** Even if you share the same goal as competitors, it’s an effective strategy to secure rights at the level where your company excels (e.g., learning methods, execution systems, data, etc.).

Why not secure patent rights for your company’s AI, including its learning methods and data?

Patent attorneys with deep expertise in the IT, software, and AI fields provide comprehensive support—from claim drafting that includes learning methods, data, and models, to free assessments of patentability, and application strategies in Japan, the U.S., and Europe.

[Schedule a Free Initial Consultation](https://www.evorix.jp/free-consultation)[IT & AI Intellectual Property Services](https://www.evorix.jp/it-ip-portal)

## Frequently Asked Questions (FAQ)

Q. What kind of patent is US 11,887,367 B1?

A. It is a U.S. patent registered by OpenAI that protects a method for training AI to perform “automated screen operations.”It is a technology that uses an “Inverse Dynamics Model (IDM)”—trained on a small amount of labeled data—to automatically label (pseudo-label) vast amounts of unlabeled video (such as footage of people operating software), and then trains an operation model using that large dataset.It corresponds to the method OpenAI calls “VPT (Video PreTraining)” and was registered on January 30, 2024.

Q. What is an “Inverse Dynamics Model (IDM)”?

A. It is a model that estimates “what actions were performed” during a given time interval based on the video frames (observations) before and after that point. Whereas conventional AI (policy models) predict “what to do next,” IDM estimates “what was done” retrospectively.Because it can reference not only past frames but also future frames, it achieves high accuracy in estimating user actions and can generate large volumes of labels at low cost.

Q. Why is “learning from videos” important?

A. There are countless videos on the internet showing people operating software and games. However, these videos do not include action labels indicating “when and which keys were pressed.”This invention has paved the way for training computer-use agents cost-effectively and at scale by training IDM on a small amount of labeled data and automatically labeling vast amounts of unlabeled video.

Q. How is this different from Anthropic’s “computer use” patent?

A. The approaches are fundamentally different. Anthropic (originating from Adept) protects the “agent execution framework, DSL, and data flow.”In contrast, OpenAI’s patent protects a “training method for teaching an agent to perform operations from video.” It is interesting to note that, despite addressing the same challenge of “having AI operate a PC,” the two companies have obtained patents based on different technical approaches.

Q. Can a learning method (training method) also be patented?

A. Yes, they can. As demonstrated by this patent, if you clearly describe specific algorithms (IDM, non-causal prediction, pseudo-labeling) and the technical effects they produce (low-cost, large-scale labeling), it is possible to obtain patent protection in Japan, the U.S., or Europe.Data creation methods and training methods are the source of AI’s competitive advantage and are important subjects for patent protection.

**Note regarding this article:** This article provides a general explanation of the technology and system based on published patent applications. Although US 11,887,367 B1 is a registered patent, the actual scope of protection is determined by the wording of each claim, the doctrine of equivalents, and historical information.The cited claims, abstract, and specification are based on published patent bulletin data (such as FreePatentsOnline); however, for legally significant purposes (FTO, infringement analysis, invalidation, patent applications, etc.), please be sure to verify the USPTO official transcript and the latest prosecution history, and consult a specialist for an individual review.The Japanese translation is provided for reference purposes only; the official text is the original English version.

**See also (AI Agent Patent Series):**  
・[Anthropic’s Core “Computer Use” Patent US 12,430,150 B1 (Execution Platform)](https://www.evorix.jp/blog/anthropic-computer-use-patent-us12430150)  
・[Anthropic’s Data Flow Patents (Training ↔ Inference Pipeline)](https://www.evorix.jp/blog/anthropic-data-flow-patent-us20250299074) [・Patent Case Studies and](https://www.evorix.jp/blog/ai-agent-patent-cases-japan-us-europe)  
[Examination Practices in Japan, the U.S., and Europe (Case Studies)](https://www.evorix.jp/blog/ai-agent-patent-cases-japan-us-europe) [・Can](https://www.evorix.jp/blog/ai-agent-patent-application)  
[AI Agent Technology Be Patented?(Basics)](https://www.evorix.jp/blog/ai-agent-patent-application)

## Source

- US 11,887,367 B1 (Google Patents): [https://patents.google.com/patent/US11887367B1/en](https://patents.google.com/patent/US11887367B1/en)
- Claims and Specification (FreePatentsOnline): [https://www.freepatentsonline.com/11887367.html](https://www.freepatentsonline.com/11887367.html)

特許, 外国特許, 知財戦略, AI, ソフトウェア特許, 弁理士, AI特許, 知的財産権, AIエージェント, 特許事務所, OpenAI

## Related posts

[![](https://www.evorix.jp/hs-fs/hubfs/Gemini_Generated_Image_u4oipou4oipou4oi.jpg?height=200&name=Gemini_Generated_Image_u4oipou4oipou4oi.jpg)](https://www.evorix.jp/en/blog/openai-custom-gpts-patent-us12406207)

特許, 外国特許, 知財戦略, AI, ソフトウェア特許, 弁理士, AI特許, 知的財産権, AIエージェント, 特許事務所, OpenAI

## [\[In-Depth Explanation by a Patent Attorney\] Analyzing OpenAI’s “Custom GPTs” Patent US 12,406,207 B2 | “Model Builder”: AI Creating AI](https://www.evorix.jp/en/blog/openai-custom-gpts-patent-us12406207)

![Picture of Takefumi Sugiura – Japanese Patent Attorney](https://app.hubspot.com/settings/avatar/4ef5aa3d824852243e3f9a0ef7c7a511) [Takefumi Sugiura – Japanese Patent Attorney](https://www.evorix.jp/en/blog/author/takefumi-sugiura-japanese-patent-attorney) 

 2026/07/18

The ability to create a unique AI assistant with specialized knowledge without writing a single...

[Read more](https://www.evorix.jp/en/blog/openai-custom-gpts-patent-us12406207)

[![【弁理士徹底解説】OpenAIのマルチエージェント特許 US 12,405,822 B1 を読み解く｜共有ワークスペースで複数AIを協調させる](https://www.evorix.jp/hs-fs/hubfs/Gemini_Generated_Image_fsjjeefsjjeefsjj.jpg?height=200&name=Gemini_Generated_Image_fsjjeefsjjeefsjj.jpg)](https://www.evorix.jp/en/blog/openai-multi-agent-workspace-patent-us12405822)

特許, 外国特許, 知財戦略, AI, ソフトウェア特許, 弁理士, AI特許, マルチエージェント, 知的財産権, AIエージェント, 特許事務所, OpenAI

## [\[In-Depth Explanation by a Patent Attorney\] Analyzing OpenAI’s Multi-Agent Patent US 12,405,822 B1 | Coordinating Multiple AIs in a Shared Workspace](https://www.evorix.jp/en/blog/openai-multi-agent-workspace-patent-us12405822)

![Picture of Takefumi Sugiura – Japanese Patent Attorney](https://app.hubspot.com/settings/avatar/4ef5aa3d824852243e3f9a0ef7c7a511) [Takefumi Sugiura – Japanese Patent Attorney](https://www.evorix.jp/en/blog/author/takefumi-sugiura-japanese-patent-attorney) 

 2026/07/18

Even complex tasks that are difficult for a single AI agent to handle may be solvable if multiple...

[Read more](https://www.evorix.jp/en/blog/openai-multi-agent-workspace-patent-us12405822)

[![【弁理士徹底解説】Anthropic「Computer Use」の中核特許 US 12,430,150 B1 を読み解く｜クレーム全文と技術アーキテクチャ](https://www.evorix.jp/hs-fs/hubfs/Gemini_Generated_Image_7fcf6e7fcf6e7fcf.jpg?height=200&name=Gemini_Generated_Image_7fcf6e7fcf6e7fcf.jpg)](https://www.evorix.jp/en/blog/anthropic-computer-use-patent-us12430150)

特許, 外国特許, 知財戦略, AI, ソフトウェア特許, 弁理士, AI特許, マルチエージェント, 知的財産権, AIエージェント, 特許事務所, Anthropic

## [\[In-Depth Explanation by a Patent Attorney\] Decoding Anthropic’s Core “Computer Use” Patent, US 12,430,150 B1 | Full Text of the Claims and Technical Architecture](https://www.evorix.jp/en/blog/anthropic-computer-use-patent-us12430150)

![Picture of Takefumi Sugiura – Japanese Patent Attorney](https://app.hubspot.com/settings/avatar/4ef5aa3d824852243e3f9a0ef7c7a511) [Takefumi Sugiura – Japanese Patent Attorney](https://www.evorix.jp/en/blog/author/takefumi-sugiura-japanese-patent-attorney) 

 2026/07/18

The era in which AI agents “use” computers has arrived. Leading the way is Anthropic’s “Computer...

[Read more](https://www.evorix.jp/en/blog/anthropic-computer-use-patent-us12430150)

---

[![知的財産事務所エボリクス/EVORIX/大阪/特許・商標・意匠登](https://www.evorix.jp/hs-fs/hubfs/%E7%9F%A5%E7%9A%84%E8%B2%A1%E7%94%A3%E4%BA%8B%E5%8B%99%E6%89%80%E3%82%A8%E3%83%9C%E3%83%AA%E3%82%AF%E3%82%B9%20(500%20%C3%97%20250%20px).png?width=500&height=250&name=%E7%9F%A5%E7%9A%84%E8%B2%A1%E7%94%A3%E4%BA%8B%E5%8B%99%E6%89%80%E3%82%A8%E3%83%9C%E3%83%AA%E3%82%AF%E3%82%B9%20(500%20%C3%97%20250%20px).png "知的財産事務所エボリクス/EVORIX/大阪/特許・商標・意匠登")](https://www.evorix.jp)

Intellectual Property Law Firm EVORIX

 

4th Floor, Qus-Hiranomachi Building,  
3-1-2 Hiranomachi, Chuo-Ku, Osaka-shi,  
Osaka 541-0046 Japan

Mail: [contact@evorix.jp](mailto:contact@evorix.jp)

TEL: +81-6-7777-1884

- [Hague International Design Application](https://www.evorix.jp/hague-design-application)
- [Madrid Protocol International Trademark Application](https://www.evorix.jp/madrid-protocol-trademark)
- [Amazon IP Infringement Support](https://www.evorix.jp/amazon-infringement)

- [About Us](https://www.evorix.jp/about)
- [Our Attorneys](https://www.evorix.jp/staff)
- [Services](https://www.evorix.jp/contents)
- [Consultation Process](https://www.evorix.jp/consultation)
- [Blog](https://www.evorix.jp/blog)
- [Careers](https://www.evorix.jp/recruit)
- [Trademark Portfolio](https://www.evorix.jp/trademark-list)
- [Privacy Policy](https://www.evorix.jp/hubfs/%E8%B3%87%E6%96%99/HP-%E3%83%97%E3%83%A9%E3%82%A4%E3%83%90%E3%82%B7%E3%83%BC%E3%83%9D%E3%83%AA%E3%82%B7%E3%83%BC.pdf)
- [Contact](https://www.evorix.jp/inquiry)

---

 

Copyright © 2026, Intellectual Property Law Firm EVORIX® All rights reserved. 

```json
{
  "@context" : "https://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "name" : "Takefumi Sugiura – Japanese Patent Attorney",
    "url" : "https://www.evorix.jp/en/blog/author/takefumi-sugiura-japanese-patent-attorney"
  },
  "dateModified" : "2026-07-18T10:48:47.521Z",
  "datePublished" : "2026-07-18T10:48:47.000Z",
  "headline" : "[In-Depth Explanation by a Patent Attorney] Decoding OpenAI’s “AI Agent That Learns from Videos” Patent US 11,887,367 B1 (VPT) | How to Create “Computer Use”",
  "image" : [ "https://www.evorix.jp/hubfs/Gemini_Generated_Image_862ths862ths862t.jpg" ],
  "mainEntityOfPage" : {
    "@id" : "https://www.evorix.jp/en/blog/openai-vpt-patent-us11887367",
    "@type" : "WebPage"
  },
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "url" : "https://www.evorix.jp/hubfs/%E7%9F%A5%E7%9A%84%E8%B2%A1%E7%94%A3%E4%BA%8B%E5%8B%99%E6%89%80%E3%82%A8%E3%83%9C%E3%83%AA%E3%82%AF%E3%82%B9%20(500%20%C3%97%20250%20px).png"
    },
    "name" : "知的財産事務所エボリクス"
  }
}
```

```json
{
  "@context" : "https://schema.org",
  "@type" : "BlogPosting",
  "author" : {
    "@type" : "Person",
    "affiliation" : "知的財産事務所エボリクス",
    "jobTitle" : "弁理士",
    "name" : "杉浦 健文"
  },
  "datePublished" : "2026-06-06",
  "description" : "OpenAIの登録特許US 11,887,367 B1（VPT）を弁理士が深掘り解説。逆動力学モデル（IDM）と非因果的な疑似ラベリングで、ラベルなし動画からcomputer use操作を学習させる訓練方法。クレーム1の原文引用と逐条解説、Anthropicのcomputer use特許との対比、学習方法の日米欧の審査評価まで。",
  "headline" : "【弁理士徹底解説】OpenAIの「動画から学ぶAIエージェント」特許 US 11,887,367 B1（VPT）を読み解く",
  "image" : "https://www.evorix.jp/hubfs/EVORIX-logo-rich.png",
  "inLanguage" : "ja",
  "mainEntityOfPage" : "https://www.evorix.jp/blog/openai-vpt-patent-us11887367",
  "publisher" : {
    "@type" : "Organization",
    "logo" : {
      "@type" : "ImageObject",
      "url" : "https://www.evorix.jp/hubfs/EVORIX-logo-rich.png"
    },
    "name" : "EVORIX"
  }
}
```

```json
{
  "@context" : "https://schema.org",
  "@type" : "FAQPage",
  "mainEntity" : [ {
    "@type" : "Question",
    "acceptedAnswer" : {
      "@type" : "Answer",
      "text" : "An OpenAI U.S. patent protects a method for training AI to perform “automated screen operations.” This technology uses an “Inverse Dynamics Model (IDM)”—trained on a small amount of labeled data—to automatically label (pseudo-label) vast amounts of unlabeled video (such as footage of people operating software), and then trains an operation model using that large dataset. The patent, which corresponds to the method OpenAI calls “VPT (Video PreTraining),” was granted on January 30, 2024."
    },
    "name" : "What kind of patent is U.S. Patent No. 11,887,367 B1?"
  }, {
    "@type" : "Question",
    "acceptedAnswer" : {
      "@type" : "Answer",
      "text" : "This is a model that estimates “what actions were performed” during a given time interval based on screen captures (observations) taken before and after that interval. Whereas conventional AI (policy models) predict “what to do next,” IDM estimates “what was done” retrospectively. Because it can reference not only past frames but also future frames, it achieves high accuracy in estimating actions and can generate large volumes of labels at low cost."
    },
    "name" : "What is an “Inverse Dynamics Model (IDM)”?"
  }, {
    "@type" : "Question",
    "acceptedAnswer" : {
      "@type" : "Answer",
      "text" : "There are countless videos on the Internet showing people operating software and games. However, these videos do not include operation labels indicating “when and which keys were pressed.” This invention has paved the way for training computer-use agents cost-effectively and at scale by training an IDM using a small amount of labeled data and then automatically labeling vast amounts of unlabeled video."
    },
    "name" : "Why is “learning from videos” important?"
  }, {
    "@type" : "Question",
    "acceptedAnswer" : {
      "@type" : "Answer",
      "text" : "The approaches are fundamentally different. Anthropic (originating from Adept) protects “the agent’s execution framework, DSL, and data flow.” In contrast, OpenAI’s patent protects a “training method for teaching an agent to perform operations based on video.” It is interesting to note that, despite addressing the same challenge of “having AI operate a PC,” the two companies have obtained patents based on different technical approaches."
    },
    "name" : "How is this different from Anthropic's \"computer use\" patent?"
  }, {
    "@type" : "Question",
    "acceptedAnswer" : {
      "@type" : "Answer",
      "text" : "That is correct. As demonstrated by this patent, if you clearly describe specific algorithms (IDM, non-causal prediction, pseudo-labeling) and the technical effects they produce (low-cost, large-scale labeling), it is possible to obtain patent protection in Japan, the United States, and Europe. Data generation and training methods are the source of AI’s competitive advantage and are important subjects for patent protection."
    },
    "name" : "Can learning methods (training methods) be patented?"
  } ]
}
```