# US 2026/0065604 A1 · Information processing apparatus, information processing system, information processing method, and medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065604 A1
- Document ID: US20260065604A1
- Status: Published application
- Kind: A1
- Application number: 19/313,696
- Filed: 2025-08-28
- Published: 2026-03-05
- Earliest claimed: 2024-09-04
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: MAMORU TANAE; AZUSA MATSUMOTO; HIDEKAZU KAMEI; YUSUKE OKABE
- Web page: https://patentgrep.com/patent/US20260065604A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06T 2219/2016: Rotation, translation, scaling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An information processing apparatus is provided. The apparatus detects, from a medium, identification information for identifying 3D model data representing 3D models of an object respectively corresponding to a plurality of timecodes. The apparatus accepts a user operation to designate a timecode of a display target. The apparatus causes a display to display an image of the object based on a 3D model of the object corresponding to the timecode in accordance with the identification information and the user operation. The apparatus records, in accordance with a user operation, a virtual image to be synthesized with a captured image. The virtual image includes the image of the object displayed on the display.

## Claims

### Claim 1

An information processing apparatus comprising one or more memories storing instructions and one or more processors that execute the instructions to:
detect, from a medium, identification information for identifying 3D model data representing 3D models of an object respectively corresponding to a plurality of timecodes;
accept a user operation to designate a timecode of a display target;
cause a display to display an image of the object based on a 3D model of the object corresponding to the timecode in accordance with the identification information and the user operation; and
record, in accordance with a user operation, a virtual image to be synthesized with a captured image, the virtual image including the image of the object displayed on the display.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the one or more processors execute the instructions to accept a user operation to designate at least one of a position of the object, an orientation of the object, and a size of the object.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the one or more processors execute the instructions to cause the display to display a user interface for designating at least one of the timecode, the position of the object, the orientation of the object, and the size of the object.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1, wherein the one or more processors execute the instructions to
accept a user operation to designate a viewpoint with respect to the object, and
cause the display to display an image of the object from the viewpoint.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein the viewpoint with respect to the object is indicated by a physical position and attitude of the information processing apparatus with respect to the medium.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein the one or more processors execute the instructions to detect the identification information based on an image of the medium in a captured image.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein the identification information is printed as a code on the medium.

### Claim 8 (depends on 6)

The information processing apparatus according to claim 6, wherein the medium is a printed matter.

### Claim 9 (depends on 6)

The information processing apparatus according to claim 6, wherein the medium is a shaped object of a character.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein
the identification information identifies the 3D model data of each of a plurality of objects, and
the one or more processors execute the instructions to
accept a user operation to designate timecodes of a display target independently for the plurality of objects, respectively, and
cause the display to display images of the plurality of objects, wherein the images of the plurality of objects are based on respective 3D models of the respective objects corresponding to respective timecodes in accordance with the user operation.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein the one or more processors execute the instructions to accept a user operation to designate at least one of a position of the object, an orientation of the object, and a size of the object, independently for each of the plurality of objects.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein
the identification information identifies the 3D model data of each of a plurality of objects, and
the one or more processors execute the instructions to accept a user operation to designate at least one of a position of the object, an orientation of the object, and a size of the object, independently for each of the plurality of objects.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the one or more processors execute the instructions to
accept a user operation to designate a timecode range, and
record a moving image of the object based on a 3D model of the object corresponding to the timecode range in accordance with the user operation.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein the one or more processors execute the instructions to
accept a user operation to designate movement of a viewpoint with respect to the object, and
record a moving image of the object from a viewpoint moving in accordance with the user operation.

### Claim 15 (depends on 13)

The information processing apparatus according to claim 13, wherein the one or more processors execute the instructions to generate a synthesized moving image of the moving image having been recorded and a captured image.

### Claim 16 (depends on 1)

The information processing apparatus according to claim 1, wherein the one or more processors execute the instructions to record information indicating a region of an image of the object in the virtual image.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein the one or more processors execute the instructions to generate a synthesized image of the virtual image having been recorded and a captured image.

### Claim 18

An information processing system comprising one or more memories storing instructions and one or more processors that execute the instructions to:
detect, from a medium, identification information for identifying 3D model data representing 3D models of an object respectively corresponding to a plurality of timecodes;
accept a user operation to designate a timecode of a display target;
generate an image of the object based on a 3D model of the object corresponding to the timecode in accordance with the identification information and the user operation;
cause a display to display the image of the object; and
record, in accordance with a user operation, a virtual image to be synthesized with a captured image, the virtual image including the image of the object displayed on the display.

### Claim 19

An information processing method comprising:
detecting, from a medium, identification information for identifying 3D model data representing 3D models of an object respectively corresponding to a plurality of timecodes;
accepting a user operation to designate a timecode of a display target;
causing a display to display an image of the object based on a 3D model of the object corresponding to the timecode in accordance with the identification information and the user operation; and
recording, in accordance with a user operation, a virtual image to be synthesized with a captured image, the virtual image including the image of the object displayed on the display.

### Claim 20

A non-transitory computer-readable medium storing instructions executable by a computer to perform a method comprising:
detecting, from a medium, identification information for identifying 3D model data representing 3D models of an object respectively corresponding to a plurality of timecodes;
accepting a user operation to designate a timecode of a display target;
causing a display to display an image of the object based on a 3D model of the object corresponding to the timecode in accordance with the identification information and the user operation; and
recording, in accordance with a user operation, a virtual image to be synthesized with a captured image, the virtual image including the image of the object displayed on the display.
