# US 2025/0148690 A1 · Information processing method, information processing device, and non-transitory computer readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148690 A1
- Document ID: US20250148690A1
- Status: Published application
- Kind: A1
- Application number: 19/019,031
- Filed: 2025-01-13
- Published: 2025-05-08
- Earliest claimed: 2022-07-19
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Minami NAKA; Tadamasa TOMA; Satoshi MATSUI
- Web page: https://patentgrep.com/patent/US20250148690A1

## CPC

- G06T 15/04: Texture mapping
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 5/80: Geometric correction
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06T 2207/30244: Camera pose
- G06V 2201/07: Target detection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing device acquires a three-dimensional object by reproducing a real object including a dynamic region in a virtual space, identifies a first dynamic region indicating the dynamic region in the three-dimensional object, acquires a real image of the real object captured by an imaging device, detects a second dynamic region indicating the dynamic region in the real image, embeds an image of the second dynamic region in real time as a texture image of the first dynamic region, and outputs a display image of the three-dimensional object in which the image of the second dynamic region has been embedded.

## Claims

### Claim 1

An information processing method in a computer, the method comprising:
acquiring a three-dimensional object by reproducing a real object including a dynamic region in a virtual space;
identifying a first dynamic region indicating the dynamic region in the three-dimensional object;
acquiring a real image of the real object captured by an imaging device;
detecting a second dynamic region indicating the dynamic region in the real image;
embedding an image of the second dynamic region in real time as a texture image of the first dynamic region; and
outputting a display image of the three-dimensional object in which the image of the second dynamic region has been embedded.

### Claim 2 (depends on 1)

The information processing method according to claim 1, wherein
the real object has a marker indicating the dynamic region,
the identifying the first dynamic region includes detecting the first dynamic region based on the marker in the three-dimensional object, and
the detecting the second dynamic region includes detecting the second dynamic region based on an image indicating the marker included in the real image.

### Claim 3 (depends on 1)

The information processing method according to claim 1, wherein
the dynamic region corresponds to an object element constituting the real object,
the identifying the first dynamic region includes identifying a region of the object element in the three-dimensional object with object recognition processing, and
the detecting the second dynamic region includes detecting a region of the object element in the real image with the object recognition processing.

### Claim 4 (depends on 1)

The information processing method according to claim 1, wherein
the real image is repeatedly acquired, and
the detecting, the embedding, and the outputting of the second dynamic region are performed each time the real image is acquired.

### Claim 5 (depends on 1)

The information processing method according to claim 1, wherein
the embedding the image of the second dynamic region includes
acquiring a distortion parameter of the imaging device,
correcting distortion of the image of the second dynamic region using the distortion parameter, and
embedding the image of the second dynamic region after the correcting in the first dynamic region.

### Claim 6 (depends on 5)

The information processing method according to claim 5, wherein the distortion parameter is estimated by camera calibration using current position and attitude information about the imaging device, initial position and attitude information about the imaging device at a time of capturing an initial texture image embedded in the first dynamic region, two-dimensional position information about the dynamic region in the initial texture image, two-dimensional position information about the second dynamic region in the real image, and three-dimensional position information about the first dynamic region.

### Claim 7 (depends on 6)

The information processing method according to claim 6, wherein the current position and attitude information about the imaging device is estimated by applying a self-position estimation algorithm to the initial texture image and the real image.

### Claim 8 (depends on 1)

The information processing method according to claim 1, wherein
the embedding the image of the second dynamic region includes
editing the image of the second dynamic region to match with a shape of the first dynamic region, based on two-dimensional position information about a vertex of the second dynamic region and two-dimensional position information about a vertex of the first dynamic region, and
embedding the edited image of the second dynamic region in the first dynamic region.

### Claim 9 (depends on 1)

The information processing method according to claim 1, wherein the dynamic region includes a region corresponding to a display region of a monitor included in the real object.

### Claim 10

An information processing device comprising a processor,
wherein the processor
acquires a three-dimensional object by reproducing a real object including a dynamic region in a virtual space,
identifies a first dynamic region indicating the dynamic region in the three-dimensional object,
acquires a real image of the real object captured by an imaging device,
detects a second dynamic region indicating the dynamic region in the real image,
embeds an image of the second dynamic region in real time as a texture image of the first dynamic region, and
outputs a display image of the three-dimensional object in which the image of the second dynamic region has been embedded.

### Claim 11

A non-transitory computer readable recording medium storing an information processing program for causing a computer to perform processing of:
acquiring a three-dimensional object by reproducing a real object including a dynamic region in a virtual space;
identifying a first dynamic region indicating the dynamic region in the three-dimensional object;
acquiring a real image of the real object captured by an imaging device;
detecting a second dynamic region indicating the dynamic region in the real image;
embedding an image of the second dynamic region in real time as a texture image of the first dynamic region; and
outputting a display image of the three-dimensional object in which the image of the second dynamic region has been embedded.
