# US 2024/0257450 A1 · Information processing apparatus, information processing method, and non-transitory computer readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0257450 A1
- Document ID: US20240257450A1
- Status: Published application
- Kind: A1
- Application number: 18/417,050
- Filed: 2024-01-19
- Published: 2024-08-01
- Earliest claimed: 2023-02-01
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: KENJI OUCHI
- Web page: https://patentgrep.com/patent/US20240257450A1

## CPC

- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/54: relating to texture
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing apparatus according to the present invention includes at least one memory and at least one processor which function as: an acquisition unit configured to acquire a display condition for a graphic to be displayed in three-dimensional space; an analyzing unit configured to analyze the three-dimensional space; and a determining unit configured to determine a display position of the graphic in the three-dimensional space, on a basis of the display condition of the graphic and an analysis result of the three-dimensional space, wherein the display condition is associated with the graphic, and includes a condition relating to the three-dimensional space.

## Claims

### Claim 1

An information processing apparatus comprising at least one memory and at least one processor which function as:
an acquisition unit configured to acquire a display condition for a graphic to be displayed in three-dimensional space;
an analyzing unit configured to analyze the three-dimensional space; and
a determining unit configured to determine a display position of the graphic in the three-dimensional space, on a basis of the display condition of the graphic and an analysis result of the three-dimensional space, wherein
the display condition is associated with the graphic, and includes a condition relating to the three-dimensional space.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the at least one memory and the at least one processor further function as a second acquisition unit configured to acquire image data of the three-dimensional space, and
the analyzing unit analyzes the image data of the three-dimensional space.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein
the at least one memory and the at least one processor further function as a display control unit configured to perform control to display the graphic at the display position in the three-dimensional space.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1, wherein the three-dimensional space is real space or virtual space.

### Claim 5 (depends on 1)

The information processing apparatus according to claim 1, wherein
the analyzing unit analyzes at least a partial region of the three-dimensional space, and
the region analyzed by the analyzing unit is a region that corresponds to a field of view of a user, or a region including the region that corresponds to the field of view and a region that does not correspond to the field of view.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein the acquisition unit acquires metadata added to image data of the graphic, data that is separate from the image data of the graphic, data stored in the information processing apparatus, or data stored in an external device, as the display condition of the graphic.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, wherein the acquisition unit acquires one or more recommendation values that include at least one of a recommendation value of brightness of a background, a recommendation value of tint of the background, a recommendation value of white balance of the background, a recommendation value of resolution of the background, and a recommendation value of texture of the background, as the display condition of the graphic.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein
the determining unit determines a candidate for the display position of the graphic in the three-dimensional space, on a basis of the display condition of the graphic and the analysis result of the three-dimensional space,
the candidate is displayed identifiably in the three-dimensional space, and
the determining unit determines, in response to a predetermined user operation during display of the candidate, the candidate to be the display position of the graphic.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein the determining unit determines a position in the three-dimensional space at which a difference from the one or more recommendation values acquired as the display condition of the graphic is smaller than a threshold value, as the candidate for the display position of the graphic.

### Claim 10 (depends on 9)

The information processing apparatus according to claim 9, wherein, in a case in which a plurality of positions at each of which the difference from the one or more recommendation values acquired as the display condition of the graphic is smaller than the threshold value exist in the three-dimensional space, the determining unit determines a position at which the difference is smallest among the plurality of positions, as the candidate for the display position of the graphic.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein
the graphic is a graphic to be displayed in a state where it is combined on an image of the three-dimensional space, and
the at least one memory and the at least one processor further function as a correcting unit configured to correct an image of the three-dimensional space on a basis of the display condition of the graphic and the analysis result of the three-dimensional space.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein the correcting unit corrects at least one of brightness, tint, white balance, resolution, and texture of the image of the three-dimensional space.

### Claim 13 (depends on 11)

The information processing apparatus according to claim 11, wherein the correcting unit corrects the image of the three-dimensional space by a correction amount that is smaller than a predetermined amount.

### Claim 14 (depends on 1)

The information processing apparatus according to claim 1, wherein
the at least one memory and the at least one processor further function as a notification control unit configured to perform control to give a predetermined notification to a user in a case in which a predetermined change occurs in the three-dimensional space during display of the graphic, on a basis of the analysis result of the three-dimensional space.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein
the at least one memory and the at least one processor further function as a notification control unit for performing control to give a predetermined notification to a user in a case in which a predetermined amount of time elapses from start of displaying the graphic.

### Claim 16 (depends on 14)

The information processing apparatus according to claim 14, wherein the predetermined notification is a notification prompting updating of the display position of the graphic.

### Claim 17

An information processing apparatus comprising at least one memory and at least one processor which function as:
a determining unit configured to determine a candidate for a display position for a graphic in a three-dimensional space; and
a display control unit configured to perform control to identifiably display the candidate in the three-dimensional space, wherein
a candidate determined by the determining unit differs between a case of a first graphic, and a case of a second graphic that differs from the first graphic.

### Claim 18

An information processing method comprising:
acquiring a display condition for a graphic to be displayed in three-dimensional space;
analyzing the three-dimensional space; and
determining a display position of the graphic in the three-dimensional space, on a basis of the display condition of the graphic and an analysis result of the three-dimensional space, wherein
the display condition is associated with the graphic, and includes a condition relating to the three-dimensional space.

### Claim 19

A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute an information processing method comprising:
acquiring a display condition for a graphic to be displayed in three-dimensional space;
analyzing the three-dimensional space; and
determining a display position of the graphic in the three-dimensional space, on a basis of the display condition of the graphic and an analysis result of the three-dimensional space, wherein
the display condition is associated with the graphic, and includes a condition relating to the three-dimensional space.
