# US 2026/0095647 A1 · Information processing apparatus, information processing system, method for controlling information processing apparatus, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0095647 A1
- Document ID: US20260095647A1
- Status: Published application
- Kind: A1
- Application number: 19/333,863
- Filed: 2025-09-19
- Published: 2026-04-02
- Earliest claimed: 2024-10-02
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: MUNEYOSHI MAEDA
- Web page: https://patentgrep.com/patent/US20260095647A1

## CPC

- H04N 23/635: {Region indicators; Field of view indicators}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 2207/20221: Image fusion; Image merging
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The information processing apparatus obtains information on a positional relationship between a user-wearable display apparatus that includes an imaging unit, and a user-operable imaging apparatus; determines display content to be displayed on the display apparatus based on the obtained positional relationship information; and output the determined display content, wherein the display content includes an image indicating a field of view of a user while not wearing the display apparatus or an image captured by an operation target of the user, and includes an image captured by the imaging unit, or is generated based on an image captured by the imaging apparatus.

## Claims

### Claim 1

An information processing apparatus comprising:
one or more memory devices that store a set of instructions; and
one or more processors that execute the set of instructions to:
obtain information on a positional relationship between a user-wearable display apparatus that includes an imaging unit, and a user-operable imaging apparatus;
determine display content to be displayed on the display apparatus based on the obtained positional relationship information; and
output the determined display content,
wherein the display content
includes an image indicating a field of view of a user while not wearing the display apparatus or an image captured by an operation target of the user, and
includes an image captured by the imaging unit, or is generated based on an image captured by the imaging apparatus, and
wherein the positional relationship information includes at least one among:
first information indicating that the imaging unit is light-shielded by the imaging apparatus,
second information indicating that the display apparatus has approached a viewfinder of the imaging apparatus, and
third information obtained by direct communication between the display apparatus and the imaging apparatus.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the one or more processors execute instructions in the one or more memory devices to:
in a case where the first information or the second information is obtained, or in a case where the third information is obtained and a distance between the display apparatus and the imaging apparatus obtained based on the obtained third information is within a predetermined distance,
determine an image captured by the imaging apparatus to be the display content.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein
the one or more processors execute instructions in the one or more memory devices to:
in a case where fourth information indicating that the imaging apparatus is included in a first image captured by the imaging unit is obtained as the positional relationship information,
determine the first image, and a second image captured by the imaging apparatus to be superimposed on a display unit on a back of the imaging apparatus included in the first image to be the display content.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the display unit or an operation unit included in the imaging apparatus included in the first image is configured to be operable by the user.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein
the one or more processors execute instructions in the one or more memory devices to:
in a case where the positional relationship information, which does not include any of the first information, the second information, the third information, and the fourth information, is obtained,
determine an image captured by the imaging unit to be the display content.

### Claim 6 (depends on 1)

An information processing system comprising:
the information processing apparatus according to claim 1; and
the imaging apparatus comprising:
one or more memory devices that store a set of instructions; and
one or more processors that execute the set of instructions to:
accept an operation of the user, and set an operation target in a virtual world; and
in a case where the first information or the second information is obtained, in a case where the third information is obtained and a distance between the display apparatus and the imaging apparatus obtained based on the obtained third information is within a predetermined distance, or in a case where fourth information indicating that the imaging apparatus is included in an image captured by the imaging unit is obtained as the positional relationship information in the information processing apparatus,
set the operation target of the imaging apparatus to the imaging apparatus,
wherein the one or more processors execute instructions in the one or more memory devices in the information processing apparatus to:
determine an image in which an operation accepted by the imaging apparatus has been reflected in captured data captured by the imaging apparatus to be the display content,
wherein the one or more processors execute instructions in the one or more memory devices in the imaging apparatus to:
in a case where the positional relationship information, which does not include any of the first information, the second information, the third information, and the fourth information, is obtained in the information processing apparatus,
set the operation target of the imaging apparatus to the display apparatus, and
wherein the one or more processors execute instructions in the one or more memory devices in the information processing apparatus to:
determine an image in which an operation accepted by the imaging apparatus has been reflected in captured data captured by the imaging unit of the display apparatus to be the display content.

### Claim 7

A method for controlling an information processing apparatus, the method comprising:
obtaining information on a positional relationship between a user-wearable display apparatus that includes an imaging unit, and a user-operable imaging apparatus;
determining display content to be displayed on the display apparatus based on the obtained positional relationship information; and
outputting the determined display content,
wherein the display content
includes an image indicating a field of view of a user while not wearing the display apparatus or an image captured by an operation target of the user, and
includes an image captured by the imaging unit, or is generated based on an image captured by the imaging apparatus, and
wherein the positional relationship information includes at least one among:
first information indicating that the imaging unit is light-shielded by the imaging apparatus,
second information indicating that the display apparatus has approached a viewfinder of the imaging apparatus, and
third information obtained by direct communication between the display apparatus and the imaging apparatus.

### Claim 8

A non-transitory computer-readable storage medium storing a program for causing a computer to execute each step in a method for controlling an information processing apparatus, the method comprising:
obtaining information on a positional relationship between a user-wearable display apparatus that includes an imaging unit, and a user-operable imaging apparatus;
determining display content to be displayed on the display apparatus based on the obtained positional relationship information; and
outputting the determined display content,
wherein the display content
includes an image indicating a field of view of a user while not wearing the display apparatus or an image captured by an operation target of the user, and
includes an image captured by the imaging unit, or is generated based on an image captured by the imaging apparatus, and
wherein the positional relationship information includes at least one among:
first information indicating that the imaging unit is light-shielded by the imaging apparatus,
second information indicating that the display apparatus has approached a viewfinder of the imaging apparatus, and
third information obtained by direct communication between the display apparatus and the imaging apparatus.
