# US 2025/0378657 A1 · Image processing apparatus, image processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0378657 A1
- Document ID: US20250378657A1
- Status: Published application
- Kind: A1
- Application number: 19/227,710
- Filed: 2025-06-04
- Published: 2025-12-11
- Earliest claimed: 2024-06-11
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: HIROKI WATABE
- Web page: https://patentgrep.com/patent/US20250378657A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- H04N 5/77: between a recording apparatus and a television camera
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G06F 3/147: using display panels
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus controls a display device wearable on a head of a user and includes: an obtainment unit configured to obtain a reality image which is an image captured of an actual space around the user and a saving unit configured to save the reality image obtained by the obtainment unit, in a state when the display device is being worn by the user.

## Claims

### Claim 1

An image processing apparatus that controls a display device wearable on a head of a user, the image processing apparatus comprising:
an obtainment unit configured to obtain a reality image which is an image captured of an actual space around the user and
a saving unit configured to save the reality image obtained by the obtainment unit, in a state where the display device is being worn by the user.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the reality image obtained by the obtainment unit is captured by an image capture unit that the display device has.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, further comprising an informing unit configured to inform a surrounding of the user that the saving unit is saving the reality image.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, further comprising a switching unit configured to switch whether the saving unit saves the reality image.

### Claim 5 (depends on 4)

The image processing apparatus according to claim 4, wherein the switching unit switches whether the saving unit saves the reality image based on content displayed on the display device.

### Claim 6 (depends on 4)

The image processing apparatus according to claim 4, wherein the switching unit makes a switch not to save the reality image in a case where content displayed on the display device includes the reality image obtained by the obtainment unit.

### Claim 7 (depends on 4)

The image processing apparatus according to claim 4, further comprising setting unit configured to set a mode in which the image processing apparatus operates, the mode being either a first mode where an image where the reality image obtained by the obtainment unit and a virtual image are superimposed over each other is displayed on the display device or a second mode where an image not including the reality image is displayed,
wherein, in a case when the setting unit sets the second mode, the switching unit makes a switch to save the reality image.

### Claim 8 (depends on 4)

The image processing apparatus according to claim 4, wherein the obtainment unit further obtains position and posture information on the display device in a state where the display device is being worn by the user, and
the switching unit switches whether to save the reality image obtained by the obtainment unit based further on the position and posture information obtained by the obtainment unit.

### Claim 9 (depends on 8)

The image processing apparatus according to claim 8, wherein, in a case when a position and posture of the display device indicated by the position and posture information obtained by the obtainment unit is within a predetermined range from a predetermined reference position and posture, the switching unit makes a switch to save the reality image.

### Claim 10 (depends on 9)

The image processing apparatus according to claim 9, wherein the reference position and posture is a position and posture of the user at a time of the user starting to use the display device.

### Claim 11 (depends on 4)

The image processing apparatus according to claim 4, further comprising a detection unit configured to detect moving object in the reality image obtained by the obtainment unit,
wherein, in a case when the detection unit detects the moving object, the switching unit makes a switch to save the reality image.

### Claim 12 (depends on 1)

The image processing apparatus according to claim 1, further comprising a generation unit configured to generate an image to be saved, based on the reality image obtained by the obtainment unit,
wherein the saving unit saves, as the reality image, the image to be saved generated by the generation unit.

### Claim 13 (depends on 12)

The image processing apparatus according to claim 12, wherein the image to be saved is an image with less data volume than the reality image obtained by the obtainment unit.

### Claim 14 (depends on 12)

The image processing apparatus according to claim 12, wherein the image to be saved is an image with data reduced in a direction of a time axis compared to the reality image obtained by the obtainment unit.

### Claim 15 (depends on 12)

The image processing apparatus according to claim 12, wherein the obtainment unit obtains a plurality of the reality images captured by a plurality of image capture units each having a predetermined angle of view as an image capture range, and
the generation unit generates, as the image to be saved, an image having a wider angle of view than the predetermined angle of view based on the plurality of reality images obtained by the obtainment unit.

### Claim 16 (depends on 12)

The image processing apparatus according to claim 12, further comprising a detection unit configured to detect moving object in the reality image obtained by the obtainment unit,
wherein the generation unit generates, as the image to be saved, an image clipped to include a region where the moving object is detected in the reality image.

### Claim 17 (depends on 1)

The image processing apparatus according to claim 1, wherein the image processing apparatus is configured integrally with the display device.

### Claim 18 (depends on 1)

The image processing apparatus according to claim 1, wherein the image processing apparatus is configured separately from the display device and is communicatively connected to the display device via a transmission channel.

### Claim 19

An image processing method executed by a computer that controls a display device wearable on a head of a user, the method comprising:
obtaining a reality image which is an image captured of an actual space around the user; and
saving the reality image obtained in the obtaining in a state where the display device is being worn by the user.

### Claim 20

A non-transitory computer readable storage medium storing a program which causes a computer to execute an image processing method, wherein the image processing method is executed by the computer that controls a display device wearable on a head of a user and comprises:
obtaining a reality image which is an image captured of an actual space around the user; and
saving the reality image obtained in the obtaining, in a state where the display device is being worn by the user.
