# US 2024/0176411 A1 · Electronic device and method for controlling electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0176411 A1
- Document ID: US20240176411A1
- Status: Published application
- Kind: A1
- Application number: 18/491,970
- Filed: 2023-10-23
- Published: 2024-05-30
- Earliest claimed: 2022-11-24
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: SEIJI OGAWA
- Web page: https://patentgrep.com/patent/US20240176411A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0485: Scrolling or panning
- G09G 3/002: {to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT}
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- H04N 23/60: Control of cameras or camera modules
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G09G 2354/00: Aspects of interface with display user
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device includes a processor; and a memory storing a program which, when executed by the processor, causes the electronic device to: obtain a plurality of VR images that are sequentially captured; and generate, from each of the plurality of VR images, a VR image in which a reference direction of the VR image is corrected to a direction in which a specific subject is present in the VR image.

## Claims

### Claim 1

An electronic device comprising:
a processor; and
a memory storing a program which, when executed by the processor, causes the electronic device to:
obtain a plurality of VR images that are sequentially captured; and
generate, from each of the plurality of VR images, a VR image in which a reference direction of the VR image is corrected to a direction in which a specific subject is present in the VR image.

### Claim 2 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to generate, for each of the plurality of VR images, correction data for correcting the reference direction of the VR image based on a difference between the reference direction of the VR image and the direction in which the specific subject is present in the VR image, and to correct the reference direction of each of the plurality of VR images using the correction data.

### Claim 3 (depends on 2)

The electronic device according to claim 2, wherein the program when executed by the processor further causes the electronic device to transmit the plurality of VR images and the correction data to an external device, or transmit a plurality of VR images, in which the reference direction of each of the plurality of VR images is corrected, to the external device.

### Claim 4 (depends on 2)

The electronic device according to claim 2, wherein the program when executed by the processor further causes the electronic device to control such that the plurality of VR images and the correction data are associated and stored on a recording medium.

### Claim 5 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to obtain a VR moving image including a plurality of frames corresponding to the plurality of VR images respectively.

### Claim 6 (depends on 1)

The electronic device according to claim 1, wherein the specific subject is specified by a user.

### Claim 7 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to correct the reference direction of each of the plurality of VR images and to generate, as data different from the plurality of VR images, a plurality of corrected VR images.

### Claim 8 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to correct the reference direction of each of the plurality of VR images and to store, as a replacement, the plurality of VR images.

### Claim 9 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to instruct, based on an operation by a user, whether to correct the reference direction of the VR image based on the direction, in which the specific subject is present, or to correct the reference direction of the VR image according to a direction specified by the user.

### Claim 10 (depends on 9)

The electronic device according to claim 9, wherein the program when executed by the processor further causes the electronic device to instruct, based on the operation by the user, whether to correct the reference direction of the VR image based on the direction, in which the specific subject is present, or to correct the reference direction of the VR image based on the direction specified by the user for each transmission destination of the VR images.

### Claim 11 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to correct, for the VR image in which the specific subject is absent, the reference direction of the VR image based on a position of the specific subject detected in another VR image.

### Claim 12 (depends on 1)

The electronic device according to claim 1, wherein the program when executed by the processor further causes the electronic device to:
switch between displaying a plurality of shared images in a list and displaying one of the plurality of shared images individually; and
control a change in a display area of each of the plurality of shared images, wherein
in a state in which the shared images are a plurality of corrected VR images generated and the shared images are displayed individually, during playback of the shared image is in progress, the change is controlled so as not to change the display area based on a predetermined operation for changing a display direction even in cases where the predetermined operation is received from a user; and
in a state in which the plurality of shared images are displayed in the list and an operation of scrolling through the list of the plurality of shared images by the user is in progress, the change is controlled so as not to change the display area based on the predetermined operation even in cases where the predetermined operation is received.

### Claim 13 (depends on 12)

The electronic device according to claim 12, wherein the predetermined operation is an operation of changing a posture of the electronic device.

### Claim 14 (depends on 12)

The electronic device according to claim 12, wherein the program when executed by the processor further causes the electronic device to control to change the display area based on the predetermined operation in a case where the shared images are the plurality of corrected VR images that are generated and the shared image is individually displayed in VR.

### Claim 15 (depends on 1)

The electronic device according to claim 1, wherein the plurality of VR images are a plurality of images that are continuously captured.

### Claim 16 (depends on 1)

The electronic device according to claim 1, wherein the plurality of VR images are a plurality of images captured at predetermined time intervals.

### Claim 17 (depends on 1)

The electronic device according to claim 1, wherein the VR image is an image of which area is wider than a display area that can be displayed on a display unit at a time.

### Claim 18

A method for controlling an electronic device, the method comprising:
obtaining a plurality of VR images that are sequentially captured; and
generating, from each of the plurality of VR images, a VR image in which a reference direction of the VR image is corrected to a direction in which a specific subject is present in the VR image.

### Claim 19

A non-transitory computer-readable storage medium storing a program for causing a computer to execute the method for controlling the electronic device, the method comprising:
obtaining a plurality of VR images that are sequentially captured; and
generating, from each of the plurality of VR images, a VR image in which a reference direction of the VR image is corrected to a direction in which a specific subject is present in the VR image.
