# US 2024/0406544 A1 · Information processing device and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0406544 A1
- Document ID: US20240406544A1
- Status: Published application
- Kind: A1
- Application number: 18/698,358
- Filed: 2022-09-13
- Published: 2024-12-05
- Earliest claimed: 2021-10-15
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Toshio OHKI; Hidenari SHINOTOU; Itsuki YAMASHITA
- Web page: https://patentgrep.com/patent/US20240406544A1

## CPC

- H04N 23/635: {Region indicators; Field of view indicators}
- G06T 7/74: {involving reference images or patches}
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/63: by using electronic viewfinders
- G06T 2207/30196: Human being; Person
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An information processing device includes a composition position determiner that determines a composition position of an auxiliary image in a second captured image captured after a first captured image in accordance with a position and a motion of a subject in the first captured image, and a composition processing unit that composites the auxiliary image with the composition position in the second captured image.

## Claims

### Claim 1

An information processing device comprising:
a composition position determiner that determines a composition position of an auxiliary image in a second captured image captured after a first captured image in accordance with a position and a motion of a subject in the first captured image; and
a composition processing unit that composites the auxiliary image with the composition position in the second captured image.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the composition position determiner determines the position of the subject on the second captured image as the composition position on a basis of the position of the subject in the first captured image and a difference between imaging timings of the first captured image and the second captured image.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the motion of the subject is identified by using a captured image captured before the first captured image.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein
the auxiliary image is a frame image indicating a specific position of the subject.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein
the frame image is an image indicating a focus position.

### Claim 6 (depends on 1)

The information processing device according to claim 1, wherein
the auxiliary image is an image indicating a position of a specific subject recognized as a result of image recognition processing on the first captured image.

### Claim 7 (depends on 1)

The information processing device according to claim 1, wherein
the information processing device serves as a smartphone including an imaging unit that captures the first captured image and the second captured image.

### Claim 8 (depends on 1)

The information processing device according to claim 1, wherein
the first captured image and the second captured image are preview images displayed on a display unit.

### Claim 9

A program for
causing a calculation processing device to execute:
a composition position determination function of determining a composition position of an auxiliary image in a second captured image captured after a first captured image in accordance with a position and a motion of a subject in the first captured image; and
a composition function of compositing the auxiliary image with the composition position in the second captured image.

### Claim 10

An information processing device comprising:
a first processor that performs image processing on a captured image output from a pixel array unit in which pixels each having a photoelectric conversion element are two-dimensionally arranged and processing of determining a composition position of an auxiliary image to be composited with the captured image on a basis of the captured image; and
a second processor that performs processing of displaying, on a display unit, a composite image obtained by compositing the auxiliary image with the composition position in an image subjected to the image processing.

### Claim 11 (depends on 10)

The information processing device according to claim 10, wherein
the first processor performs the image processing and the processing of determining the composition position in parallel.

### Claim 12 (depends on 10)

The information processing device according to claim 10, wherein
the first processor executes processing of compositing the auxiliary image with the image subjected to the image processing.

### Claim 13 (depends on 10)

The information processing device according to claim 10, wherein
the auxiliary image is a frame image indicating a specific position of a subject.

### Claim 14 (depends on 13)

The information processing device according to claim 13, wherein
the frame image is an image indicating a focus position.

### Claim 15 (depends on 10)

The information processing device according to claim 10, wherein
the auxiliary image is an image indicating a position of a specific subject recognized as a result of image recognition processing on the captured image.

### Claim 16 (depends on 10)

The information processing device according to claim 10, wherein
the information processing device serves as a smartphone including the pixel array unit.

### Claim 17

A program for
causing a first processor to execute image processing on a captured image output from a pixel array unit and processing of determining a composition position in an auxiliary image to be composited with the captured image on a basis of the captured image, and
causing a second processor to execute processing of displaying, on a display unit, a composite image obtained by compositing the auxiliary image with the composition position of an image subjected to the image processing.
