# US 2025/0168486 A1 · Information processing device, information processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168486 A1
- Document ID: US20250168486A1
- Status: Published application
- Kind: A1
- Application number: 18/843,146
- Filed: 2023-03-03
- Published: 2025-05-22
- Earliest claimed: 2022-04-01
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Keiichiro TANIGUCHI; Takuro NODA
- Web page: https://patentgrep.com/patent/US20250168486A1

## CPC

- H04N 23/62: Control of parameters via user interfaces
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06T 7/73: using feature-based methods
- G06V 10/945: {User interactive design; Environments; Toolboxes}
- G06V 40/18: Eye characteristics, e.g. of the iris
- H04N 23/60: Control of cameras or camera modules
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/63: by using electronic viewfinders
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 2207/30201: Face
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An imaging control technology, which is appropriate in a case in which “imaging while doing” is performed, capable of providing a captured image appropriately perceiving an object at which a user is gazing even in the case in which so-called “imaging while doing” is performed is realized. An information processing device according to the present technology includes: a detection unit configured to detect a gazing point of a user on a real space on the basis of distance measurement information representing a distance measurement result for a predetermined range including an imaging range that is a target range of imaging on the real space as a target and estimation information of a visual line and eye positions of the user; and a control unit configured to perform control relating to the imaging using information of a gazing area set on the basis of the gazing point.

## Claims

### Claim 1

An information processing device comprising:
a detection unit configured to detect a gazing point of a user on a real space on the basis of distance measurement information representing a distance measurement result for a predetermined range including an imaging range that is a target range of imaging on the real space as a target and estimation information of a visual line and eye positions of the user; and
a control unit configured to perform control relating to the imaging using information of a gazing area set on the basis of the gazing point.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein the detection unit generates a three-dimensional map for the predetermined range on the basis of the distance measurement information and detects an intersection with the visual line of the user on the three-dimensional map as the gazing point.

### Claim 3 (depends on 1)

The information processing device according to claim 1, further comprising a gazing area setting unit setting an area including the gazing point as the gazing area.

### Claim 4 (depends on 3)

The information processing device according to claim 3, wherein the gazing area setting unit sets an area of which positions of left, right, upper, and lower area ends are positions of a predetermined distance from the gazing point as the gazing area.

### Claim 5 (depends on 3)

The information processing device according to claim 3, wherein the gazing area setting unit identifies an object including the gazing point among objects detected in an object detecting process for the real space as a target as a gazing object and sets an area including the gazing object as the gazing area.

### Claim 6 (depends on 5)

The information processing device according to claim 5, wherein the gazing area setting unit sets the gazing area such that the gazing object is located at a position inside of an area designated in advance through an operation.

### Claim 7 (depends on 1)

The information processing device according to claim 1, wherein the control unit estimates whether or not the gazing point has been moved to another object on the basis of gazing point detection results of a plurality of number of times acquired by the detection unit and, in a case in which it is estimated that the gazing point has been moved to another object, performs a switching process in which the gazing area based on the gazing point that is newly detected by the detection unit is applied as the gazing area used for control relating to the imaging.

### Claim 8 (depends on 7)

The information processing device according to claim 7, wherein the control unit estimates whether or not the gazing point has been moved to the other object on the basis of range information of objects detected in the object detecting process for the real space as a target.

### Claim 9 (depends on 7)

The information processing device according to claim 7, wherein, when estimation of the gazing point having been moved to the other object is set as a first condition, the control unit performs the switching process in a case in which the first condition and a second condition different from the first condition are satisfied.

### Claim 10 (depends on 9)

The information processing device according to claim 9, wherein the second condition is a condition that a state in which the gazing point is estimated to be present at the other object has lasted for a predetermined time or more.

### Claim 11 (depends on 9)

The information processing device according to claim 9, wherein the second condition is a condition that an imaging direction is directed in a direction in which the other object is present.

### Claim 12 (depends on 7)

The information processing device according to claim 7, wherein, when switching to the gazing area of the other object is performed, the control unit changes at least one of a position and a size of the gazing area in a stepped manner.

### Claim 13 (depends on 1)

The information processing device according to claim 1, wherein the control unit performs control relating to recording of a captured image acquired using the imaging as control relating to the imaging.

### Claim 14 (depends on 13)

The information processing device according to claim 13, wherein the control unit performs control of recording a captured image acquired using the imaging and information representing the gazing area as control relating to the imaging.

### Claim 15 (depends on 1)

The information processing device according to claim 1, wherein the control unit performs display control relating to a through image of a captured image acquired using the imaging as control relating to the imaging.

### Claim 16 (depends on 15)

The information processing device according to claim 15, wherein, in a case in which the gazing area is present inside of the captured image, the control unit performs control such that an extraction image acquired by extracting the gazing area from the captured image is displayed as the through image.

### Claim 17 (depends on 15)

The information processing device according to claim 15, wherein, in a case in which the gazing area comes close to an end of the captured image to be within a predetermined distance, the control unit performs control to display notification information to the user.

### Claim 18 (depends on 15)

The information processing device according to claim 15, wherein, in a case in which the gazing point is not present inside of the captured image, the control unit performs control to display a specific image.

### Claim 19

An information processing method for causing an information processing device to perform:
detecting a gazing point of a user on a real space on the basis of distance measurement information representing a distance measurement result for a predetermined range including an imaging range that is a target range of imaging on the real space as a target and estimation information of a visual line and eye positions of the user; and
performing control relating to the imaging using information of a gazing area set on the basis of the gazing point.

### Claim 20

A recording medium having a program that can be read by a computer device recorded therein,
the program configured to cause the computer device to execute a process of detecting a gazing point of a user on a real space on the basis of distance measurement information representing a distance measurement result for a predetermined range including an imaging range that is a target range of imaging on the real space as a target and estimation information of a visual line and eye positions of the user and performing control relating to the imaging using information of a gazing area set on the basis of the gazing point.
