# US 2019/0246093 A1 · Information processing apparatus, information processing method, program, and information processing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246093 A1
- Document ID: US20190246093A1
- Status: Published application
- Kind: A1
- Application number: 16/313,611
- Filed: 2017-05-23
- Published: 2019-08-08
- Earliest claimed: 2016-07-08
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: HISAKAZU SHIRAKI; TAKESHI MIYAI; KENTARO FUKAZAWA; TADASHI MORISHIGE
- Web page: https://patentgrep.com/patent/US20190246093A1

## CPC

- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/296: Synchronisation thereof; Control thereof
- A61B 1/00193: {adapted for stereoscopic vision}
- G02B 7/28: Systems for automatic generation of focusing signals
- G02B 7/36: using image sharpness techniques {, e.g. image processing techniques for generating autofocus signals (image data processing per se G06T; in cameras having a solid state image sensor H04N23/67)}
- G02B 21/22: Stereoscopic arrangements
- G02B 21/244: {using image analysis techniques}
- G02B 23/2415: {Stereoscopic endoscopes}
- G03B 35/08: by simultaneous recording
- H04N 13/00: Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N 13/128: Adjusting depth or disparity
- H04N 13/218: using spatial multiplexing
- H04N 13/225: using parallax barriers
- H04N 23/67: Focus control based on electronic image sensor signals
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

[Object] To provide an information processing apparatus, an information processing method, a program, and an information processing system. [Solution] An information processing apparatus including: a control unit configured to control display on the basis of a detection value indicating a focus state of a lens acquired from a stereoscopic imaging unit, and a captured image signal for a left eye and a captured image signal for a right eye acquired from the imaging unit.

## Claims

### Claim 1

An information processing apparatus comprising:
a control unit configured to control display on a basis of a detection value indicating a focus state of a lens acquired from a stereoscopic imaging unit, and a captured image signal for a left eye and a captured image signal for a right eye acquired from the imaging unit.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit controls the display on a basis of an amount of parallax reduction, which indicates a degree at which parallax associated with the display is to be reduced.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the control unit controls the amount of parallax reduction on a basis of the detection value.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein
the detection value increases as a degree of focus of the lens increases, and
the control unit performs control such that the amount of parallax reduction decreases as the detection value increases.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit controls the amount of parallax reduction on a basis of a movement start time of the lens in autofocus control performed on a basis of the detection value.

### Claim 6 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit controls the amount of parallax reduction on a basis of a movement speed of the lens in autofocus control performed on a basis of the detection value.

### Claim 7 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit controls the display by performing parallax adjustment processing on a captured image for the left eye and a captured image for the right eye so as to reduce parallax associated with the display on a basis of matching between the captured image for the left eye obtained from the captured image signal for the left eye and the captured image for the right eye obtained from the captured image signal for the right eye.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein the control unit generates a parallax image signal indicating parallax at each position in the captured image for the left eye and the captured image for the right eye by means of the matching, generates a parallax adjustment image signal for reducing parallax at each position on a basis of the parallax image signal and the amount of parallax reduction, and performs the parallax adjustment processing on a basis of the parallax adjustment image signal.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein the control unit specifies an amount of shift in entire image between the captured image for the left eye and the captured image for the right eye by means of the matching, specifies an amount of parallax adjustment on a basis of the amount of shift and the amount of parallax reduction, and performs the parallax adjustment processing on a basis of the amount of parallax adjustment.

### Claim 10 (depends on 7)

The information processing apparatus according to claim 7, wherein the control unit selects which one of display control based on the parallax adjustment processing and other display control is performed in accordance with parallax detection information obtained from a sum of absolute differences in the matching.

### Claim 11 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit controls the display such that a display image for the left eye and a display image for the right eye in the display are same images in a case where the amount of parallax reduction is larger than a predetermined threshold.

### Claim 12 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit causes display of an image formed by combining a captured image for the left eye obtained from the captured image signal for the left eye and a captured image for the right eye obtained from the captured image signal for the right eye, in accordance with the amount of parallax reduction.

### Claim 13 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit causes display of an image formed by reducing a pixel level of any one of a captured image for the left eye obtained from the captured image signal for the left eye and a captured image for the right eye obtained from the captured image signal for the right eye, in accordance with the amount of parallax reduction.

### Claim 14 (depends on 3)

The information processing apparatus according to claim 3, wherein the control unit performs blur processing in accordance with the amount of parallax reduction.

### Claim 15 (depends on 3)

The information processing apparatus according to claim 3, further comprising
storage units configured to store the captured image signal for the left eye and the captured image signal for the right eye,
wherein the control unit causes display of an image obtained from the captured image signal for the left eye and the captured image signal for the right eye that are stored in the storage units, on a basis of the amount of parallax reduction.

### Claim 16 (depends on 15)

The information processing apparatus according to claim 15, wherein the control unit causes display of an image obtained from the captured image signal for the left eye and the captured image signal for the right eye based on imaging just before start of movement of the lens in autofocus control performed on a basis of the detection value, the captured image signal for the left eye and the captured image signal for the right eye being stored in the storage units.

### Claim 17 (depends on 1)

The information processing apparatus according to claim 1, wherein the control unit controls the display in accordance with a user's input.

### Claim 18

An information processing method comprising:
controlling display on a basis of a detection value indicating a focus state of a lens acquired from a stereoscopic imaging unit, and a captured image signal for a left eye and a captured image signal for a right eye acquired from the imaging unit.

### Claim 19

A program for causing a computer to realize:
a function of controlling display on a basis of a detection value indicating a focus state of a lens acquired from a stereoscopic imaging unit, and a captured image signal for a left eye and a captured image signal for a right eye acquired from the imaging unit.

### Claim 20

An information processing system comprising:
a stereoscopic imaging device;
a stereoscopic display device; and
a control unit configured to control display of the display device on a basis of a detection value indicating a focus state of a lens acquired from the imaging device, and a captured image signal for a left eye and a captured image signal for a right eye acquired from the imaging device.
