# US 9,883,164 B2 · Optimizing usage of image sensors in a stereoscopic environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,883,164 B2
- Document ID: US9883164B2
- Status: Granted
- Kind: B2
- Application number: 13/274,682
- Filed: 2011-10-17
- Published: 2013-02-07
- Granted: 2018-01-30
- Earliest claimed: 2011-08-03
- Assignees: Sony Mobile Communications Inc.
- Applicants: Mats Wernersson
- Inventors: Mats Wernersson
- Web page: https://patentgrep.com/patent/US9883164B2

## CPC

- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/128: Adjusting depth or disparity
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The invention is directed to systems, methods and computer program products for optimizing usage of image sensors in a stereoscopic environment. The method includes: (a) providing a first image sensor, where the first image sensor is associated with a first image sensor area and a first imaging area; (b) determining a distance from the camera to an object to be captured; and (c) shifting the first imaging area along a length of the first image sensor area, where the amount of the shifting is based at least partially on the distance from the camera to the object, and where the first imaging area can shift along an entire length of the first image sensor area. The invention optimizes usage of an image sensor by permitting an increase in disparity control. Additionally, the invention reduces the closest permissible distance of an object to be captured using a stereoscopic camera.

## Claims

### Claim 1

A method for optimizing usage of an image sensor of a camera, the method comprising:
providing a first image sensor that comprises a first plurality of pixels, wherein the first image sensor further comprises a first image sensor area on which light is incident and is associated with a first imaging area in which an image of an object to be captured by the camera is displayed, wherein the first imaging area is partially overlapping with the first image sensor area such that a length of the first image sensor area is greater than a length of the first imaging area;
determining a distance from the camera to an object to be captured by the camera;
determining the distance from the camera to the object is less than a predetermined threshold; and
in response to determining the distance from the camera to the object is less than the predetermined threshold, shifting the first imaging area lengthwise from a first border of the first image sensor area up to a second border of the first image sensor area, wherein the amount of the shifting is based at least partially on the distance from the camera to the object, wherein the first imaging area can shift along the entire length of the first image sensor area.

### Claim 2 (depends on 1)

The method of claim 1, wherein the length of the first image sensor area is greater than a length of the first imaging area.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
providing a first microscopic lens array situated on top of the first plurality of pixels;
shifting an optical center of the first image sensor such that a width of the first imaging area coincides with a width of the first image sensor area; and
shifting the first microscopic lens array to compensate for the shifting of the optical center.

### Claim 4 (depends on 1)

The method of claim 1, wherein the position of the optical center does not change when the first imaging area is moved along the length of the first image sensor area.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
providing, in the camera, a second image sensor that comprises a second plurality of pixels, wherein the second image sensor is associated with a second image sensor area and a second imaging area; and
rotating the second image sensor such that the second image sensor is oriented at 180 degrees with respect to the first image sensor.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
shifting the second imaging area along a length of the second image sensor area based at least partially on the distance from the camera to the object, wherein the second imaging area can shift along the entire length of the second image sensor area in a direction opposite to the shifting of the first imaging area along the length of the first image sensor area.

### Claim 7

An apparatus for optimizing usage of an image sensor of a camera, the apparatus comprising:
a first image sensor that comprises a first plurality of pixels, wherein the first image sensor further comprises a first image sensor area on which light is incident and is associated with a first imaging area in which an image of an object to be captured by the camera is displayed, wherein the first imaging area is partially overlapping with the first image sensor area;
a memory;
a processor; and
a module stored in the memory, executable by the processor, and configured to:
determine a distance from the camera to an object to be captured by the camera;
determine the distance from the camera to the object is less than a predetermined threshold; and
in response to determining the distance from the camera to the object is less than the predetermined threshold, shift the first imaging area lengthwise from a first border of the first image sensor area up to a second border of the first image sensor area, wherein the amount of the shifting is based at least partially on the distance from the camera to the object, wherein the first imaging area can shift along the entire length of the first image sensor area.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the length of the first image sensor area is greater than a length of the first imaging area.

### Claim 9 (depends on 7)

The apparatus of claim 7, further comprising:
a first microscopic lens array situated on top of the first plurality of pixels; and the module further configured to:
shift an optical center of the first image sensor such that a width of the first imaging area coincides with a width of the first image sensor area; and
shift the first microscopic lens array to compensate for the shifting of the optical center.

### Claim 10 (depends on 7)

The apparatus of claim 7, wherein the position of the optical center does not change when the first imaging area is moved along the length of the first image sensor area.

### Claim 11 (depends on 7)

The apparatus of claim 7, further comprising:
a second image sensor that comprises a second plurality of pixels, wherein the second image sensor is associated with a second image sensor area and a second imaging area, wherein the second image sensor is oriented at 180 degrees with respect to the first image sensor.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the module is further configured to:
shift the second imaging area along a length of the second image sensor area based at least partially on the distance from the camera to the object, wherein the second imaging area can shift along the entire length of the second image sensor area in a direction opposite to the shifting of the first imaging area along the length of the first image sensor area.

### Claim 13

A non-transitory computer program product for optimizing usage of an image sensor of a camera, the computer program product comprising:
a non-transitory computer-readable medium comprising a set of codes for causing a computer to:
configure a position of a first image sensor area of a first image sensor and on which light is incident, wherein the first image sensor comprises a plurality of pixels;
configure a position of a first imaging area associated with the first image sensor in which an image of an object to be captured by the camera is displayed, wherein the first imaging area is partially overlapping with the first image sensor area such that a length of the first image sensor area is greater than a length of the first imaging area;
determine a distance from the camera to an object to be captured by the camera;
determine the distance from the camera to the object is less than a predetermined threshold; and
in response to determining the distance from the camera to the object is less than the predetermined threshold, shift the first imaging area lengthwise from a first border of the first image sensor area up to a second border of the first image sensor area, wherein the amount of the shifting is based at least partially on the distance from the camera to the object, wherein the first imaging area can shift along the entire length of the first image sensor area.

### Claim 14 (depends on 13)

The non-transitory computer program product of claim 13, wherein the length of the first image sensor area is greater than a length of the first imaging area.

### Claim 15 (depends on 13)

The non-transitory computer program product of claim 13, wherein the set of codes further causes a computer to:
shift an optical center of the first image sensor such that a width of the first imaging area coincides with a width of the first image sensor area; and
shift the first microscopic lens array to compensate for the shifting of the optical center, wherein the first microscopic lens array situated on top of the first plurality of pixels.

### Claim 16 (depends on 13)

The non-transitory computer program product of claim 13, wherein the set of codes does not cause a position of the optical center to change when the first imaging area is moved along the length of the first image sensor area.

### Claim 17 (depends on 13)

The non-transitory computer program product of claim 13, wherein the set of codes further causes a computer to:
configure a position of a second image sensor area associated with a second image sensor, wherein the second image sensor comprises a plurality of pixels and is oriented at 180 degrees with respect to the first image sensor;
configure a position of a second imaging area associated with the second image sensor; and
shift the second imaging area along a length of the second image sensor area based at least partially on the distance from the camera to the object, wherein the second imaging area can shift along the entire length of the second image sensor area in a direction opposite to the shifting of the first imaging area along the length of the first image sensor area.
