# US 9,277,203 B2 · Stereoscopic camera, system and network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,277,203 B2
- Document ID: US9277203B2
- Status: Granted
- Kind: B2
- Application number: 14/740,110
- Filed: 2015-06-15
- Published: 2015-10-01
- Granted: 2016-03-01
- Earliest claimed: 2004-10-21
- Assignees: TRY Tech LLC
- Applicants: Thomas Paul Riederer
- Inventors: Thomas Paul Riederer
- Web page: https://patentgrep.com/patent/US9277203B2

## CPC

- H04N 13/194: Transmission of image signals
- H04N 13/133: Equalising the characteristics of different image components, e.g. their average brightness or colour balance
- H04N 13/189: Recording image signals; Reproducing recorded image signals
- H04N 13/218: using spatial multiplexing
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/246: Calibration of cameras
- H04N 13/296: Synchronisation thereof; Control thereof
- H04N 2213/001: Constructional or mechanical details
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention provides a new and improved stereoscopic camera, system and network of such for acquiring stereoscopic image data and, in particular, stereoscopic images of a location or points and objects within a location. Some of the benefits of these include simultaneous left/right view acquisition, a system where the display is remote from the stereoscopic camera, stereoscopic digital zoom wherein a subset of pixels is displayed, pan-tilt-zoom choice of the displayed image, interactive adjustment of images, and a network of stereoscopic cameras with a common image processing unit. The invention is capable of producing high resolution, real-time stereoscopic image data while avoiding or mitigating the deleterious effects of spurious parallax.

## Claims

### Claim 1

A stereoscopic camera comprising:
at least one image sensor comprising pixel cells configured to generate pixel data;
at least one optical instrument comprising at least one channel comprising an optical path and at least one optical component wherein said at least one optical component is configured to illuminate at least a portion of the pixel cells of the at least one image sensor, wherein the at least one optical instrument is capable of providing a plurality of optical views corresponding to a left view and a right view of a stereoscopic image of a location;
an acquisition controller configured to:
generate at least one data stream corresponding to at least one pixel data for each view of the plurality of optical views from the instrument wherein at least one first data stream corresponding to the left view is simultaneously generated with at least one second data stream corresponding to the respective right view;
combine the at least one first and second data streams into a third, single data stream wherein timing among the first and second data streams is known and maintained, wherein the single data stream is effective to represent the stereoscopic image of the location in real time; and
transmit the single data stream.

### Claim 2 (depends on 1)

A system comprising the stereoscopic camera of claim 1, further comprising an image processing unit communicatively coupled to the stereoscopic camera and configured to:
receive the single data stream of pixel data representative of the plurality of optical views of a first stereoscopic image of the location;
choose a first subset of the pixel data representative of at least a portion of the at least one left view and a corresponding second subset of the pixel data representative of at least a portion of the at least one right view; and
output said subsets to at least one stereoscopic display configured to display the first subset and the second subset of the pixel data as a second stereoscopic image of the location.

### Claim 3 (depends on 2)

The system of claim 2 wherein the second stereoscopic image is representative of a magnification of at least a portion of the first stereoscopic image.

### Claim 4 (depends on 2)

The system of claim 2 wherein the image processing unit is further configured to allow a user to choose at least one of the first and second subsets of pixel data representative of the at least one left view and corresponding at least one right view.

### Claim 5 (depends on 4)

The system of claim 4 wherein the image processing unit is further configured to automatically choose a corresponding respective subset of pixel data following the user's choice of the at least one of the first and second subsets of pixel data representative of the at least one left view and corresponding at least one right view.

### Claim 6 (depends on 4)

The system of claim 4 further configured to allow the user to choose the at least one of the first and second subsets of pixel data while viewing the display.

### Claim 7 (depends on 6)

The system of claim 6 further comprising:
a coordinate system fixed with respect to the location;
a z-direction which is orthogonal to the plane of the displayed second stereoscopic image of the location respective to said second stereoscopic image; and
a component for determining the z-direction with respect to the coordinate system.

### Claim 8 (depends on 7)

The system of claim 7 wherein the component for determining the z-direction with respect to the coordinate system is an electronic compass.

### Claim 9 (depends on 2)

The system of claim 2 wherein the image processing unit is located remotely from the stereoscopic camera.

### Claim 10 (depends on 9)

The system of claim 9 wherein communication between the stereoscopic camera and the image processing unit is over a network.

### Claim 11 (depends on 9)

The system of claim 9 wherein communication between the stereoscopic camera and image processing unit is wireless.

### Claim 12 (depends on 2)

The system of claim 2 wherein one or more of the at least one display is configured to be head-mounted to a viewer.

### Claim 13 (depends on 12)

The system of claim 12 configured such that the viewer can simultaneously see the displayed image and at least a portion of the location.

### Claim 14 (depends on 12)

The system of claim 12 wherein the display is wireless.

### Claim 15 (depends on 2)

The system of claim 2 further comprising a storage device communicatively coupled to the image processing unit.

### Claim 16 (depends on 2)

The system of claim 2 wherein the image processing unit is further configured to automatically choose at least one subset of the corresponding subsets of pixel data in such a way as to minimize spurious parallax in the second stereoscopic image.

### Claim 17 (depends on 1)

A network of a plurality of stereoscopic cameras of claim 1 further comprising at least one image processing unit wherein at least two of the plurality of stereoscopic cameras share a common image processing unit.

### Claim 18 (depends on 17)

The network of claim 17 wherein at least two of the optical instruments of the plurality of stereoscopic cameras provide a plurality of optical views of at least one common point in the location.

### Claim 19 (depends on 1)

The stereoscopic camera of claim 1, wherein the single data stream is compressed prior to transmission.

### Claim 20

A stereoscopic camera comprising:
an optical instrument having at least one optical path, wherein the instrument is capable of providing a plurality of optical views corresponding to a left view and a right view of a stereoscopic image of a location;
a plurality of optical sensors in the at least one optical path, wherein each sensor comprises a plurality of pixel cells, wherein the plurality of optical sensors is configured to generate pixel data from the pixel cells, said data corresponding to at least one pixel data for each view of the plurality of optical views provided by the instrument; and
an acquisition controller configured to:
cause the plurality of optical sensors to generate at least one first data stream of pixel data corresponding to the left view and at least one second data stream of pixel data corresponding to the right view wherein the pixel data corresponding to a pixel of the left view is simultaneously generated with the pixel data corresponding to a pixel of the respective right view;
combine the at least one first and second data streams into a third, single data stream wherein timing among data corresponding to respective pixels is known and maintained, and the single data stream is effective to represent the stereoscopic image of the location; and
transfer the single data stream in real time to another device.

### Claim 21 (depends on 20)

The stereoscopic camera of claim 20 wherein the camera comprises at least two respective optical paths having at least two respective optical axes, the camera further comprising an adjustment mechanism for aligning the vergence of the respective optical axes of each of the at least two optical paths to converge at a point in the location.

### Claim 22 (depends on 20)

The stereoscopic camera of claim 20 further comprising a pan-tilt-zoom mechanism.

### Claim 23 (depends on 20)

The stereoscopic camera of claim 20 further comprising a GPS receiver.

### Claim 24 (depends on 20)

The stereoscopic camera of claim 20 further comprising at least one deflecting element.

### Claim 25 (depends on 20)

A network comprising a plurality of stereoscopic cameras according to claim 20 wherein the plurality of stereoscopic cameras is communicatively coupled to at least one image processing unit.

### Claim 26 (depends on 25)

The network according to claim 25 configured such that at least one point in the location can be viewed by at least two stereoscopic cameras of the plurality of stereoscopic cameras.

### Claim 27 (depends on 25)

The network according to claim 25 further comprising at least one electronic compass.
