# US 2015/0145950 A1 · Multi field-of-view multi sensor electro-optical fusion-zoom camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0145950 A1
- Document ID: US20150145950A1
- Status: Published application
- Kind: A1
- Application number: 14/404,715
- Filed: 2014-03-27
- Published: 2015-05-28
- Earliest claimed: 2013-03-27
- Assignees: BAE Systems Information and Electronic Systems Integration Inc.
- Applicants: BAE Systems Information and Electronic Systems Integration Inc.
- Inventors: Robert H. Murphy; Stephen F. Sagan; Michael Gertsenshteyn
- Web page: https://patentgrep.com/patent/US20150145950A1

## CPC

- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 23/11: for generating image signals from visible and infrared light wavelengths
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system and method for creating an image is presented. The system includes a first camera, a second camera, and a fusion processor. The first camera has a small field-of-view (FOV) and an optical line of sight (LOS). The second camera has a large FOV that is larger than the small FOV and the second camera has an optical LOS. The first camera and second camera are mounted so that the optical LOS of the first camera is parallel to the optical LOS of the second camera. The fusion processor fuses a second image captured by the second camera with a first image captured by the first camera. The fused image has better resolution in a fused portion of the fused image than in unfused portion of the fused image.

## Claims

### Claim 1

A system for creating an image comprising:
a first camera with a first field-of-view (FOV) and an optical line of sight (LOS);
a second camera with a second FOV that is larger than the first FOV, wherein the second camera has an optical LOS;
a mounting device to mount the first camera and second camera so that the optical LOS of the first camera is parallel to the optical LOS of the second camera; and
a fusion processor configured to fuse a second image captured by the second camera with a first image captured by the first camera to produce a final image.

### Claim 2 (depends on 1)

The system for creating an image of claim 1, wherein the final image with a first resolution in a first portion of the final image that is greater than a second resolution in a second portion of the final image.

### Claim 3 (depends on 1)

The system for creating an image of claim 1 wherein the optical LOS of the first camera is coaxial with the optical LOS of the second camera.

### Claim 4 (depends on 1)

The system for creating an image of claim 1 further comprising:
a third camera with a third FOV that is larger than the second FOV of the second camera, wherein the third camera has an optical LOS, so that the optical LOS of the first camera is parallel to the optical LOS of the third camera; and wherein the fusion processor is to fuse a third image captured by the third camera with the first image captured by the first camera and with the second image captured by the second camera to produce the final image.

### Claim 5 (depends on 1)

The system for creating an image of claim 1 wherein the first and second cameras are optical cameras.

### Claim 6 (depends on 1)

The system for creating an image of claim 1 wherein the fusion processor is configured to upsample the second image to enlarge images in the second image so that objects in regions of the second image from the second camera match in size the objects of the first image taken by the first camera.

### Claim 7 (depends on 1)

The system for creating an image of claim 1 further comprising:
a first housing with the first camera mounted in the first housing; and
a second housing that is spaced apart from the first housing with the second camera mounted in the second housing.

### Claim 8 (depends on 1)

The system for creating an image of claim 1 wherein the first camera has a FOV that is variable.

### Claim 9 (depends on 1)

The system for creating an image of claim 1 wherein a distance between the first camera and the second camera is less than 100 times a largest aperture entrance of both the first camera and the second camera.

### Claim 10 (depends on 1)

The system for creating an image of claim 1 further comprising:
a physical mounting platform with the first camera and second camera physically mounted to the mounting platform so that the first camera cannot move relative to the second camera.

### Claim 11 (depends on 1)

The system for creating an image of claim 1 wherein the system is free of moving parts.

### Claim 12 (depends on 1)

The system for creating an image of claim 1 wherein the first camera is an infra-red (IR) camera and the second camera is an optical camera.

### Claim 13 (depends on 1)

The system for creating an image of claim 1 wherein the first camera is adapted to capture images in a first frequency range and the second camera is adapted to capture images in a second frequency range that is different than the first frequency range.

### Claim 14 (depends on 13)

The system for creating an image of claim 13 wherein the first frequency range is a single frequency.

### Claim 15 (depends on 1)

The system for creating an image of claim 1 wherein the first image further comprises:
a plurality of pixels.

### Claim 16

A sensor system comprising:
a first sensor with a first field-of-view (FOV) and a first line of site (LOS);
a second sensor with a second FOV that is larger than the first FOV and a LOS that is parallel to the LOS of the first sensor; and
a fusion processor to merge a set of data collected by the first sensor with a set of data collected by the second sensor to create merged data that has an area with first resolution and an area of second resolution that has a lower resolution than the first resolution.

### Claim 17 (depends on 16)

The sensor system of claim 16 wherein the first LOS and the second LOS are coaxial.

### Claim 18 (depends on 16)

The sensor system of claim 16 wherein the first sensor is an optical camera.

### Claim 19

A method of creating a wide field-of-view image comprising:
collecting a set of data with a first sensor with a first field-of-view (FOV) and a first line of site (LOS);
aligning a second sensor so that a second LOS of the second sensor is parallel to the first LOS of the first sensor;
collecting a second set of data with the second sensor with a second FOV that is larger than the first FOV; and
merging a set of data collected by the first sensor with the second set of data collected by the second sensor to create merged data that has an area with first resolution and an area with a second resolution that has a lower resolution than the first resolution.

### Claim 20 (depends on 19)

The method of creating a wide field-of-view image of claim 19 further comprising:
locating an object in the first set of data;
locating the object in the second set of data; and
wherein the merging the set of data collected by the first sensor with the second set of data is based, at least in part, on a location of the object in the first set of data and a location of the object in the second set of data.
