# US 10,455,199 B1 · Image management system for reducing effects of laser beams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,199 B1
- Document ID: US10455199B1
- Status: Granted
- Kind: B1
- Application number: 14/823,677
- Filed: 2015-08-11
- Granted: 2019-10-22
- Earliest claimed: 2015-08-11
- Assignees: The Boeing Company
- Applicants: The Boeing Company
- Inventors: Mark Joseph Clemen, Jr.; James A. Grossnickle
- Web page: https://patentgrep.com/patent/US10455199B1

## CPC

- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 23/60: Control of cameras or camera modules
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/10152: Varying illumination
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method and apparatus for countering an attack on a platform. Images are received from cameras associated with the platform, and the images are identified from a group of the cameras that have a desired level of information when a group of light sources is directed at a camera system. A fused image is generated from a combination of the images from the group of the cameras and displayed on a display system for the platform. The fused image enables performing an operation using the platform.

## Claims

### Claim 1

An apparatus comprising:
a plurality of cameras in a camera system associated with a platform, wherein the plurality of cameras generate a plurality of images, and wherein each camera in the plurality of cameras generates an image in the plurality of images; and
an image manager in communication with the camera system, wherein the image manager identifies one or more first cameras in the plurality of cameras that are illuminated by a laser beam directed at the one or more first cameras and creates a fused image comprising images in the plurality of images from second cameras in the plurality of cameras that are not identified as being illuminated by the laser beam and excluding images in the plurality of images from the one or more first cameras in the plurality of cameras that are identified as being illuminated by the laser beam directed at the one or more first cameras.

### Claim 2 (depends on 1)

The apparatus of claim 1 further comprising:
a bus system connected to the camera system and the image manager, wherein the cameras and the image manager communicate with each other using the bus system.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein in identifying the one or more first cameras in the plurality of cameras that are illuminated by the laser beam directed at the one or more first cameras, the image manager identifies images from the plurality of images that include spots of bright light created by the laser beam.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the image manager reduces noise in the plurality of images prior to identifying the images from the plurality of images that include spots of bright light created by the laser beam.

### Claim 5 (depends on 1)

The apparatus of claim 1 further comprising:
a display system in communication with the image manager, wherein the image manager displays the fused image.

### Claim 6 (depends on 1)

The apparatus of claim 1 further comprising:
camera controllers associated with the cameras, wherein the camera controllers decide when the images are sent to the image manager based on a policy.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the policy sets a saturation level that is acceptable for sending the images.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein each camera in the plurality of cameras comprises:
an image sensor configured to generate the image;
a light filter system positioned such that light passes though the light filter system to the image sensor;
a light detector that identifies when the camera is being illuminated by the laser beam;
a communications unit; and
a controller, wherein the controller is in communication with the image sensor, the light detector, and the communications unit.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the image manager is in a location selected from one of the platform and a remote location to the platform.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein fields of view of the plurality of cameras overlap each other.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the platform is selected from one of a mobile platform, a stationary platform, a land-based structure, an aquatic-based structure, a space-based structure, an aircraft, an unmanned aerial vehicle, a rotorcraft, a helicopter, a surface ship, a tank, a personnel carrier, a train, a spacecraft, a space station, a satellite, a submarine, an automobile, a power plant, a bridge, a dam, a house, a manufacturing facility, and a building.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the fused image enables performing an operation using the platform, wherein the operation is selected from one of navigation, surveillance, information gathering, and deploying objects.

### Claim 13

An aircraft display system comprising:
a display system;
a plurality of cameras in a camera system associated with the aircraft, wherein the plurality of cameras have different fields of view, wherein the plurality of cameras generate a plurality of images, and wherein each camera in the plurality of cameras generates an image in the plurality of images; and
an image manager in communication with the display system and the camera system, wherein the image manager identifies one or more first cameras in the plurality of cameras that are illuminated by a laser beam directed at the one or more first cameras, creates a fused image comprising images in the plurality of images from one or more second cameras in the plurality of cameras that are not identified as being illuminated by the laser beam and excluding images in the plurality of images from the one or more first cameras in the plurality of cameras that are identified as being illuminated by the laser beam directed at the one or more first cameras, and displays the fused image on the display system s.

### Claim 14 (depends on 13)

The aircraft display system of claim 13 further comprising:
camera controllers associated with the cameras, wherein the camera controllers decide when to send the images to the image manager based on a saturation level of image sensors in the cameras.

### Claim 15 (depends on 13)

The aircraft display system of claim 13, wherein the aircraft is a manned aircraft and the display system is located in the aircraft.

### Claim 16 (depends on 13)

The aircraft display system of claim 13, wherein the aircraft is an unmanned aerial vehicle and the display system is located on a second platform in a remote location to the aircraft, wherein the second platform is selected from one of a surface ship, a building, a ground vehicle, another aircraft, and a space station.

### Claim 17 (depends on 13)

The aircraft display system of claim 13, wherein fields of view of the plurality of cameras overlap each other.

### Claim 18

A method for countering an attack on a platform comprising:
receiving a plurality of images from a plurality of cameras associated with the platform, wherein each camera in the plurality of cameras generates an image in the plurality of images;
identifying one or more first cameras in the plurality of cameras that are being illuminated by a laser beam directed at the one or more first cameras; and
generating a fused image from a combination of images in the plurality of images from one or more second cameras in the plurality of cameras that are not identified as being illuminated by the laser beam and excluding images in the plurality of images from the one or more first cameras in the plurality of cameras that are identified as being illuminated by the laser beam directed at the one or more first cameras; and
displaying the fused image on a display system for the platform, wherein the fused image enables performing an operation using the platform.

### Claim 19 (depends on 18)

The method of claim 18 further comprising:
reducing noise in the plurality of images prior to identifying the cameras in the plurality of cameras that are being illuminated by the laser beam.

### Claim 20 (depends on 18)

The method of claim 18 further comprising:
sending the images from the cameras based on a policy.

### Claim 21 (depends on 18)

The method of claim 18, wherein identifying the one or more first cameras in the plurality of cameras that are being illuminated by the laser beam comprises:
identifying images from the cameras that include spots of bright light.

### Claim 22 (depends on 18)

The method of claim 18, wherein the platform is a manned aircraft and the display system is located in the manned aircraft.

### Claim 23 (depends on 18)

The method of claim 18, wherein the platform is an unmanned aerial vehicle and the display system is located on a second platform in a location that is remote to the unmanned aerial vehicle, wherein the platform is selected from one of a surface ship, a building, a ground vehicle, another aircraft, and a space station.
