# US 11,999,506 B2 · Camera core monitor using gradient filter

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,999,506 B2
- Document ID: US11999506B2
- Status: Granted
- Kind: B2
- Application number: 17/176,931
- Filed: 2021-02-16
- Published: 2022-08-18
- Granted: 2024-06-04
- Earliest claimed: 2021-02-16
- Assignees: Rockwell Collins, Inc.
- Applicants: Rockwell Collins, Inc.
- Inventors: Gregory G. Lajiness; Brandon E. Wilson
- Web page: https://patentgrep.com/patent/US11999506B2

## CPC

- G01C 11/02: Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
- G06V 10/242: {by image rotation, e.g. by 90 degrees}
- B64D 47/08: Arrangements of cameras
- G02B 27/01: Head-up displays
- G06T 7/74: {involving reference images or patches}
- G06V 10/247: {by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids}
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/17: taken from planes or by drones
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G02B 2027/012: {comprising devices for attenuating parasitic image effects}
- G02B 2027/014: {comprising information/image processing systems}
- G06T 2207/30204: Marker
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An imaging system for an aircraft is disclosed. The imaging system comprises one or more image sensors configured to image a surrounding environment of the aircraft, an artifact pattern on an optical component in an optical path of the one or more image sensors, and a controller communicatively coupled to the one or more image sensors. The controller includes one or more processors configured to execute program instructions causing the one or more processors to: receive an image of the surrounding environment of the aircraft from the one or more image sensors, wherein the image includes features of the artifact pattern, extract the features of the artifact pattern from the image, and determine an orientation of the features of the artifact pattern in the image with respect to a calibration artifact pattern.

## Claims

### Claim 1

An imaging system for an aircraft, comprising:
one or more image sensors configured to image a surrounding environment of the aircraft;
an artifact pattern on an optical component in an optical path of the one or more image sensors, wherein the artifact pattern is a tangible coating physically on the optical component, wherein the artifact pattern comprises a gradient pattern, wherein the gradient pattern has a lighter portion and a darker portion; and
a controller communicatively coupled to the one or more image sensors, wherein the controller includes one or more processors configured to execute program instructions causing the one or more processors to:
receive an image of the surrounding environment of the aircraft from the one or more image sensors, wherein the image includes features of the artifact pattern;
extract the features of the artifact pattern from the image; and
determine an orientation of the features of the artifact pattern in the image with respect to a calibration artifact pattern comprising comparing an axis of symmetry of the features of the artifact pattern in the image with an axis of symmetry of the calibration artifact pattern, wherein the determined orientation of the image with respect to the calibration artifact pattern indicates a reflection or rotation of the image with respect to the calibration artifact pattern,
wherein, responsive to the orientation of the features of the artifact pattern indicating a misalignment, the image is removed from a video stream configured to be presented on a display to a user of the aircraft.

### Claim 2 (depends on 1)

The imaging system of claim 1, wherein the optical component is a lens or a window in the optical path of the one or more image sensors.

### Claim 3 (depends on 1)

The imaging system of claim 1, wherein the artifact pattern is asymmetrical.

### Claim 4 (depends on 1)

The imaging system of claim 1, wherein the artifact pattern is diagonally symmetric.

### Claim 5 (depends on 1)

The imaging system of claim 1, wherein the artifact pattern is a neutral density (ND) filter.

### Claim 6 (depends on 1)

The imaging system of claim 1, wherein the orientation of the features of the artifact pattern indicates a translation of the image with respect to the calibration artifact pattern.

### Claim 7 (depends on 1)

The imaging system of claim 1, wherein the one or more image sensors comprise a complementary metal oxide semiconductor (CMOS) photodiode array.

### Claim 8 (depends on 1)

The imaging system of claim 1, wherein, responsive to the orientation of the features of the artifact pattern indicating a misalignment, the image is removed from a video stream configured to be presented on a display to a user of the aircraft.