# US 2021/0280069 A1 · Methods and systems for highlighting ground traffic on cockpit displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0280069 A1
- Document ID: US20210280069A1
- Status: Published application
- Kind: A1
- Application number: 16/808,736
- Filed: 2020-03-04
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: Honeywell International Inc.
- Applicants: Honeywell International Inc.
- Inventors: Zuowei He; Gang He; Haidong Huang
- Web page: https://patentgrep.com/patent/US20210280069A1

## CPC

- G08G 5/21: located onboard the aircraft
- B64D 43/00: Arrangements or adaptations of instruments
- B64D 47/08: Arrangements of cameras
- G01C 23/005: {Flight directors (indicating arrangements specially adapted for rotary gyroscopes G01C19/32)}
- G08G 5/51: for control when on the ground, e.g. taxiing or rolling
- G08G 5/55: for a single aircraft
- G08G 5/723: {from the aircraft}
- G08G 5/80: Anti-collision systems
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)

## Abstract

Systems and methods are disclosed that receiving ground traffic data from a traffic computer, and enhanced vision system, EVS, imaging data from at least one EVS camera. A target area is determined in the EVS imaging data based on position data of the ground traffic data. Graphics processing is performed that is confined to the target area to enhance visibility of ground traffic in the EVS imaging data in the target area, thereby generating enhanced EVS imaging data. The graphics processing is selected from at least one of contrast enhancement, edge detection and template matching and highlighting of an outline of the ground traffic. A display is generated that is to be displayed on the display device based on the enhanced EVS imaging data and the EVS imaging data.

## Claims

### Claim 1

An aircraft display system for highlighting ground traffic, the aircraft display system comprising:
a display device;
at least one processor in operable communication with the display device, the at least one processor configured to execute program instructions, wherein the program instructions are configured to cause the at least one processor to:
receive ground traffic data from a traffic computer, the ground traffic data including position data for ground traffic;
receive enhanced vision system, EVS, imaging data from at least one EVS camera;
determine a target area in the EVS imaging data based on the position data of the ground traffic data;
perform graphics processing that is confined to the target area to enhance visibility of ground traffic in the EVS imaging data in the target area, thereby generating enhanced EVS imaging data, wherein the graphics processing is selected from at least one of contrast enhancement, edge detection and template matching; and
generate a display to be displayed on the display device based on the enhanced EVS imaging data and the EVS imaging data.

### Claim 2 (depends on 1)

The aircraft display system of claim 1, wherein the ground traffic data from the traffic computer is Automatic Dependent Surveillance Broadcast, ADSB, data, is derived from on board sensor data, or is unlinked from a ground based surveillance system.

### Claim 3 (depends on 1)

The aircraft display system of claim 1, wherein the program instructions are configured to cause the at least one processor to:
receive airport data defining valid regions data for ground traffic;
determine the target area in the EVS imaging data based on the position data of the ground traffic data and the valid regions of the airport data.

### Claim 4 (depends on 1)

The aircraft display system of claim 1, wherein the ground traffic data includes the position data and aircraft identification data for ground traffic, wherein the program instructions are configured to cause the at least one processor to:
retrieve aircraft template data from an aircraft model database using the aircraft identification data for ground traffic, the aircraft template data representing an aircraft template;
scale the aircraft template based on a distance between ownship aircraft and the ground traffic using the position data for ground traffic and ownship position data;
match scaled aircraft template and EVS imaging data in the target area as part of the graphics processing; and
generate the display to be displayed on the display device based on the EVS imaging data including highlighting ground traffic outline in the target area based on the scaled aircraft template.

### Claim 5 (depends on 5)

The aircraft display system of claim 5, wherein the program instructions are configured to:
receive the ground traffic data including position, bearing and heading data for ground traffic;
scale and rotate the aircraft template, the scaling being based on a distance and relative bearing angle between ownship aircraft and the ground traffic using the position data and bearing data for ground traffic and ownship position and heading data and the rotating being based on heading data for ground traffic and ownship attitude data including heading, pitch and roll data; and
generate the display to be displayed on the display device based on the EVS imaging data including highlighting ground traffic outline in the target area based on the scaled and rotated aircraft template.

### Claim 6 (depends on 1)

The aircraft display system of claim 1, wherein the ground traffic data includes position and velocity data for ground traffic and the program instructions are configured to cause the at least one processor to determine the target area in the EVS imaging data based on the position and velocity data of the ground traffic data and predetermined latency of the position and velocity data.

### Claim 7

A method of operating an aircraft display system, the method comprising:
receiving, via at least one processor, ground traffic data from a traffic computer, the ground traffic data including position data for ground traffic;
receiving, via the at least one processor, enhanced vision system, EVS, imaging data from at least one EVS camera;
determining, via the at least one processor, a target area in the EVS imaging data based on the position data of the ground traffic data;
performing, via the at least one processor, graphics processing that is confined to the target area to enhance visibility of ground traffic in the EVS imaging data in the target area, thereby generating enhanced EVS imaging data, wherein the graphics processing is selected from at least one of contrast enhancement, edge detection and template matching and highlighting of an outline of the ground traffic; and
generating, via the at least one processor, a display to be displayed on a display device of the aircraft display system, the display based on the enhanced EVS imaging data and the EVS imaging data.

### Claim 8 (depends on 7)

The method of claim 7, wherein the ground traffic data from the traffic computer is Automatic Dependent Surveillance Broadcast, ADSB, data.

### Claim 9 (depends on 7)

The method of claim 7, comprising:
receiving, via the at least one processor, airport data defining valid regions data for ground traffic;
determining, via the at least one processor, the target area in the EVS imaging data based on the position data of the ground traffic data and the valid regions of the airport data.

### Claim 10 (depends on 7)

The method of claim 7, wherein the ground traffic data includes the position data and aircraft identification data for ground traffic, the method comprising:
retrieving, via the at least one processor, aircraft template data from an aircraft model database using the aircraft identification data for ground traffic, the aircraft template data representing an aircraft template;
scaling, via the at least one processor, the aircraft template based on a distance between ownship aircraft and the ground traffic using the position data for ground traffic and ownship position data;
matching, via the at least one processor, scaled aircraft template and EVS imaging data in the target area as part of the graphics processing; and
generating, via the at least one processor, the display to be displayed on the display device based on the EVS imaging data including highlighting ground traffic outline in the target area based on the scaled aircraft template.

### Claim 11 (depends on 10)

The method of claim 10, comprising
receiving, via the at least one processor, the ground traffic data including position, bearing and heading data for ground traffic;
scaling and rotating, via the at least one processor, the aircraft template, the scaling being based on a distance and relative bearing angle between ownship aircraft and the ground traffic using the position data and bearing data for ground traffic and ownship position and heading data and the rotating being based on heading data for ground traffic and ownship attitude data including heading, pitch and roll data; and
generating, via the at least one processor, the display to be displayed on the display device based on the EVS imaging data including highlighting ground traffic outline in the target area based on the scaled and rotated aircraft template.

### Claim 12 (depends on 7)

The method of claim 7, wherein the ground traffic data includes position and velocity data for ground traffic and the program instructions are configured to cause the at least one processor to determine the target area in the EVS imaging data based on the position and velocity data of the ground traffic data and predetermined latency of the position and velocity data.

### Claim 13

Non-transitory computer readable media encoded with programming instructions configurable to cause a processor to perform the steps of:
receiving ground traffic data from a traffic computer, the ground traffic data including position data for ground traffic;
receiving enhanced vision system, EVS, imaging data from at least one EVS camera;
determining a target area in the EVS imaging data based on the position data of the ground traffic data;
performing graphics processing that is confined to the target area to enhance visibility of ground traffic in the EVS imaging data in the target area, thereby generating enhanced EVS imaging data, wherein the graphics processing is selected from at least one of contrast enhancement, edge detection and template matching and highlighting of an outline of the ground traffic; and
generating a display to be displayed on a display device of the cockpit display system, the display is based on the enhanced EVS imaging data and the EVS imaging data such that the target area, which is based on the enhanced EVS imaging data, is differentiated from the display surrounding the target area, which is based on the EVS imaging data.

### Claim 14 (depends on 13)

Non-transitory computer readable media according to claim 13 executable by the at least one processor of the cockpit display system to perform the steps of:
retrieve ground traffic template data from ground traffic model database using ground traffic identification data included in the ground traffic data, the ground traffic template data representing a ground traffic template;
performing template matching based on the ground traffic template data and EVS imaging data confined to the target area as part of the graphics processing, thereby generating matching data; and
generating the display to be displayed on the display device so as to include outlining, in the enhanced EVS imaging data, around ground traffic in the target area based on an outline of the aircraft template and the matching data.

### Claim 15 (depends on 13)

Non-transitory computer readable media according to claim 13 executable by the at least one processor of the cockpit display system to perform the steps of:
determining the target area in the EVS imaging data based on position and velocity data of the ground traffic data and predetermined latency of the position and velocity data;
receiving airport data defining valid regions data for ground traffic; and
reducing a size of the target area in the EVS imaging data based on the position data of the ground traffic data and the valid regions of the airport data.
