# US 2017/0287224 A1 · Method of synthetic representation of elements of interest in a viewing system for aircraft

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287224 A1
- Document ID: US20170287224A1
- Status: Published application
- Kind: A1
- Application number: 15/469,555
- Filed: 2017-03-26
- Published: 2017-10-05
- Earliest claimed: 2016-04-01
- Assignees: Thales
- Applicants: Thales
- Inventors: Thierry GANILLE; Bruno AYMERIC; Johanna LUX
- Web page: https://patentgrep.com/patent/US20170287224A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G01C 23/005: {Flight directors (indicating arrangements specially adapted for rotary gyroscopes G01C19/32)}
- G01S 7/24: the display being orientated or displaced in accordance with movement of object carrying the transmitting and receiving apparatus, e.g. true-motion radar
- G01S 13/89: for mapping or imaging
- G01S 13/913: {for landing purposes}
- G01S 13/935: for terrain-avoidance
- G02B 27/01: Head-up displays
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G06T 15/205: {Image-based rendering}
- G06V 20/13: Satellite images
- G06V 20/17: taken from planes or by drones
- G08G 5/21: located onboard the aircraft
- G08G 5/54: for approach or landing
- G08G 5/74: for monitoring terrain
- H04N 7/183: {for receiving images from a single remote source}
- H04N 23/20: for generating image signals from infrared radiation only
- B64D 43/00: Arrangements or adaptations of instruments
- B64D 45/08: optical
- G02B 2027/0134: {of stereoscopic type}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G06T 2215/16: Using real world measurements to influence rendering
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT

## Abstract

A method of synthetic representation of elements of interest in a viewing system for aircraft, the viewing system comprises location sensors, a cartographic database and a database of elements of interest, an image sensor, a unit for processing images and a unit for generating three-dimensional digital images representative of the terrain overflown and a viewing device, wherein, when the terrain overflown comprises an element of interest, the method of synthetic representation comprises: a first step of searching for and detecting the element of interest in each image of a sequence of images, and; a second step of generating three-dimensional digital images representative of the terrain overflown, the element of interest represented according to a first representation if it has not been detected in any of the images of the sequence of images and according to a second representation if it is detected.

## Claims

### Claim 1

A method of synthetic representation of elements of interest in a viewing system for aircraft, the said viewing system comprising at least sensors of location of the said aircraft, a first cartographic database, a second database of elements of interest, an image sensor, a processing unit for the images arising from the said image sensor, a unit for generating three-dimensional digital images representative of the terrain overflown by the aircraft as a function of the data arising from the location sensors, from the cartographic database and the database of elements of interest and from the image processing unit and a viewing device, wherein
when the terrain overflown comprises at least one element of interest present in the database of elements of interest, the said element being displayed in the three-dimensional digital images representative of the terrain overflown, the said method of synthetic representation comprises at least:
a first step of searching for and detecting the said element of interest in each image of a sequence of images arising from the image sensor, the detection being ensured by the processing unit and;
a second step of generating three-dimensional digital images representative of the terrain overflown, the element of interest being represented according to a first representation if it has not been detected in any of the images of the sequence of images arising from the image sensor and according to a second representation if it is detected in at least one image of the sequence of images.

### Claim 2 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein, in the second step, the element of interest being represented in the second representation is represented according to a third representation if it is no longer detected in a determined succession of images of the said sequence of images.

### Claim 3 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein, when the element of interest is detected in at least one image of the sequence of images, the position of this element of interest in the three-dimensional digital image is made to agree with the position that it occupies in the said image arising from the image sensor.

### Claim 4 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein, when the element of interest is detected in at least one image of the sequence of images, the position of the three-dimensional digital image is made to agree with the position of the said image arising from the image sensor.

### Claim 5 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein the first representation, the second representation and the third representation of an element of interest differ from one another by the colours of their contours or by the line styles of their contours or by the appearance, the disappearance or the modification of symbols associated with the said element of interest.

### Claim 6 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein the element of interest is a landing runway or elements of a landing runway or a helipad.

### Claim 7 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein the element of interest is a fixed obstacle.

### Claim 8 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein the image sensor is a millimetric radar or a “LADAR” or an infrared camera.

### Claim 9 (depends on 1)

The method of synthetic representation of elements of interest according to claim 1, wherein the viewing system is one of the colour screens of the instrument panel of the aircraft or a display of head-up type displaying the three-dimensional image on the exterior landscape or a helmet viewing system or a device for display and projection on the windscreen of the aircraft.
