# US 2021/0278529 A1 · Synthetic weather systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278529 A1
- Document ID: US20210278529A1
- Status: Published application
- Kind: A1
- Application number: 17/130,553
- Filed: 2020-12-22
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Rockwell Collins, Inc.
- Applicants: Rockwell Collins, Inc.
- Inventors: SHIVASHANKAR MADDANIMATH VEERAYYA; VINAY S. HUDDAR
- Web page: https://patentgrep.com/patent/US20210278529A1

## CPC

- G01S 13/953: {mounted on aircraft}
- B64D 45/00: Aircraft indicators or protectors not otherwise provided for
- B64D 47/08: Arrangements of cameras
- G01C 23/005: {Flight directors (indicating arrangements specially adapted for rotary gyroscopes G01C19/32)}
- G01S 7/20: Stereoscopic displays; Three-dimensional [3D] displays; Pseudo-3D displays
- G01S 13/867: {Combination of radar systems with cameras}
- G06N 20/00: Machine learning
- G06N 3/02: Neural networks
- Y02A 90/10: Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- Y02A: TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE

## Abstract

A synthetic visual system for an aircraft may comprise: a camera in electronic communication with a controller; a radar system in electronic communication with the controller; a three-dimensional cockpit display in electronic communication with the controller via a synthetic weather system; and a tangible, non-transitory memory configured to communicate with the controller. The three-dimensional cockpit display may be configured to display a three-dimensional weather image based on correlated data between the radar system and the camera.

## Claims

### Claim 1

A synthetic vision system for an aircraft, comprising:
a camera in electronic communication with a controller;
a radar system in electronic communication with the controller;
a three-dimensional cockpit display in electronic communication with the controller via a synthetic weather system; and
a tangible, non-transitory memory configured to communicate with the controller, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the controller, cause the controller to perform operations comprising:
receiving, by the controller, a reflectivity data from the radar system;
receiving, by the controller, a visual data from the camera; and
correlating, by the controller, the reflectivity data to the visual data.

### Claim 2 (depends on 1)

The synthetic vision system of claim 1, wherein the three-dimensional cockpit display is configured to display a correlated visual data from the reflectivity data.

### Claim 3 (depends on 1)

The synthetic vision system of claim 1, further comprising a developer system in electronic communication with the controller.

### Claim 4 (depends on 3)

The synthetic vision system of claim 3, wherein the developer system is configured to compile the reflectivity data and the visual data.

### Claim 5 (depends on 1)

The synthetic vision system of claim 1, wherein the reflectivity data further comprises reflectivity as a function of elevation, longitude, latitude, and time.

### Claim 6 (depends on 1)

The synthetic vision system of claim 1, wherein the camera is coupled proximate a nose end of the aircraft.

### Claim 7 (depends on 1)

The synthetic vision system of claim 1, wherein the radar system is configured to receive weather data.

### Claim 8 (depends on 1)

The synthetic vision system of claim 1, wherein the three-dimensional cockpit display includes a source of the radar system.

### Claim 9 (depends on 1)

The synthetic vision system of claim 1, wherein the synthetic weather system includes a machine learning model.

### Claim 10 (depends on 9)

The synthetic vision system of claim 9, wherein the machine learning model is configured to continuously learn from the reflectivity data and the visual data.

### Claim 11

A method of inferencing and display of weather for an aircraft, the method comprising:
capturing, via a processor, a real-time reflectivity data from a radar system;
capturing, via the processor, a real-time visual data from a camera;
correlating, via the processor, the real-time reflectivity data to the real-time visual data when the visibility is clear; and
displaying, via the processor, a first estimated three-dimensional weather image based on correlating the real-time reflectivity data to the real-time visual data when visibility is clear; and
displaying, via the processor, a second estimated three-dimensional weather image passed on the real-time reflectivity data when the visibility is less than clear.

### Claim 12 (depends on 11)

The method of claim 11, wherein displaying the second estimated three-dimensional weather image is based on receiving the real-time reflectivity data from the radar system.

### Claim 13 (depends on 11)

The method of claim 11, wherein the processor comprises a machine learning model.

### Claim 14 (depends on 11)

The method of claim 11, wherein the camera is coupled proximate a nose of the aircraft.

### Claim 15 (depends on 11)

The method of claim 11, wherein the real-time reflectivity data further comprises reflectivity as a function of elevation, longitude, latitude, and time.

### Claim 16

A method of developing a three-dimensional weather model for an aircraft cockpit display, the method comprising:
compiling, via a processor, a reflectivity data from a radar system;
compiling, via the processor, a visual data from a camera;
correlating, via the processor, the reflectivity data to the visual data; and
developing, via the processor, an estimated three-dimensional weather model based on correlating the reflectivity data to the visual data.

### Claim 17 (depends on 16)

The method of claim 16, wherein compiling the reflectivity data and compiling the visual data is received from a plurality of aircraft when the plurality of aircraft have clear visibility.

### Claim 18 (depends on 16)

The method of claim 16, wherein the processor comprises a machine learning model.

### Claim 19 (depends on 16)

The method of claim 16, wherein the camera is coupled proximate a nose of the aircraft.

### Claim 20 (depends on 16)

The method of claim 16, wherein the reflectivity data further comprises reflectivity as a function of elevation, longitude, latitude, and time.
