# US 2020/0286388 A1 · Method and apparatus for visualizing risk levels associated with aerial vehicle flights

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0286388 A1
- Document ID: US20200286388A1
- Status: Published application
- Kind: A1
- Application number: 16/297,216
- Filed: 2019-03-08
- Published: 2020-09-10
- Earliest claimed: 2019-03-08
- Assignees: HERE Global B.V.
- Applicants: Here Global B.V.
- Inventors: Michele VELASTRI; Friedrich HARTMANN; Dmitry KOVAL; Virva Emilia AUVINEN; Christian STADE-SCHULDT
- Web page: https://patentgrep.com/patent/US20200286388A1

## CPC

- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G08G 5/55: for a single aircraft
- G01C 21/005: {with correlation of navigation data from several sources, e.g. map or contour matching (G01C21/30 takes precedence)}
- G01C 21/32: Structuring or formatting of map data
- G01C 23/00: Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
- G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G08G 5/21: located onboard the aircraft
- G08G 5/30: Flight plan management
- G08G 5/32: for flight plan preparation
- G08G 5/34: for flight plan modification
- G08G 5/59: in accordance with predefined flight zones, e.g. to avoid prohibited zones
- G08G 5/723: {from the aircraft}
- G08G 5/76: for monitoring atmospheric conditions
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An approach is provided for visualizing risk levels associated with aerial vehicle flights. The approach, for example, involves determining a flight path for an aerial vehicle. The approach also involves calculating at least one risk area along the flight path based on risk-related data associated with the flight path (e.g., data on population density, electromagnetic fields, absence of location signals such as Global Positioning System (GPS) signals, weather, network coverage, aviation related data, etc.). The approach further involves generating a representation of the at least one risk area as a virtual obstacle object and rendering the virtual obstacle object in a user interface of a device in relation to the flight path.

## Claims

### Claim 1

A method comprising:
determining a flight path for an aerial vehicle;
calculating at least one risk area along the flight path based on risk-related data associated with the flight path;
generating a representation of the at least one risk area as a virtual obstacle object; and
rendering the virtual obstacle object in a user interface of a device in relation to the flight path.

### Claim 2 (depends on 1)

The method of claim 1, wherein the risk-related data includes at least one of:
population density data;
electromagnetic field data;
data on an absence of location signals;
weather data;
network coverage data; and
aviation related data.

### Claim 3 (depends on 1)

The method of claim 1, wherein the virtual obstacle object represents a risk to the aerial vehicle that is not visible.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
updating the risk-related data continuously, periodically, according to a schedule, or a combination thereof; and
updating the at least one risk area, the virtual obstacle object, the flight path, or a combination thereof based on the updating.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
dynamically adjusting at least one dimension of the virtual obstacle object as a function of time based on the updating.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
initiating a generation of a different flight path based on determining that a risk level associated with the at least risk area is above a risk threshold.

### Claim 7 (depends on 1)

The method of claim 1, wherein the user interface is associated with a trip planning application, an augmented reality application, or a combination thereof.

### Claim 8 (depends on 1)

The method of claim 1, wherein the augmented reality application is used by a pilot or a co-pilot of the aerial vehicle during a flight.

### Claim 9

An apparatus comprising:
at least one processor; and
at least one memory including computer program code for one or more programs,
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
determine a flight path for an aerial vehicle;
calculate at least one risk area along the flight path based on risk-related data associated with the flight path;
generate a representation of the at least one risk area as a virtual obstacle object; and
render the virtual obstacle object in a user interface of a device in relation to the flight path.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the apparatus is further caused to:
select an area of interest from among the at least one risk area;
determine human activity data for the area of interest, wherein the human activity data includes a plurality of data sources; and
generating a prediction of a population density in the area of interest at a selected time based on the human activity data.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the prediction of the human population density is generated based on a trained machine learning model, and wherein the trained machine learning model is trained using ground truth data correlating reference historical human activity data to ground truth population density data.

### Claim 12 (depends on 9)

The apparatus of claim 9, wherein the selected time is future time that is provided with respect to a time of day, a day, a week, a season, a year, or a combination thereof.

### Claim 13 (depends on 9)

The apparatus of claim 9, wherein the plurality of data sources includes at least one of:
positioning data from a mobile device;
traffic data;
public transport routing request data;
smart city data;
mobile communications operator data;
social media data; and
event data.

### Claim 14 (depends on 9)

The apparatus of claim 9, wherein the apparatus is further caused to:
select an event occurring or expected to occur in the area of interest at the selected time,
wherein the prediction of the population density is further based on the event.

### Claim 15 (depends on 9)

The apparatus of claim 9, wherein the apparatus is further caused to:
generate a visual representation of the population density,
wherein a dimension of the visual representation is based on the population density.

### Claim 16

A non-transitory computer-readable storage medium for routing a drone using digital map data representing a network of underground passageways, interior passageways, or a combination thereof, carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform:
determining a flight path for an aerial vehicle;
calculating at least one risk area along the flight path based on risk-related data associated with the flight path;
generating a representation of the at least one risk area as a virtual obstacle object; and
rendering the virtual obstacle object in a user interface of a device in relation to the flight path.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the risk-related data includes at least one of:
population density data;
electromagnetic field data;
data on an absence of location signals;
weather data;
network coverage data; and
aviation related data.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the virtual obstacle object represents a risk to the aerial vehicle that is not visible.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein the apparatus is caused to further perform:
updating the risk-related data continuously, periodically, according to a schedule, or a combination thereof; and
updating the at least one risk area, the virtual obstacle object, the flight path, or a combination thereof based on the updating.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the apparatus is caused to further perform:
dynamically adjusting at least one dimension of the virtual obstacle object as a function of time based on the updating.
