# US 12,112,647 B2 · Methods and devices for unmanned aerial vehicle based site inspection and scale rendered analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,647 B2
- Document ID: US12112647B2
- Status: Granted
- Kind: B2
- Application number: 18/331,284
- Filed: 2023-06-08
- Published: 2024-04-04
- Granted: 2024-10-08
- Earliest claimed: 2019-08-01
- Assignees: Halkin Inc.
- Applicants: Halkin Inc.
- Inventors: Ryan Hall; Grant Hall
- Web page: https://patentgrep.com/patent/US12112647B2

## CPC

- G08G 5/55: for a single aircraft
- B64C 39/024: {of the remote controlled vehicle type, i.e. RPV}
- B64U 70/90: Launching from or landing on platforms
- G06Q 10/06311: {Scheduling, planning or task assignment for a person or group}
- G06T 7/0004: {Industrial image inspection}
- G08G 5/26: Transmission of traffic-related information between aircraft and ground stations
- G08G 5/30: Flight plan management
- G08G 5/32: for flight plan preparation
- G08G 5/57: for unmanned aircraft
- H04L 67/125: involving control of end-device applications over a network
- H04L 67/61: taking into account QoS or priority requirements
- B64U 10/14: with four distinct rotor axes, e.g. quadcopters
- B64U 2101/26: for manufacturing, inspections or repairs
- B64U 2101/30: for imaging, photography or videography
- G06T 2207/10024: Color image
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/10048: Infrared image
- G06T 2207/30164: Workpiece; Machine component
- G06T 2207/30168: Image quality inspection
- G06T 2207/30184: Infrastructure
- G06T 2207/30188: Vegetation; Agriculture
- Y02P 90/80: Management or planning
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B64C: AEROPLANES; HELICOPTERS
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

Various embodiments of the present technology generally relate to unmanned aerial vehicle (UAV) scale rendered analysis, orthomosaic, and 3D mapping and landing platform systems. More specifically, some embodiments relate to systems, methods, and means for the collection and processing of images captured during a UAV flight sequence. In some embodiments, the UAV landing platform retrieves flight information and initial map information over a unidirectional virtual private network from a multitenant cloud-based scheduling application. The UAV landing platform sends the initial map information to a UAV over a WiFi, Bluetooth, or radio frequency network and initiates a drone flight sequence once the drone flight sequence has been approved by a local user. The UAV landing platform receives property image data from a UAV after a UAV flight sequence has ended and transmits the received property image data back to the cloud application.

## Claims

### Claim 1

A method of operating a mobile device, the method comprising:
receiving one or more multidimensional models of an environment from a model generation platform, wherein the one or more multidimensional models were generated based on image data captured by an unmanned aerial vehicle (UAV) during a UAV flight sequence;
receiving user input comprising a model analysis request for the one or more multidimensional models;
executing a model analysis of the one or more multidimensional models based on the model analysis request; and
enabling display of results of the model analysis for access by an end user.

### Claim 2 (depends on 1)

The method of claim 1 wherein the model analysis request comprises one or more of a model overlay request, a model editing request, a model annotation request, a wall mode request, an inventory analysis request, a model layers request, a first person perspective request, a model degradation analysis request, a model measurement request, and a gas analysis request.

### Claim 3 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a model overlay request and wherein executing the model overlay request includes overlaying the one or more multidimensional models onto a base wireframe model.

### Claim 4 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a model editing request and wherein executing the model editing request includes editing the one or more multidimensional models.

### Claim 5 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a model annotation request and wherein executing the model annotation request includes annotating the one or more multidimensional models with grid points.

### Claim 6 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a wall mode request and wherein executing the wall mode request includes identifying vertical surfaces of the one or more multidimensional models.

### Claim 7 (depends on 1)

The method of claim 1 wherein the model analysis request comprises an inventory analysis request and wherein executing the inventory analysis request includes categorizing objects of the one or more multidimensional models.

### Claim 8 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a model layers request and wherein executing the model layers request includes identifying overlaid model layers of the one or more multidimensional models.

### Claim 9 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a first person perspective request and wherein executing the first person perspective request includes configuring the one or more multidimensional models to allow a first person perspective.

### Claim 10 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a model measurement request and wherein executing the model measurement request includes measuring metrics of the one or more multidimensional models and wherein the metrics include distances, heights, areas, and volumes of objects within the one or more multidimensional models.

### Claim 11 (depends on 1)

The method of claim 1 wherein the model analysis request comprises a gas analysis request and wherein executing the gas analysis request includes labeling gases of the one or more multidimensional models.

### Claim 12 (depends on 1)

The method of claim 1 wherein the one or more multidimensional models are representative of three-dimensional (3D) models and wherein the 3D models comprise one or more of orthomosaic images, 3D wireframe images, thermal models, landscape models, and architectural models.

### Claim 13 (depends on 1)

The method of claim 1 wherein the mobile application receives the one or more multidimensional models over a unidirectional virtual private network.

### Claim 14

A computing apparatus comprising:
one or more computer-readable storage media; and
program instructions stored on the one or more computer-readable storage media that, when executed by a processing system, direct the computing apparatus to at least:
receive one or more multidimensional models of an environment from a model generation platform, wherein the one or more multidimensional models were generated based on image data captured by an unmanned aerial vehicle (UAV) during a UAV flight sequence;
receive user input comprising a model analysis request for the one or more multidimensional models;
execute a model analysis of the one or more multidimensional models based on the model analysis request; and
enable display of results of the model analysis for access by an end user.

### Claim 15 (depends on 14)

The computing apparatus of claim 14 wherein the model analysis request comprises one or more of a model overlay request, a model editing request, a model annotation request, a wall mode request, an inventory analysis request, a model layers request, a first person perspective request, a model degradation analysis request, a model measurement request, and a gas analysis request.

### Claim 16 (depends on 15)

The computing apparatus of claim 15 wherein the program instructions further direct the computing apparatus to:
overlay the one or more multidimensional models onto a base wireframe model when the model analysis request is a model overlay request;
annotate the one or more multidimensional models with grid points when the model analysis request is a model annotation request;
identify vertical surfaces of the one or more multidimensional models when the model analysis request is a wall mode request.

### Claim 17 (depends on 14)

The computing apparatus of claim 14 wherein the one or more multidimensional models are representative of three-dimensional (3D) models and wherein the 3D models comprise one or more of orthomosaic images, 3D wireframe images, thermal models, landscape models, and architectural models.

### Claim 18 (depends on 14)

The computing apparatus of claim 14 wherein the computing apparatus receives the one or more multidimensional models over a unidirectional virtual private network.

### Claim 19

One or more computer-readable storage media having program instructions stored thereon to process multidimensional models generated based on image data captured by an unmanned aerial vehicle (UAV) during a UAV flight sequence, wherein the program instructions, when executed by a computing system, direct the computing system to at least:
receive one or more multidimensional models of an environment from a model generation platform;
receive user input comprising a model analysis request for the one or more multidimensional models;
execute a model analysis of the one or more multidimensional models based on the model analysis request; and
enable display of results of the model analysis for access by an end user.

### Claim 20 (depends on 19)

The one or more computer-readable storage media of claim 19 wherein the model analysis request comprises one or more of a model overlay request, a model annotation request, and a wall mode request, and wherein the program instructions further direct the computing system to at least:
overlay the one or more multidimensional models onto a base wireframe model when the model analysis request is a model overlay request;
annotate the one or more multidimensional models with grid points when the model analysis request is a model annotation request;
identify vertical surfaces of the one or more multidimensional models when the model analysis request is a wall mode request.
