# US 2025/0093882 A1 · Multi-Phase Semantic Three-Dimensional Scan For Structure Inspection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0093882 A1
- Document ID: US20250093882A1
- Status: Published application
- Kind: A1
- Application number: 18/892,300
- Filed: 2024-09-20
- Published: 2025-03-20
- Earliest claimed: 2023-09-20
- Assignees: Skydio, Inc.
- Applicants: Skydio, Inc.
- Inventors: Adam Parker Bry; Hayk Martirosyan; Vincent Lecrubier
- Web page: https://patentgrep.com/patent/US20250093882A1

## CPC

- G05D 1/2467: {using a semantic description of the environment}
- G05D 1/646: Following a predefined trajectory, e.g. a line marked on the floor or a flight path
- G05D 1/2465: {using a 3D model of the environment}
- G05D 1/689: Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672)
- G06T 7/0004: {Industrial image inspection}
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 20/17: taken from planes or by drones
- G06V 20/176: {Urban or other man-made structures}
- G05D 2105/89: {for inspecting structures, e.g. wind mills, bridges, buildings or vehicles}
- G05D 2107/75: {Electric power generation plants}
- G05D 2109/20: Aircraft, e.g. drones
- G05D 2109/254: {Flying platforms, e.g. multicopters}
- G05D 2111/10: Optical signals
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/20112: Image segmentation details
- G06T 2207/30242: Counting objects in image
- G06T 2207/30244: Camera pose
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Semantic three-dimensional scan is performed for the multi-phase inspection of a structure using an unmanned aerial vehicle (UAV). The multi-phase inspection includes a first inspection phase and a second inspection phase. A UAV performs the first inspection phase of the structure to determine a semantic understanding of components associated with the structure and pose information of the components. Based on the semantic understanding of the components and the pose information, a flight path indicating capture points and camera poses associated with the capture points is determined. The UAV then performs the second inspection phase of the structure according to the flight path, in which all or some of the components are inspected.

## Claims

### Claim 1

A method, comprising:
performing, using an unmanned aerial vehicle, a first phase inspection of a structure to determine a semantic understanding of components associated with the structure and pose information of the components;
determining, based on the semantic understanding of the components and the pose information, a flight path indicating capture points and camera poses associated with the capture points; and
performing, using the unmanned aerial vehicle, a second phase inspection of a subset of the components according to the flight path.

### Claim 2 (depends on 1)

The method of claim 1, performing the first phase inspection of the structure to determine the semantic understanding of the components and the pose information comprises:
navigating the unmanned aerial vehicle to a distance from the structure such that all of the structure is within a field of view of a camera of the unmanned aerial vehicle.

### Claim 3 (depends on 1)

The method of claim 1, wherein performing the first phase inspection of the structure to determine the semantic understanding of the components and the pose information comprises:
detecting the components using a camera of the unmanned aerial vehicle; and
storing data indicative of the detected components on two-dimensional images associated with associated poses of the camera.

### Claim 4 (depends on 3)

The method of claim 3, wherein detecting the components comprises:
triangulating, using the unmanned aerial vehicle, locations of the components.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining the flight path indicating the capture points and the camera poses comprises:
determining a number of columns for the unmanned aerial vehicle to vertically navigate, wherein each column of the number of columns includes one or more of the capture points.

### Claim 6 (depends on 5)

The method of claim 5, wherein the number of columns is four columns, the four columns form a rectangular boundary surrounding the structure, and performing the second phase inspection of the subset of the components according to the flight path comprises:
navigating the unmanned aerial vehicle about the rectangular boundary including ascending to a traversal height while moving between ones of the four columns.

### Claim 7 (depends on 5)

The method of claim 5, wherein the number of columns is two columns, the two columns are at diagonally opposing locations about the structure, and performing the second phase inspection of the subset of the components according to the flight path comprises:
navigating the unmanned aerial vehicle between the two columns over the structure.

### Claim 8 (depends on 1)

The method of claim 1, wherein performing the second phase inspection of the subset of the components according to the flight path comprises:
while the unmanned aerial vehicle is at a capture point of the capture points, aiming a camera of the unmanned aerial vehicle at a component of the components according to a camera pose of the camera poses; and
capturing, using the aimed camera, an image of the component.

### Claim 9 (depends on 8)

The method of claim 8, wherein aiming the camera at the component according to the camera pose comprises:
continuously attempting to detect the component within a video feed captured using the camera until the component is centered in images of the video feed.

### Claim 10 (depends on 8)

The method of claim 8, comprising:
labeling the image with information associated with one or both of the structure or the flight path.

### Claim 11 (depends on 1)

The method of claim 1, comprising:
obtaining user input corresponding to one or more of an object of interest, a traversal height, a flight distance, a maximum speed, an exploration radius, a gimbal angle, or a column path, wherein the user input is used to perform the first phase inspection.

### Claim 12

An unmanned aerial vehicle, comprising:
one or more cameras;
one or more memories; and
one or more processors configured to execute instructions stored in the one or more memories to:
perform a first phase inspection of a structure to determine, based on one or more images captured using the one or more cameras, a semantic understanding of components associated with the structure and pose information of the components; and
perform a second phase inspection of a subset of the components according to a flight path that is based on the semantic understanding of the components and the pose information.

### Claim 13 (depends on 12)

The unmanned aerial vehicle of claim 12, wherein, to perform the first phase inspection of the structure to determine the semantic understanding of the components and the pose information, the one or more processors are configured to execute the instructions to:
capture the one or more images while all of the structure remains within a field of view of the one or more cameras; and
perform image segmentation to detect the components within the one or more images.

### Claim 14 (depends on 13)

The unmanned aerial vehicle of claim 13, wherein, to detect the components within the one or more images, the one or more processors are configured to execute the instructions to:
triangulate locations of the components to determine unique locations in three-dimensional space of the components.

### Claim 15 (depends on 12)

The unmanned aerial vehicle of claim 12, wherein, to perform the second phase inspection of the subset of the components according to the flight path, the one or more processors are configured to execute the instructions to:
aim the one or more cameras at a component; and
capture, using the aimed one or more cameras, an image of the component.

### Claim 16 (depends on 12)

The unmanned aerial vehicle of claim 12, wherein the one or more processors are configured to execute the instructions to:
determine the flight path based on the semantic understanding of the components and the pose information, wherein the flight path indicates capture points and camera poses associated with the capture points, and wherein the capture points are arranged into a number of columns for the unmanned aerial vehicle to vertically navigate.

### Claim 17

A system, comprising:
an unmanned aerial vehicle; and
a user device in communication with the unmanned aerial vehicle,
wherein the unmanned aerial vehicle is configured to:
perform a first phase inspection of a structure according to user input obtained from the user device to determine a semantic understanding of components associated with the structure and pose information of the components;
determine, based on the semantic understanding of the components and the pose information, a flight path indicating a number of columns for the unmanned aerial vehicle to vertically navigate, wherein each column of the number of columns includes one or more capture points each associated with one or more of the components; and
perform a second phase inspection according to the flight path.

### Claim 18 (depends on 17)

The system of claim 17, wherein the first phase inspection is performed while all of the structure is within a field of view of a camera of the unmanned aerial vehicle and the components are determined based on images captured using the camera.

### Claim 19 (depends on 18)

The system of claim 18, wherein the camera is aimed at a component of the one or more of the components according to a camera pose associated with a respective capture point of the one or more capture points to capture an image of the component during the second phase inspection.

### Claim 20 (depends on 17)

The system of claim 17, wherein, where the number of columns is four columns, the four columns form a rectangular boundary surrounding the structure and the unmanned aerial vehicle navigates about the rectangular boundary including ascending to a traversal height while moving between ones of the four columns, and
wherein, where the number of columns is two columns, the two columns are at diagonally opposing locations about the structure and the unmanned aerial vehicle navigates between the two columns over the structure.
