# US 2024/0255964 A1 · Gimbal control method, controller, unmanned aerial vehicle and unmanned aerial vehicle inspection system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0255964 A1
- Document ID: US20240255964A1
- Status: Published application
- Kind: A1
- Application number: 18/506,426
- Filed: 2023-11-10
- Published: 2024-08-01
- Earliest claimed: 2022-11-11
- Assignees: Autel Robotics Co., Ltd.
- Applicants: Autel Robotics Co., Ltd.
- Inventors: Weiheng LI
- Web page: https://patentgrep.com/patent/US20240255964A1

## CPC

- G05D 1/689: Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672)
- B64U 10/00: Type of UAV
- G05D 1/24: Arrangements for determining position or orientation
- G05D 1/646: Following a predefined trajectory, e.g. a line marked on the floor or a flight path
- G08G 5/26: Transmission of traffic-related information between aircraft and ground stations
- G08G 5/55: for a single aircraft
- G08G 5/74: for monitoring terrain
- B64U 20/87: Mounting of imaging devices, e.g. mounting of gimbals
- B64U 2101/26: for manufacturing, inspections or repairs
- B64U 2101/30: for imaging, photography or videography
- B64U 2201/20: Remote controls
- G05D 2105/80: for information gathering, e.g. for academic research
- G05D 2105/89: {for inspecting structures, e.g. wind mills, bridges, buildings or vehicles}
- G05D 2107/75: {Electric power generation plants}
- G05D 2109/20: Aircraft, e.g. drones
- G05D 2111/32: {transmitted via communication networks, e.g. cellular networks or wireless local area networks [WLAN]}
- G06V 10/12: Details of acquisition arrangements; Constructional details thereof
- G06V 20/182: {Network patterns, e.g. roads or rivers}
- G08G 5/57: for unmanned aircraft
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present disclosure relates to the field of unmanned aerial vehicles (UAV), and discloses a gimbal control method, a controller, an unmanned aerial vehicle and an unmanned aerial vehicle inspection system. The gimbal control method, applied to a UAV, acquires inspection information about the UAV, including an observation flight leg, an observation interval corresponding to the observation flight leg, a total flight range corresponding to the observation interval and the current flight range. Then, the observation progress of the UAV is determined according to the current flight range and the total flight range. A first position, position of center point of the field of view of the nacelle of UAV, is determined according to the observation progress and the observation interval. Finally, the angle of the gimbal of the UAV is controlled according to the first position and the current position of the UAV.

## Claims

### Claim 1

A gimbal control method, applied to an unmanned aerial vehicle, comprising:
acquiring inspection information about the unmanned aerial vehicle, wherein the inspection information comprises an observation flight leg, an observation interval corresponding to the observation flight leg, a total flight range corresponding to the observation interval, and a current flight range, wherein the observation flight leg is a flight leg configured to inspect the observation interval by the unmanned aerial vehicle;
determining an observation progress of the unmanned aerial vehicle in response to the current flight range and the total flight range;
determining a first position according to the observation progress and the observation interval, wherein the first position is a target position of a center point of a field of view of a nacelle of the unmanned aerial vehicle;
controlling an angle of the gimbal of the unmanned aerial vehicle according to the first position and a current position of the unmanned aerial vehicle.

### Claim 2 (depends on 1)

The gimbal control method according to claim 1, wherein the determining the observation progress of the unmanned aerial vehicle in response to the current flight range and the total flight range comprises:
determining a flight progress of the unmanned aerial vehicle in response to the current flight range and the total flight range;
determining the observation progress of the unmanned aerial vehicle according to the flight progress.

### Claim 3 (depends on 2)

The gimbal control according to claim 2, wherein the determining the flight progress of the unmanned aerial vehicle in response to the current flight range and the total flight range comprises:
determining a first ratio of the current flight range to the total flight range as the flight progress of the unmanned aerial vehicle.

### Claim 4 (depends on 2)

The gimbal control method according to claim 2, wherein the determining the observation progress of the unmanned aerial vehicle according to the flight progress comprises:
determining a second ratio of the flight progress to a preset coefficient as the observation progress of the unmanned aerial vehicle, wherein the preset coefficient is less than or equal to 1.

### Claim 5 (depends on 1)

The gimbal control method according to claim 1, wherein the determining the first position in response to the observation progress and the observation interval comprises:
acquiring a starting point coordinate and an ending point coordinate of the observation interval;
determining a first unit vector pointing from a starting point of the observation interval to an ending point of the observation interval according to the starting point coordinate and the ending point coordinate;
calculating coordinates of the first position by the following formula:
P
=
s
+
vec
×
present
wherein P is the coordinate of the first position, s is the starting point coordinate, vec is the first unit vector and present is the observation progress.

### Claim 6 (depends on 1)

The gimbal control method according to claim 1, wherein the controlling an angle of the gimbal of the unmanned aerial vehicle according to the first position and the current position of the unmanned aerial vehicle comprises:
determining a second unit vector pointing from the current position of the unmanned aerial vehicle to the first position according to the coordinates of the first position and the coordinates of the current position of the unmanned aerial vehicle;
determining a pitch angle and a yaw angle of the gimbal according to the second unit vector;
controlling the angle of the gimbal according to the pitch angle and the yaw angle.

### Claim 7 (depends on 1)

The gimbal control method according to claim 1, wherein before acquiring the inspection information of the unmanned aerial vehicle, the gimbal control method further comprises:
acquiring a mapping relationship between the observation flight leg and the observation interval;
determining the observation interval corresponding to the observation flight leg according to the mapping relationship and the observation flight leg;
determining all of the observation flight legs associated with the observation interval based on the mapping relationship and the observation interval;
determining the sum of the flight range of all of the observation flight legs as the total flight range corresponding to the observation interval.

### Claim 8 (depends on 7)

The gimbal control method according to claim 7, further comprising:
acquiring a flight speed of the unmanned aerial vehicle in the observation flight leg;
calculating the current flight range corresponding to the observation interval by the following formula:
S
=
∫
0
t
Vdt
wherein S is the current flight range corresponding to the observation interval, t is the time from the start of observing the observation interval to the current position of the unmanned aerial vehicle, and V is the flight speed of the unmanned aerial vehicle.

### Claim 9 (depends on 8)

The gimbal control method according to claim 8, wherein the flight progress, the current flight range, and the observation progress of the unmanned aerial vehicle are recalculated from zero when the unmanned aerial vehicle observes a new observation interval.

### Claim 10 (depends on 2)

The gimbal control method according to claim 2, wherein when the unmanned aerial vehicle performs a temporary task, the gimbal control method further comprises:
when the unmanned aerial vehicle performs the temporary task in a current flight route, continuing to perform the step of determining the flight progress of the unmanned aerial vehicle in response to the current flight range and the total flight range until the temporary task ending;
when the unmanned aerial vehicle flies away from the current flight route to perform the temporary task, latching the flight progress of the current unmanned aerial vehicle until the temporary task ending.

### Claim 11

An unmanned aerial vehicle, comprising:
a gimbal and a controller, wherein the controller comprising:
at least one processor; and,
a memory communicatively connected to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor to enable the at least one processor to perform the gimbal control method;
wherein the gimbal control method comprising:
acquiring inspection information about the unmanned aerial vehicle, wherein the inspection information comprises an observation flight leg, an observation interval corresponding to the observation flight leg, a total flight range corresponding to the observation interval, and a current flight range, wherein the observation flight leg is a flight leg configured to inspect the observation interval by the unmanned aerial vehicle;
determining an observation progress of the unmanned aerial vehicle in response to the current flight range and the total flight range;
determining a first position according to the observation progress and the observation interval, wherein the first position is a target position of a center point of a field of view of a nacelle of the unmanned aerial vehicle;
controlling an angle of the gimbal of the unmanned aerial vehicle according to the first position and a current position of the unmanned aerial vehicle.

### Claim 12 (depends on 12)

The unmanned aerial vehicle according to claim 12, wherein the determining the observation progress of the unmanned aerial vehicle in response to the current flight range and the total flight range comprises:
determining a flight progress of the unmanned aerial vehicle in response to the current flight range and the total flight range;
determining the observation progress of the unmanned aerial vehicle according to the flight progress.

### Claim 13 (depends on 13)

The unmanned aerial vehicle according to claim 13, wherein the determining the flight progress of the unmanned aerial vehicle in response to the current flight range and the total flight range comprises:
determining a first ratio of the current flight range to the total flight range as the flight progress of the unmanned aerial vehicle.

### Claim 14 (depends on 13)

The unmanned aerial vehicle according to claim 13, wherein the determining the observation progress of the unmanned aerial vehicle according to the flight progress comprises:
determining a second ratio of the flight progress to a preset coefficient as the observation progress of the unmanned aerial vehicle, wherein the preset coefficient is less than or equal to 1.

### Claim 15 (depends on 11)

An unmanned aerial vehicle inspection system, comprising:
several ground monitoring stations and the unmanned aerial vehicle of claim 11;
the ground monitoring station is communicatively connected to the unmanned aerial vehicle, and the unmanned aerial vehicle is configured to inspect an observation interval on an observation moving line and transmit image information about the observation moving line and inspection information acquired during inspection to the ground monitoring station so that the ground monitoring station controls the unmanned aerial vehicle.
