# US 2022/0044434 A1 · Device, method and system for determining flight height of unmanned aerial vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044434 A1
- Document ID: US20220044434A1
- Status: Published application
- Kind: A1
- Application number: 17/159,676
- Filed: 2021-01-27
- Published: 2022-02-10
- Earliest claimed: 2020-08-10
- Assignees: Zhejiang University
- Applicants: Zhejiang University
- Inventors: Yong HE; Liwen HE; Bingquan CHU
- Web page: https://patentgrep.com/patent/US20220044434A1

## CPC

- G06T 7/60: Analysis of geometric attributes
- B64U 20/87: Mounting of imaging devices, e.g. mounting of gimbals
- G01C 5/02: involving automatic stabilisation of the line of sight
- G01C 11/06: by comparison of two or more pictures of the same area
- G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target}
- G05D 1/0646: {to follow the profile of undulating ground}
- G05D 1/101: {specially adapted for aircraft}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/73: using feature-based methods
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/188: {Vegetation}
- B64U 2101/30: for imaging, photography or videography
- B64U 2101/40: for agriculture or forestry operations
- B64U 2201/104: using satellite radio beacon positioning systems, e.g. GPS
- G06T 2207/10032: Satellite or aerial image; Remote sensing
- G06T 2207/30188: Vegetation; Agriculture
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and system for determining flight height of an unmanned aerial vehicle (UAV) includes a determining device that includes a camera at bottom of the is UAV carried on a three-axis self-stabilizing tripod head; and a carrier phase difference satellite positioning system (CPDSPS), a graphics processing computer (GPC) and a power supply system provided on top of the UAV The GPC is connected with the CPDSPS, the power supply system and the camera, respectively. An attitude and heading reference system (AHRS) is provided at the bottom of the three-axis self-stabilizing tripod head and connected with the GPC The GPC is configured to determine relative height of the UAV from a canopy of farmland surface crops according to position information acquired by the CPDSPS, attitude information acquired by the AHRS and ground orthographic image acquired by the camera, and determine flight height of the UAV according to the relative height.

## Claims

### Claim 1

A device for determining the flight height of an unmanned aerial vehicle, comprising:
an unmanned aerial vehicle;
a three-axis self-stabilizing tripod head;
a carrier phase difference satellite positioning system;
an attitude and heading reference system;
a graphics processing computer; and
a power supply system, wherein;
a camera at the bottom of the unmanned aerial vehicle is carried on the three-axis self-stabilizing tripod head, and the three-axis self-stabilizing tripod head is used to maintain an optical axis of the camera;
the carrier phase difference satellite positioning system, the graphics processing computer and the power supply system are all provided on top of the unmanned aerial vehicle;
the graphic processing computer is connected with the carrier phase difference satellite positioning system, the power supply system and the camera, respectively;
the attitude and heading reference system is provided at bottom of the three-axis self-stabilizing tripod head and is connected with the graphics processing computer;
the graphic processing computer is configured to determine a relative height of the unmanned aerial vehicle from a canopy of farmland surface crops according to position information acquired by the carrier phase difference satellite positioning system, attitude information acquired by the attitude and heading reference system and a ground orthographic image acquired by the camera, and determine the flight height of the unmanned aerial vehicle according to the relative height.

### Claim 2 (depends on 1)

The device for determining the flight height of an unmanned aerial vehicle according to claim 1, wherein the camera is a high-resolution visible light camera.

### Claim 3 (depends on 1)

A method for determining the flight height of an unmanned aerial vehicle, wherein the determining method is applied to the device for determining the flight height of an unmanned aerial vehicle according to claim 1, and the determining method comprises:
acquiring a plurality of ground orthographic images in an agricultural operation area and position data and attitude data of an unmanned aerial vehicle at time of acquiring the plurality of ground orthographic images;
constructing a Gaussian difference pyramid according to pixel points in any two adjacent ground orthographic images;
determining feature points in any two adjacent ground orthographic images according to the Gaussian difference pyramid;
matching the feature points in two adjacent ground orthographic images to determine a matching feature point pair;
determining a position of the matching feature point pair in space according to the matching feature point pair;
determining the position of the unmanned aerial vehicle in space according to the position data and attitude data of the unmanned aerial vehicle;
determining the relative height of the unmanned aerial vehicle from the canopy of farmland surface crops according to the position of the unmanned aerial vehicle in space and the position of the matching feature point pair in space; and
determining the flight height of the unmanned aerial vehicle according to the relative height.

### Claim 4 (depends on 3)

The method for determining the flight height of an unmanned aerial vehicle according to claim 3, wherein prior to constructing a Gaussian difference pyramid according to pixel points in any two adjacent ground orthographic images, the method further comprises:
calibrating pixel points in the ground orthographic image by using formulas xcorrected=x(1+k1r2+k2r4+k3r6), ycorrected=y(1+k1r2+k2r4+k3r6), xcorrected=x+[2p1xy+p2(r2+2x2)] and ycorrected=y+[p1(r2+2y2)+2p2xy];
wherein k1, k2, and k3 are radial distortion factors, p1 and p2 are tangential distortion factors, x and y are pixel point coordinates, xcorrected and ycorrected are the coordinates of the calibrated pixel points, and r is the distance from the pixel point to the image center point.

### Claim 5 (depends on 3)

The method for determining the flight height of an unmanned aerial vehicle according to claim 3, wherein matching the feature points in two adjacent ground orthographic images to determine a matching feature point pair specifically comprises:
constructing a feature description vector corresponding to each feature point according to the feature points in the ground orthographic image;
determining a Euclidean distance between the feature points in one ground orthographic image and the feature points in another ground orthographic image according to the feature description vector corresponding to each feature point;
taking the feature point pair whose Euclidean distance is less than the distance threshold as the matching feature point pair, wherein the matching feature point pair comprises two feature points and is located in different ground orthographic images.

### Claim 6

A system for determining the flight height of an unmanned aerial vehicle, comprising:
a data acquiring module configured to acquire a plurality of ground orthographic images in an agricultural operation area and position data and attitude data of an unmanned aerial vehicle at time of acquiring the plurality of ground orthographic images;
a Gaussian difference pyramid constructing module configured to construct a Gaussian difference pyramid according to pixel points in any two adjacent ground orthographic images;
a feature point determining module configured to determine the feature points in any two adjacent ground orthographic images according to the Gaussian difference pyramid;
a matching feature point pair determining module configured to match the feature points in two adjacent ground orthographic images to determine a matching feature point pair;
a position determining module of a matching feature point pair in space configured to determine the position of the matching feature point pair in space according to the matching feature point pair;
a position determining module of an unmanned aerial vehicle in space configured to determine the position of the unmanned aerial vehicle in space according to the position data and attitude data of the unmanned aerial vehicle;
a relative height determining module configured to determine the relative height of the unmanned aerial vehicle from a canopy of farmland surface crops according to the position of the unmanned aerial vehicle in space and the position of the matching feature point pair in space;
a flight height determining module configured to determine the flight height of the unmanned aerial vehicle according to the relative height.

### Claim 7 (depends on 6)

The system for determining the flight height of an unmanned aerial vehicle according to claim 6, further comprising:
a pixel point calibrating module configured to calibrate pixel points in the ground orthographic image by using formulas xcorrected=x(1+k1r2+k2r4+k3r6), ycorrected=y(1+k1r2+k2r4+k3r6), xcorrected=x+[2p1xy+p2(r2+2x2)] and ycorrected=y+[p1(r2+2y2)+2p2xy];
wherein k1, k2, and k3 are radial distortion factors, p1 and p2 are tangential distortion factors, x and y are pixel point coordinates, xcorrected and ycorrected are the coordinates of the calibrated pixel points, and r is the distance from the pixel point to the image center point.

### Claim 8 (depends on 6)

The system for determining the flight height of an unmanned aerial vehicle according to claim 6, wherein the matching feature point pair determining module specifically comprises:
a feature description vector constructing unit configured to construct a feature description vector corresponding to each feature point according to the feature points in the ground orthographic image;
an Euclidean distance determining unit configured to determine the Euclidean distance between the feature points in one ground orthographic image and the feature points in another ground orthographic image according to the feature description vector corresponding to each feature point;
a matching feature point pair determining unit configured to take the feature point pair whose Euclidean distance is less than the distance threshold as the matching feature point pair, wherein the matching feature point pair comprises two feature points and is located in different ground orthographic images.

### Claim 9 (depends on 3)

The method for determining the flight height of an unmanned aerial vehicle according to claim 3, wherein the camera is a high-resolution visible light camera.

### Claim 10 (depends on 2)

A method for determining the flight height of an unmanned aerial vehicle, wherein the determining method is applied to the device for determining the flight height of an unmanned aerial vehicle according to claim 2, and the determining method comprises:
acquiring a plurality of ground orthographic images in an agricultural operation area and the position data and attitude data of an unmanned aerial vehicle at the time of acquiring the plurality of ground orthographic images;
constructing a Gaussian difference pyramid according to pixel points in any two adjacent ground orthographic images;
determining the feature points in any two adjacent ground orthographic images according to the Gaussian difference pyramid;
matching the feature points in two adjacent ground orthographic images to determine a matching feature point pair;
determining the position of the matching feature point pair in space according to the matching feature point pair;
determining the position of the unmanned aerial vehicle in space according to the position data and attitude data of the unmanned aerial vehicle;
determining the relative height of the unmanned aerial vehicle from the canopy of farmland surface crops according to the position of the unmanned aerial vehicle in space and the position of the matching feature point pair in space;
determining the flight height of the unmanned aerial vehicle according to the relative height.

### Claim 11 (depends on 10)

The method for determining the flight height of an unmanned aerial vehicle according to claim 10, wherein prior to constructing a Gaussian difference pyramid according to pixel points in any two adjacent ground orthographic images, the method further comprises:
calibrating pixel points in the ground orthographic image by using formulas xcorrected=x(1+k1r2+k2r4+k3r6), ycorrected=y(1+k1r2+k2r4+k3r6), xcorrected=x+[2p1xy+p2(r2+2x2)] and ycorrected=y+[p1(r2+2y2)+2p2xy];
wherein k1, k2, and k3 are radial distortion factors, p1 and p2 are tangential distortion factors, x and y are pixel point coordinates, xcorrected and ycorrected are the coordinates of the calibrated pixel points, and r is the distance from the pixel point to the image center point.

### Claim 12 (depends on 10)

The method for determining the flight height of an unmanned aerial vehicle according to claim 10, wherein matching the feature points in two adjacent ground orthographic images to determine a matching feature point pair specifically comprises:
constructing a feature description vector corresponding to each feature point according to the feature points in the ground orthographic image;
determining a Euclidean distance between the feature points in one ground orthographic image and the feature points in another ground orthographic image according to the feature description vector corresponding to each feature point;
taking the feature point pair whose Euclidean distance is less than the distance threshold as the matching feature point pair, wherein the matching feature point pair comprises two feature points and is located in different ground orthographic images.
