# US 2025/0146847 A1 · Control method and device, aerial vehicle, movable platform, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0146847 A1
- Document ID: US20250146847A1
- Status: Published application
- Kind: A1
- Application number: 19/020,678
- Filed: 2025-01-14
- Published: 2025-05-08
- Earliest claimed: 2022-07-29
- Assignees: Sz Dji Technology Co., Ltd.
- Applicants: Sz Dji Technology Co., Ltd.
- Inventors: Bo WU; Siqi LIU; Yiteng XU
- Web page: https://patentgrep.com/patent/US20250146847A1

## CPC

- G01D 18/00: Testing or calibrating apparatus or arrangements provided for in groups G01D1/00 - G01D15/00
- B64C 27/08: with two or more rotors
- B64C 39/02: characterised by special use
- B64D 47/08: Arrangements of cameras
- B64U 10/13: Flying platforms
- B64U 10/14: with four distinct rotor axes, e.g. quadcopters
- B64U 20/87: Mounting of imaging devices, e.g. mounting of gimbals
- B64U 30/296: Rotors with variable spatial positions relative to the UAV body (foldable or collapsible rotors B64U30/293)
- G05D 1/243: Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals (using passive navigation aids external to the vehicle G05D1/244; using signals from positioning sensors located off-board the vehicle G05D1/249)
- G05D 1/498: {involving adjustment of the relative position of the centre of gravity of the vehicle}
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- B64U 2101/30: for imaging, photography or videography
- G05D 2109/254: {Flying platforms, e.g. multicopters}
- G05D 2111/10: Optical signals
- G01D: MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- B64C: AEROPLANES; HELICOPTERS
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A control method includes obtaining, in real time during operation of a movable platform, data of a plurality of sensors located at one or more arm assemblies of the movable platform, performing real-time calibration using the data to obtain a calibration result that characterizes a relative pose between the plurality of sensors, and performing movement control on the movable platform according to the calibration result.

## Claims

### Claim 1

A control method comprising:
obtaining, in real time during operation of a movable platform, data of a plurality of sensors located at one or more arm assemblies of the movable platform;
performing real-time calibration using the data to obtain a calibration result that characterizes a relative pose between the plurality of sensors; and
performing movement control on the movable platform according to the calibration result.

### Claim 2 (depends on 1)

The method according to claim 1, wherein:
obtaining, in real time during operation of the movable platform, the data of the plurality of sensors includes obtaining, in real time during a process of the one or more arm assemblies moving relative to a center body of the movable platform, the data of the plurality of sensors; and
the plurality of sensors are arranged such that the relative pose between the plurality of sensors is able to change during the process of the one or more arm assemblies moving relative to the center body.

### Claim 3 (depends on 1)

The method according to claim 1, wherein:
the one or more arm assemblies include two arm assemblies; and
the plurality of sensors include two vision sensors arranged at the two arm assemblies, respectively, and the calibration result characterizes a relative pose between the two vision sensors.

### Claim 4 (depends on 3)

The method according to claim 3, wherein:
the two vision sensors are two first vision sensors arranged at front ends of the two arm assemblies, respectively; and
the plurality of sensors further include two second vision sensors arranged at rear ends of the two arm assemblies, respectively, and the calibration result further characterizes a relative pose between the two second vision sensors.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the plurality of sensors include one or more of a vision sensor, a GPS sensor, an inertial sensor, an infrared sensor, a magnetic sensor, an ultrasonic sensor, or a Lidar sensor.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the plurality of sensors include a vision sensor, and the data includes image data obtained by the vision sensor.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the vision sensor includes a binocular vision sensor, and the data includes image data respectively obtained by vision sensors forming the binocular vision sensor.

### Claim 8 (depends on 7)

The method according to claim 7, wherein performing real-time calibration using the data includes performing real-time calibration on a relative pose parameter of the vision sensors forming the binocular vision sensor using the image data obtained in real time by the binocular vision sensor.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the image data obtained in real time by the binocular vision sensor includes an image sequence obtained frame by frame.

### Claim 10 (depends on 9)

The method according to claim 9, wherein:
performing real-time calibration to obtain the calibration result includes using epipolar constraint and depth constraint to determine the calibration result;
the epipolar constraint is based on current frames respectively obtained by the vision sensors of the binocular vision sensors; and
the depth constraint is based on a image sequence obtained frame by frame by at least one of the vision sensors of the binocular vision sensor.

### Claim 11 (depends on 7)

The method according to claim 7, wherein performing movement control on the movable platform includes:
correcting the image data according to the calibration result to obtain corrected image data; and
performing movement control on the movable platform according to the corrected image data.

### Claim 12 (depends on 1)

The method according to claim 1, wherein obtaining, in real time during operation of the movable platform, the data of the plurality of sensors includes obtaining, in real time during a process of a driver assembly of the movable platform driving the one or more arm assemblies to move relative to a center body of the movable platform, the data of the plurality of sensors.

### Claim 13 (depends on 1)

The method according to claim 1, further comprising, before performing real-time calibration:
obtaining, in real time during operation of the movable platform, theoretical pose data of the plurality of sensors;
wherein performing real-time calibration to obtain the calibration result includes gradually converging with the theoretical pose data as an initial value to determine the calibration result.

### Claim 14 (depends on 13)

The method according to claim 13, wherein the theoretical pose data is determined based on a real-time position of the one or more arm assemblies relative to a center body of the movable platform.

### Claim 15 (depends on 14)

The method according to claim 14, wherein:
the plurality of sensors are a plurality of first sensors;
the movable platform further includes one or more second sensors arranged at the one or more arm assemblies and/or the center body; and
the real-time position of the one or more arm assemblies is obtained by the one or more second sensors.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the one or more arm assemblies are configured to rotate relative to the center body, and the one or more second sensors include an angle detection sensor.

### Claim 17 (depends on 16)

The method according to claim 16, wherein the one or more second sensors include a Hall sensor.

### Claim 18 (depends on 1)

The method according to claim 1, wherein the movement control includes at least one of an obstacle avoidance operation, a path planning operation, or a target tracking operation.

### Claim 19

A control device comprising:
one or more memories storing one or more computer programs; and
one or more processors configured to execute the one or more computer programs to:
obtain, in real time during operation of a movable platform, data of a plurality of sensors located at one or more arm assemblies of the movable platform;
perform real-time calibration using the data to obtain a calibration result that characterizes a relative pose between the plurality of sensors; and
perform movement control on the movable platform according to the calibration result.

### Claim 20

An aerial vehicle comprising:
one or more arm assemblies;
a plurality of sensors located at the one or more arm assemblies; and
a control device including:
one or more memories storing one or more computer programs; and
one or more processors configured to execute the one or more computer programs to:
obtain, in real time during operation of the movable platform, data of the plurality of sensors;
perform real-time calibration using the data to obtain a calibration result that characterizes a relative pose between the plurality of sensors; and
perform movement control on the movable platform according to the calibration result.
