# US 12,117,826 B2 · Systems and methods for controlling an unmanned aerial vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,117,826 B2
- Document ID: US12117826B2
- Status: Granted
- Kind: B2
- Application number: 18/221,970
- Filed: 2023-07-14
- Published: 2024-04-11
- Granted: 2024-10-15
- Earliest claimed: 2015-12-22
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: Pablo Lema; Shu Ching Ip
- Web page: https://patentgrep.com/patent/US12117826B2

## CPC

- G05D 1/0016: {characterised by the operator's input device (input arrangements for computing systems in general G06F3/00)}
- B64C 39/024: {of the remote controlled vehicle type, i.e. RPV}
- B64U 10/14: with four distinct rotor axes, e.g. quadcopters
- G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target}
- G05D 1/223: Command input arrangements on the remote controller, e.g. joysticks or touch screens
- G05D 1/689: Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672)
- G06K 7/10: by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- B64U 10/13: Flying platforms
- B64U 2101/30: for imaging, photography or videography
- B64U 2201/20: Remote controls
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B64C: AEROPLANES; HELICOPTERS
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS

## Abstract

The present teachings provide a system including image sensors, remote controllers, and one or more physical processors. The image sensors are configured to generate output signals conveying visual information regarding the one or more images of one or more individuals. The remote controllers are configured to be worn by individuals, and the remote controllers are in communication with the image sensors to provide location information to the image sensors regarding a location of the individuals wearing the remote controllers. The one or more physical processors are configured by computer-readable instructions to recognize the remote controllers worn by the individuals. The one or more physical processors are configured to track the individuals based on the location of the remote controllers. The one or more physical processors are configured to control the image sensors to capture images of the individuals based upon the location of the remote controllers.

## Claims

### Claim 1

A system comprising:
image sensors configured to generate output signals conveying visual information, the visual information including one or more images of one or more individuals;
remote controllers configured to be worn by the one or more individuals, wherein the remote controllers are in communication with the image sensors to provide location information to the image sensors regarding a location of the remote controllers worn by the one or more individuals; and
one or more physical processors configured by computer-readable instructions to:
recognize the remote controllers worn by the one or more individuals;
track the one or more individuals based on the location of the remote controllers; and
control the image sensors to capture images of the one or more individuals based upon the location of the remote controllers.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
a controller interface physically in communication with the remote controllers, wherein information is sent from the remote controllers to the controller interface.

### Claim 3 (depends on 2)

The system of claim 2, wherein the controller interface is configured to:
control the image sensors through adjustments of any of aperture timing, exposure, focal length, angle of view, depth of field, focus, light metering, white balance, resolution, frame rate, object of focus, capture angle, a zoom parameter, video format, a sound parameter, and a compression parameter.

### Claim 4 (depends on 1)

The system of claim 1, wherein the remote controllers are physically independent from the image sensors.

### Claim 5 (depends on 1)

The system of claim 1, further comprising:
a sensor control subsystem that is configured to control the image sensors to capture the visual information including the images of the one or more individuals.

### Claim 6 (depends on 4)

The system of claim 4, wherein the one or more physical processors are configured to:
analyze patterns, positions, and/or movements of the one or more individuals.

### Claim 7 (depends on 1)

The system of claim 1, further comprising a pattern recognition component configured to:
recognize and/or interpret patterns of the one or more individuals wearing the remote controllers and to analyze the visual information captured by the image sensors.

### Claim 8 (depends on 7)

The system of claim 7, wherein the pattern recognition component provides a timestamp with the visual information captured by the image sensors so that the visual information can be processed subsequent to the visual information being captured based on the timestamp.

### Claim 9

A system comprising:
an image sensor configured to generate output signals conveying visual information captured by the image sensor;
a sensor control subsystem comprising:
a sensor control component configured to determine sensor parameters related to operation of the image sensor; and
one or more physical processors configured by computer-readable instructions to:
operate the sensor control subsystem based on the sensor parameters from the sensor control component; and
control the image sensor, based on the sensor parameters of the sensor control subsystem, so that the visual information captured by the image sensor includes an image of a particular object or individuals.

### Claim 10 (depends on 9)

The system of claim 9, wherein the sensor control subsystem, based on the sensor parameters, zooms the image sensor.

### Claim 11 (depends on 9)

The system of claim 9, further comprising:
remote controllers configured to be worn by the individuals, wherein the remote controllers are in communication with the image sensor to provide location information to the image sensor regarding a location of the individuals wearing the remote controllers.

### Claim 12 (depends on 11)

The system of claim 11, wherein the individuals wearing the remote controllers are tracked by the image sensor so that the individuals remain within the visual information being captured.

### Claim 13 (depends on 11)

The system of claim 11, wherein the remote controllers are configured to transmit information related to the sensor control information so that the image sensor captures the image of the particular object or the individuals related to the remote controllers.

### Claim 14 (depends on 11)

The system of claim 11, wherein the remote controllers are physically independent of the image sensor.

### Claim 15

A method comprising:
generating, with an image sensor, output signals conveying visual information that include images of one or more individuals;
determining, with a sensor control component of a sensor control subsystem, sensor parameters related to operation of the image sensor;
operating the sensor control subsystem based on the sensor parameters from the sensor control component; and
controlling the image sensor, based on the sensor parameters, to capture an image of a particular object or individual based on the visual information.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
zooming the image sensor based on the sensor parameters from the sensor control subsystem.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
providing location information, from remote controllers worn by the particular object or the individual, to the image sensor regarding a location of the particular object or the individual.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
tracking the remote controllers with the image sensor to maintain the particular object or the individual within the visual information being captured.

### Claim 19 (depends on 17)

The method of claim 17, wherein the remote controllers are physically independent of the image sensor.

### Claim 20 (depends on 15)

The method of claim 15, further comprising:
recognizing and/or interpreting patterns, with a pattern recognition component, of the particular object or the individual wearing remote controllers, and
analyzing the visual information captured by the image sensor with the pattern recognition component.
