# US 2012/0249774 A1 · Imaging based stabilization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249774 A1
- Document ID: US20120249774A1
- Status: Published application
- Kind: A1
- Application number: 13/079,106
- Filed: 2011-04-04
- Published: 2012-10-04
- Earliest claimed: 2011-04-04
- Assignees: CyPhy Works, Inc.
- Inventors: Samuel A. Johnson; Helen Greiner; Andrew Shein
- Web page: https://patentgrep.com/patent/US20120249774A1

## CPC

- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G06T 7/75: {involving models}
- B64C 1/00: Fuselages; Constructional features common to fuselages, wings, stabilising surfaces or the like
- G06T 2207/30244: Camera pose
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B64C: AEROPLANES; HELICOPTERS

## Abstract

An image-based sensor system for a mobile unit makes use of light emitters and imagers to acquire illumination patterns of emitted light impinging on the floor and/or walls surrounding the unit. The illumination pattern is used to estimate location and/or orientation of the unit. These estimates are used for one or more functions of stabilization, calibration, localization, and mapping of or with respect to the unit.

## Claims

### Claim 1

An apparatus comprising mobile part, the mobile part comprising:
a first light emitter for forming a first light emission comprising a plurality of emitted rays on a cone or cylinder that is symmetrical about a central axis of the mobile part; and
a first imager for acquiring images from a point of view along the central axis showing an illumination pattern at intersections of the emitted rays and a first surface upon which the first light emission impinges;
wherein the apparatus further includes a first estimator for processing the acquired images and using the acquired images to determine at least one of (a) an orientation of the central axis of the apparatus with respect to the first surface, and (b) a distance from the surface along the central axis.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the mobile part comprises an aerial vehicle, and wherein the apparatus further comprises a module configured to be responsive to the determined orientation and/or distance to perform at least one function from a group of functions consisting of stabilization, calibration, localization, and mapping.

### Claim 3 (depends on 2)

The apparatus of claim 2 wherein the module responsive to the determined orientation and/or distance comprises a control system configured to generate control signals for flight controls of the aerial vehicle.

### Claim 4 (depends on 3)

The apparatus of claim 3 wherein the control system is configured to be responsive to the determined orientation to stabilize an orientation of the vehicle.

### Claim 5 (depends on 3)

The apparatus of claim 3 wherein the control system is configured to be responsive to the determined distance to stabilize an altitude of the vehicle above the surface.

### Claim 6 (depends on 1)

The apparatus of claim 1 wherein the first light emitter comprises a plurality of optical elements disposed at a fixed radius perpendicular from a point on the central axis.

### Claim 7 (depends on 6)

The apparatus of claim 6 wherein the plurality of optical elements comprise a plurality of laser light sources.

### Claim 8 (depends on 6)

The apparatus of claim 6 wherein the plurality of optical elements comprise a plurality reflectors, and the first light emitter further comprises a laser light source configured to reflect rays off the plurality of reflectors to form the first light emission.

### Claim 9 (depends on 1)

The apparatus of claim 1 wherein the estimator is configured to determine the orientation according to an eccentricity of the illumination pattern.

### Claim 10 (depends on 1)

The apparatus of claim 1 wherein the estimator is configured to determine the distance according to a size of the illumination pattern.

### Claim 11 (depends on 1)

The apparatus of claim 1 wherein the first light emitter comprises a reflector configured to rotate about the central axis, and a laser light source configured to reflect a ray off the rotating mirror to form the rays on the cone that is symmetrical about the central axis.

### Claim 12 (depends on 11)

The apparatus of claim 11 wherein the mobile part comprises an aerial vehicle having a propeller assembly configured to rotate about the central axis to provide lift for the aerial vehicle, and wherein the reflector is coupled to the propeller assembly to rotate with the rotation of the propeller assembly.

### Claim 13 (depends on 1)

The apparatus of claim 1 wherein the mobile part further comprises:
a second light emitter for forming a second light emission comprising a plurality of emitted rays from the central axis of the mobile part; and
a second imager for acquiring images showing an illumination pattern at intersections of the emitted rays of the second light emission and one or more second surfaces upon which the second light emission impinges;
wherein the apparatus comprises a second estimator for processing the acquired images for the second imager and using the acquired images to determine a location of the mobile part relative to the one or more second surfaces.

### Claim 14 (depends on 13)

The apparatus of claim 13 wherein the rays of the second emission are on a plane that is perpendicular to the central axis of the mobile part.

### Claim 15 (depends on 14)

The apparatus of claim 14 wherein the second imager acquires images from one or more points of view that are displaced in the direction of the central axis from the plane of the rays of the second light emission.

### Claim 16 (depends on 15)

The apparatus of claim 15 wherein the estimator is configured to determine the location relative to the surface according to a displacement of the displacement in the images acquired by the second imager of the illumination pattern in a direction corresponding to the central axis.

### Claim 17 (depends on 13)

The apparatus of claim 13 wherein the second imager comprises a plurality of imagers disposed about the periphery of the mobile part, and wherein the second imager is configured to combine the images of the plurality of imagers to form an imaging including all directions extending from the central axis.

### Claim 18 (depends on 13)

The apparatus of claim 13 wherein the second estimator is configured to be responsive to the location to perform at least one function from a group of functions consisting of stabilization, calibration, localization, and mapping.

### Claim 19 (depends on 1)

The method of claim 1 wherein the first estimator is implemented in the mobile part of the apparatus.

### Claim 20 (depends on 1)

The method of claim 1 wherein the mobile part comprises an aerial vehicle that is tethered to a control station, and wherein the first estimator is implemented at least in part at the control station.

### Claim 21

A method for calibrating a image-guided apparatus, comprising:
placing the apparatus in a calibration unit, the calibration unit having a substantially cylindrical inner surface, the apparatus being placed to align a central axis of the apparatus with the central axis of the cylinder;
emitting a light emission from a light emitter affixed to the apparatus, the light emission comprising rays in a symmetrical pattern about the central axis, the rays impinging on the inner surface of the cylinder;
acquiring images from an imager affixed to the apparatus, the images showing an illumination pattern at intersections of the emitted rays and the inner surface of the cylinder; and
calibrating an estimator of the apparatus according to known dimensions of the calibration unit and the illumination pattern.
