# US 2015/0086078 A1 · Method for estimating ego motion of an object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0086078 A1
- Document ID: US20150086078A1
- Status: Published application
- Kind: A1
- Application number: 14/460,629
- Filed: 2014-08-15
- Published: 2015-03-26
- Earliest claimed: 2013-09-20
- Assignees: Application Solutions (Electronics and Vision) Ltd.
- Applicants: Application Solutions (Electronics and Vision) Ltd.
- Inventors: Alexander Sibiryakov
- Web page: https://patentgrep.com/patent/US20150086078A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/223: using block-matching
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/262: using transform domain methods, e.g. Fourier domain methods
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20056: Discrete and fast Fourier transform, [DFT, FFT]
- G06T 2207/20068: Projection on vertical or horizontal image axis
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for estimating ego motion of an object moving on a surface, the method including generating at least two composite top view images of the surface on the basis of video frames provided by at least one onboard video camera of the object moving on the surface; performing a region matching between consecutive top view images to extract global motion parameters of the moving object; calculating the ego motion of the moving object from the extracted global motion parameters of the moving object.

## Claims

### Claim 1

A method for estimating ego motion of an object moving on a surface,
the method comprising:
(a) generating at least two composite top view images of the surface on the basis of video frames provided by at least one onboard video camera of said object moving on said surface;
(b) performing a region matching between consecutive top view images to extract global motion parameters of said moving object;
(c) calculating the ego motion of said moving object from the extracted global motion parameters of said moving object.

### Claim 2 (depends on 1)

The method according to claim 1,
wherein said region matching between consecutive top view images comprises feature matching or block matching.

### Claim 3 (depends on 1)

The method according to claim 1,
wherein the top view images are processed by performing a 1D integral transformation to provide 1D integral images used for the region matching.

### Claim 4 (depends on 1)

The method according to claim 1,
wherein the extracted global motion parameters of said moving object comprise a translation and a rotation of the moving object.

### Claim 5 (depends on 1)

The method according to claim 1,
wherein a motion of a feature on a top view image is decomposed into a sum of a global translation vector estimated from a large top view region and a local translation vector estimated from a small region around the respective feature.

### Claim 6 (depends on 1)

The method according to claim 1,
wherein the top view image is formed by a metric top view image of the surface constructed by a regular grid with a predetermined distance between samples on the surface and by projecting each sample into a camera image to obtain a pixel value.

### Claim 7 (depends on 1)

The method according to claim 1,
wherein the global motion parameters are computed from a set of inliers provided by said region matching and selected by an estimator.

### Claim 8 (depends on 1)

The method according to claim 1,
wherein the object is formed by a vehicle moving on a flat surface.

### Claim 9

An apparatus for estimation of ego motion of an object moving on a surface comprising
at least one onboard video camera attached to said object adapted to provide video frames of the surface;
a generation unit adapted to generate composite top view images of the surface on the basis of video frames;
a region matching unit adapted to perform a region matching between consecutive top view images to extract global motion parameters of said moving object; and
a calculation unit adapted to calculate the ego motion of said moving object from the extracted global motion parameters of said moving object.

### Claim 10 (depends on 9)

The apparatus according to claim 9 further comprising a transformation unit adapted to perform a 1D integral transformation of the top view images to provide 1D integral images stored in a buffer to be used for the region matching by said region matching unit.

### Claim 11 (depends on 9)

The apparatus according to claim 9,
wherein the global motion parameters are computed from a set of inliers provided by said region matching performed by said region matching unit and selected by an estimator.

### Claim 12 (depends on 11)

The apparatus according to claim 11,
wherein the estimator is a RANSAC estimator.

### Claim 13 (depends on 9)

The apparatus according to claim 9,
wherein the onboard video cameras are monocular cameras.

### Claim 14 (depends on 9)

A vehicle moveable on a surface comprising an apparatus according to claim 9.

### Claim 15 (depends on 14)

The vehicle according to claim 14,
wherein the vehicle comprises a car moving on a road surface or a robot moving on a flat surface.
