# US 2011/0235916 A1 · Determining Points of Parabolic Curvature on Surfaces of Specular Objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2011/0235916 A1
- Document ID: US20110235916A1
- Status: Published application
- Kind: A1
- Application number: 12/730,279
- Filed: 2010-03-24
- Published: 2011-09-29
- Earliest claimed: 2010-03-24
- Assignees: Mitsubishi Electric Research Laboratories, Inc.
- Inventors: Ashok Veeraraghavan; Oncel C. Tuzel; Aswin Sankaranarayanan; Amit K. Agrawal
- Web page: https://patentgrep.com/patent/US20110235916A1

## CPC

- G06T 7/64: of convexity or concavity
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06T 2207/10016: Video; Image sequence
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Embodiments of the invention disclose a system and a method for determining points of parabolic curvature on a surface of a specular object from a set of images of the object is acquired by a camera under a relative motion between a camera-object pair and the environment. The method determines directions of image gradients at each pixel of each image in the set of images, wherein pixels from different images corresponding to an identical point on the surface of the object form corresponding pixels. The corresponding pixels having substantially constant the direction of the image gradients are selected as pixels representing points of the parabolic curvature.

## Claims

### Claim 1

A method for determining points of parabolic curvature on a surface of an object arranged in an environment, wherein the object is specular, comprising the steps of:
obtaining a set of images of the object acquired by a camera under a relative motion between a camera-object pair and the environment;
determining directions of image gradients at each pixel of each image in the set of images, wherein pixels from different images corresponding to an identical point on the surface of the object form corresponding pixels; and
selecting the corresponding pixels having substantially constant the directions of the image gradients as pixels representing points of the parabolic curvature, wherein the steps of the method are performed by a processor.

### Claim 2 (depends on 1)

The method of claim 1, wherein the surface at the points of the parabolic curvature curves only in one direction.

### Claim 3 (depends on 1)

The method of claim 1, wherein a relative pose between the camera and the object is preserved during the relative motion.

### Claim 4 (depends on 1)

The method of claim 1, wherein the relative motion between the camera-object pair and the environment is achieved by moving arbitrarily at least one of the camera-object pair and the environment.

### Claim 5 (depends on 1)

The method of claim 1, wherein different corresponding pixels having the substantially constant directions of the image gradients represent different points of the parabolic curvature.

### Claim 6 (depends on 1)

The method of claim 1, wherein the surface is twice continuously differentiable.

### Claim 7 (depends on 1)

The method of claim 1, wherein the camera is an orthographic camera.

### Claim 8 (depends on 1)

The method of claim 1, wherein the environment is set at infinity, such that the environment observed by the camera depends only on the image gradients.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
determining a gradient autocorrelation matrix M(x) according to
M

(
x
)
=
∑
j

∇
x

I
j

(
x
)

∇
x

I
j

(
x
)
T
,
wherein j indexes of the images in the set of images {Ij}, ∇xI is the image gradient, I(x) is an intensity at a pixel x, and T is a transpose operator.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
repeating the selecting to determine all the points of the parabolic curvature.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
determining a pose of the object based on the points of the parabolic curvature.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
acquiring templates of parabolic curvatures determined by rotating the points of the parabolic curvature; and
determining an optimal transformation parameters aligning the templates with points of the parabolic curvature.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
determining similarities between the templates and the points of the parabolic curvatures using a chamfer matching technique.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
refining an estimation of the pose using a Gauss-Newton optimization.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
determining a type of the object based on the points of parabolic curvature.

### Claim 16

A system for determining points of parabolic curvature on a surface of an object arranged in an environment, wherein the object is a specular object, comprising:
a camera-object pair configured to acquire a set of images of the object under a relative motion between a camera-object pair and the environment; and
a processor configured to determine directions of image gradients at each pixel of each image in the set of images, wherein pixels from different images corresponding to an identical point on the surface of the object forms corresponding pixels, wherein the processor selects the corresponding pixels having substantially constant the directions of the image gradients as pixels representing a point of the parabolic curvature.

### Claim 17 (depends on 16)

The system of claim 16, wherein the relative motion between the camera-object pair and the environment is achieved by moving arbitrarily at least one of the camera-object pair and the environment.

### Claim 18 (depends on 16)

The system of claim 16, further comprising:
determining a pose of the object based on the points of the parabolic curvature.

### Claim 19 (depends on 16)

The system of claim 16, further comprising:
determining a type of the object based on the points of parabolic curvature.

### Claim 20 (depends on 16)

The system of claim 16, wherein the surface at the points of the parabolic curvature curves only in one direction.
