# US 2013/0156262 A1 · Voting-Based Pose Estimation for 3D Sensors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156262 A1
- Document ID: US20130156262A1
- Status: Published application
- Kind: A1
- Application number: 13/329,493
- Filed: 2011-12-19
- Published: 2013-06-20
- Earliest claimed: 2011-12-19
- Assignees: Mitsubishi Electric Research Laboratories, Inc.
- Inventors: Yuichi Taguchi; Oncel Tuzel; Srikumar Ramalingam; Changhyun Choi; Ming-Yu Liu
- Web page: https://patentgrep.com/patent/US20130156262A1

## CPC

- G06T 7/75: {involving models}
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 2207/30108: Industrial image inspection
- G06T 2207/30164: Workpiece; Machine component
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A pose of an object is estimated by first defining a set of pair features as pairs of geometric primitives, wherein the geometric primitives include oriented surface points, oriented boundary points, and boundary line segments. Model pair features are determined based on the set of pair features for a model of the object. Scene pair features are determined based on the set of pair features from data acquired by a 3D sensor, and then the model pair features are matched with the scene pair features to estimate the pose of the object.

## Claims

### Claim 1

A method for estimating a pose of an object, comprising the steps of:
defining a set of pair features as pairs of geometric primitives, wherein the geometric primitives include oriented surface points, oriented boundary points, and boundary line segments;
determining model pair features based on the set of pair features for a model of the object;
determining scene pair features based on the set of pair features from data acquired by a 3D sensor; and
matching the model pair features with the scene pair features to estimate the pose of the object, wherein the steps are performed in a processor.

### Claim 2 (depends on 1)

The method of claim 1, wherein the object is one of a plurality of different object randomly commingled with other objects, and there are model pair features for each object.

### Claim 3 (depends on 1)

The method of claim 1, wherein the 3D sensor is mounted on a robotic arm, and the robotic arm includes a gripper to pick the object according to the pose.

### Claim 4 (depends on 1)

The method of claim 1, wherein the 3D sensor uses structured light generated by an infrared laser.

### Claim 5 (depends on 1)

The method of claim 1, wherein each pair feature is defined using two oriented surface points, two oriented boundary points, one oriented surface point and one oriented boundary point, and two boundary line segments.

### Claim 6 (depends on 1)

The method of claim 1, wherein each oriented surface point comprises a 3D position on a surface of the object and a 3D normal vector.

### Claim 7 (depends on 1)

The method of claim 1, wherein each oriented boundary point comprises a 3D position on a boundary of the object and a 3D direction vector.

### Claim 8 (depends on 7)

The method of claim 7, wherein the 3D direction vector is defined as a direction tangent to the boundary at the 3D position.

### Claim 9 (depends on 1)

The method of claim 1, wherein each boundary line segment is a line segment fitted to 3D points on a boundary of the object.

### Claim 10 (depends on 1)

The method of claim 1, wherein a descriptor is determined from each pair feature.

### Claim 11 (depends on 10)

The method of claims 10, wherein the matching is performed by comparing the descriptors of the model pair features and the descriptors of the scene pair features.

### Claim 12 (depends on 11)

The method of claims 11, further comprising:
discretizing the descriptors for the pair features;
storing the discretized descriptors of the model pair features in a hash table; and
performing the matching using the hash table.

### Claim 13 (depends on 1)

The method of claim 1, wherein candidate poses of the object are estimated based on voting via an intermediate coordinate transformation.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
clustering the candidate poses.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
refining the pose using an iterative-closest point procedure.
