# US 2015/0146990 A1 · Pattern extracting device, image projecting device, pattern extracting method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146990 A1
- Document ID: US20150146990A1
- Status: Published application
- Kind: A1
- Application number: 14/401,897
- Filed: 2013-05-16
- Published: 2015-05-28
- Earliest claimed: 2012-05-21
- Assignees: Ricoh Company, Ltd.
- Inventors: Yukinaka Uchiyama; Fumihiro Hasegawa
- Web page: https://patentgrep.com/patent/US20150146990A1

## CPC

- H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)}
- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06T 3/4007: based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403)
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 5/80: Geometric correction
- G06V 10/36: Applying a local operator, i.e. means to operate on image points situated in the vicinity of a given point; Non-linear local filtering operations, e.g. median filtering
- G06V 10/40: Extraction of image or video features
- G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
- G06V 10/993: {Evaluation of the quality of the acquired pattern}
- H04N 9/3194: {including sensor feedback}
- G01B 11/2504: {Calibration devices}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS

## Abstract

A pattern extracting device, an image projecting device, a pattern extracting method, and a program capable of extracting all the feature points by interpolating defective feature points even when there are defective feature points of an image pattern. The pattern extracting device extracts feature points to be interpolated based on a captured image of a projected image pattern, and interpolates the feature point to be interpolated by using near-by feature points that are located near the feature point, divides the near-by feature points into groups, calculates extrapolation coordinates of the groups, and calculates coordinates of the feature point to be interpolated in view of significance of the extrapolation.

## Claims

### Claim 1

A pattern extracting device for extracting an image pattern, the pattern extracting device comprising:
an interpolation target extraction unit configured to extract a feature point to be interpolated based on a captured image of a projected image pattern; and
an interpolation unit configured to interpolate the feature point to be interpolated by using near-by feature points which are located near the feature point to be interpolated.

### Claim 2 (depends on 1)

The pattern extracting device according to claim 1,
wherein the interpolation unit is configured to divide the near-by feature points into groups, calculate extrapolation coordinates of the groups, and calculate coordinates of the feature point to be interpolated in view of significance of the extrapolation.

### Claim 3 (depends on 1)

The pattern extracting device according to claim 1, further comprising:
an update unit configured to update status information which indicates a status of the feature points,
wherein the interpolation target extraction unit is configured to extract the feature point by using the status information.

### Claim 4 (depends on 1)

The pattern extracting device according to claim 1, further comprising:
a confidence rating calculation unit configured to calculate a confidence rating of the interpolation that is executed by the interpolation unit.

### Claim 5 (depends on 1)

The pattern extracting device according to claim 1,
wherein the interpolation unit is configured to repeatedly perform the interpolation on the feature point to be interpolated.

### Claim 6 (depends on 1)

The pattern extracting device according to claim 1,
wherein the interpolation unit is configured to calculate coordinates of a defective feature point, which is included in an image pattern to be projected and is to be interpolated, by using coordinates of a feature point that is included in an image pattern to be projected and that corresponds to the defective feature point that is the feature point to be interpolated, coordinates of feature points that are included in the image pattern to be projected and that is located near the feature point corresponding to the defective feature point, and coordinates of near-by feature points locating near the defective feature point.

### Claim 7 (depends on 1)

The pattern extracting device according to claim 1,
wherein the interpolation target extraction unit is configured to extract the feature point to be interpolated by using a plurality of the captured images of the projected image pattern.

### Claim 8 (depends on 1)

The pattern extracting device according to claim 1,
wherein the interpolation target extraction unit and the interpolation unit are configured to perform the processes on each of a plurality of the captured images of the projected image pattern, and
wherein the pattern extracting device further includes a correction unit that is configured to correct at least one of the coordinates of the feature point to be interpolated and coordinates of feature points included in the captured image by using at least one of the coordinates of the feature points included in the captured image and the coordinates of the feature points calculated by the interpolation unit.

### Claim 9 (depends on 1)

The pattern extracting device according to claim 1,
wherein the interpolation unit is configured to set feature points, which are located within a range of a predetermined distance from the feature point to be interpolated, as the near-by feature points.

### Claim 10 (depends on 1)

An image projecting device comprising the pattern extracting device according to claim 1.

### Claim 11

A pattern extracting method executed by a pattern extracting device, the pattern extracting method comprising:
a step of extracting a feature point to be interpolated based on a captured image of a projected image pattern; and
a step of interpolating the feature point to be interpolated by using near-by feature points which are located near the feature point to be interpolated.

### Claim 12 (depends on 11)

The pattern extracting method according to claim 11,
wherein in the step of interpolating, the near-by feature points are divided into groups, extrapolation coordinates of the groups are calculated, and coordinates of the feature point to be interpolated is calculated in view of significance of the extrapolation.

### Claim 13 (depends on 11)

The pattern extracting method according to claim 11, further comprising:
a step of updating status information which indicates a status of the feature points,
wherein in the step of extracting, the feature point is extracted by using the status information.

### Claim 14 (depends on 11)

The pattern extracting method according to claim 11, further comprising:
a step of calculating a confidence rating of the interpolation.

### Claim 15 (depends on 11)

The pattern extracting method according to claim 11,
wherein in the step of interpolating the interpolation is repeatedly performed on the feature point to be interpolated.

### Claim 16 (depends on 11)

The pattern extracting method according to claim 11,
wherein in the step of interpolating, the coordinates of a defective feature point, which is included in an image pattern to be projected and is to be interpolated, are calculated by using coordinates of a feature point that is included in the image pattern to be projected and that corresponds to the defective feature point that is the feature point to be interpolated, coordinates of feature points that are included in the image pattern to be projected and that are located near the feature point corresponding to the defective feature point, and coordinates of near-by feature points locating near the defective feature point.

### Claim 17 (depends on 11)

The pattern extracting method according to claim 11,
wherein in the step of extracting, the feature point to be interpolated is extracted by using a plurality of the captured images of the projected image pattern.

### Claim 18 (depends on 11)

The pattern extracting method according to claim 11,
wherein the steps of extracting and interpolating are performed on each of a plurality of the captured image of the projected image pattern, and
wherein the pattern extracting method further includes a step of correcting in which at least one of the coordinates of the feature point to be interpolated and coordinates of feature points included in the captured image is corrected by using at least one of the coordinates of the feature points included in the captured image and the coordinates of the feature points calculated in the step of interpolating.

### Claim 19 (depends on 11)

The pattern extracting method according to claim 11,
wherein in the step of interpolating, feature points, which are located within a range of a predetermined distance from the feature point to be interpolated, are set as the near-by feature points.

### Claim 20 (depends on 11)

A non-transitory computer readable medium including a program causing a pattern extracting device to execute the pattern executing method according to claim 11.
