# US 10,769,401 B2 · Image recognition device, image recognition method and image recognition unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,401 B2
- Document ID: US10769401B2
- Status: Granted
- Kind: B2
- Application number: 16/069,463
- Filed: 2017-01-11
- Published: 2019-01-17
- Granted: 2020-09-08
- Earliest claimed: 2016-01-14
- Assignees: Seiko Epson Corporation
- Applicants: Seiko Epson Corporation
- Inventors: Taisuke Yamauchi
- Web page: https://patentgrep.com/patent/US10769401B2

## CPC

- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G01B 11/2545: {with one projection direction and several detection directions, e.g. stereo}
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings
- G06V 40/1306: {non-optical, e.g. ultrasonic or capacitive sensing}
- G06V 40/1335: {Combining adjacent partial images (e.g. slices) to create a composite input or reference pattern; Tracking a sweeping finger movement}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image recognition device, an image recognition method and an image recognition unit are capable of performing touch recognition high in accuracy. The image recognition device includes a measurement point determination section adapted to determine a fingertip from an image obtained by a camera, a pattern display section adapted to make a projector display a first pattern having a first linear pattern varying in luminance with a first pitch along a direction parallel to an epipolar line passing through the fingertip, and a second linear pattern varying in luminance with a second pitch along a direction parallel to the epipolar line, and a position detection section adapted to perform touch recognition based on a variation of the first pattern from the image including the first pattern.

## Claims

### Claim 1

An image recognition device used in an image display unit including an imaging device adapted to image an image display surface, and a detecting image display device adapted to display a detecting image on the image display surface, the image recognition device comprising:
a pattern display section adapted to make the detecting image display device display a first pattern having a first linear pattern varying in luminance with a first pitch along a direction parallel to an epipolar line determined from a positional relationship between the imaging device and the detecting image display device, and a second linear pattern varying in luminance with a second pitch different from the first pitch along a direction parallel to the epipolar line;
a measurement point determination section adapted to detect an object located between the imaging device and the image display surface to determine a measurement target point of the object; and
a position detection section adapted to detect a position of the measurement target point with respect to the image display surface based on an image including the measurement target point and the first pattern obtained by the imaging device, wherein
the first linear pattern and the second linear pattern are displayed simultaneously.

### Claim 2 (depends on 1)

The image recognition device according to claim 1, wherein
the second pitch is shorter than twice the first pitch.

### Claim 3 (depends on 1)

The image recognition device according to claim 1, wherein
the first pattern is divided into a plurality of regions having a third pitch along a direction parallel to the epipolar line, and an address used to identify a position is assigned to each of the plurality of regions.

### Claim 4 (depends on 1)

An image recognition unit comprising:
the image recognition device according to claim 1;
the imaging device; and
the detecting image display device.

### Claim 5 (depends on 3)

The image recognition device according to claim 3, wherein
the third pitch is equal to a lowest common multiple of the first pitch and the second pitch.

### Claim 6 (depends on 3)

The image recognition device according to claim 3, wherein
the pattern display section makes the detecting image display device display a second pattern having a linear shape along the epipolar line passing through the measurement target point except the region in which the measurement target point is located.

### Claim 7 (depends on 3)

The image recognition device according to claim 3, wherein
the pattern display section makes the detecting image display device display a second pattern straddling the region in which the measurement target point is located and two regions adjacent to the region in which the measurement target point is located.

### Claim 8 (depends on 3)

The image recognition device according to claim 3, wherein
the pattern display section makes the detecting image display device display a second pattern having a linear pattern along a direction parallel to the epipolar line, wherein the linear pattern is disposed in the plurality of regions adjacent to each other so as to be shifted from each other in a direction crossing the epipolar line.

### Claim 9 (depends on 4)

The image recognition unit according to claim 4, comprising:
an image display device adapted to display an image on the image display surface.

### Claim 10

An image recognition method used in an image display unit including an imaging device adapted to image an image display surface, and a detecting image display device adapted to display a detecting image on the image display surface, the image recognition method comprising:
making the detecting image display device display a first pattern having a first linear pattern varying in luminance with a first pitch along a direction parallel to an epipolar line determined from a positional relationship between the imaging device and the detecting image display device, and a second linear pattern varying in luminance with a second pitch different from the first pitch along a direction parallel to the epipolar line;
detecting an object located between the imaging device and the image display surface to determine a measurement target point of the object; and
detecting a position of the measurement target point with respect to the image display surface based on an image including the measurement target point and the first pattern obtained by the imaging device, wherein
the first linear pattern and the second linear pattern are displayed simultaneously.