# US 2015/0145762 A1 · Position-of-interest detection device, position-of-interest detection method, and position-of-interest detection program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0145762 A1
- Document ID: US20150145762A1
- Status: Published application
- Kind: A1
- Application number: 14/404,595
- Filed: 2013-05-29
- Published: 2015-05-28
- Earliest claimed: 2012-06-01
- Assignees: Sharp Kabushiki Kaisha
- Applicants: Sharp Kabushiki Kaisha
- Inventors: Tomoya Shimura
- Web page: https://patentgrep.com/patent/US20150145762A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A distance calculation unit acquires a first position information indicating a position of a part of a body of each user indicated in an image captured by an imaging device. A user information analysis unit detects an operation region where a user can operate by using a part of a body, based on the first position information, and that identifies as an operator candidate a user having the part of the body indicated by the first position information in case that the detection of the operation region was possible. The user information analysis unit, of operator candidates, identifies as an operator a user including a part of the body in the operation region, and identifies as a user who cannot perform operation a user other than a user identified as the operator of the operator candidates. Because of the above, it is possible to increase operability.

## Claims

### Claim 1

A position-of-interest detection device comprising:
a position detection unit configured to acquire position information indicating a position of a part of a body of each user indicated in an image captured by an imaging device; and
a user information analysis unit configured to detect an operation region where a user can operate by using a part of a body, based on the position information, and identify as at least one operator candidate at least one user having the part of the body indicated by the position information in case that the detection of the operation region was possible,
wherein the user information analysis unit, of the at least one operator candidate, is configured to identify as an operator a first user including the part of the body in the operation region, and identify as at least one user who cannot perform operation at least one second user other than the first.

### Claim 2 (depends on 1)

The position-of-interest detection device according to claim 1,
wherein, in case that the part of the body is included in the operation region, the user information analysis unit is configured to detect user information that includes information indicating a shape of the part of the body of the first user, the position-of-interest detection device comprising a control unit configured to execute processing corresponding user information detected by the user information analysis unit.

### Claim 3 (depends on 1)

The position-of-interest detection device according to claim 1,
wherein the user information analysis unit is configured to detect the operation region by a prescribed operation specified by the first user.

### Claim 4 (depends on 1)

The position-of-interest detection device according to claim 1,
wherein the user information analysis unit, by the first user specifying a first vertex in a display region of a display device within the field of view of the first user and making an operation of specifying a second vertex diagonally opposite the first vertex, is configured to detect the operation region.

### Claim 5 (depends on 1)

The position-of-interest detection device according to claim 1,
wherein position-of-interest detection device comprises a position-of-interest detection unit configured to associate a size of an operation region detected by the user information analysis unit in case that the first user is viewed from a display device with a size of an operated region in a display region of the display device and calculate, based on the association, a corresponding position within an operated region from the position of the part of the body of the first user within the operation region.

### Claim 6 (depends on 5)

The position-of-interest detection device according to claim 5, wherein the position detection unit is configured to use, as the part of the body, a hand.

### Claim 7 (depends on 1)

The position-of-interest detection device according to claim 1,
the position-of-interest detection device comprises a display unit configured to display the image captured by the imaging device, and
the imaging device is installed at a position higher than that of the display unit.

### Claim 8 (depends on 1)

The position-of-interest detection device according to claim 1, wherein the user information analysis unit is configured to use the operation region which broadens from the operator toward the position-of-interest detection device.

### Claim 9 (depends on 1)

The position-of-interest detection device according to claim 1, wherein the user information analysis unit, based on a position of at least one of an eye and a face of the operator and the operated region in a display region of a display device, is configured to detect the operation region.

### Claim 10 (depends on 1)

The position-of-interest detection device according to claim 1, the position-of-interest detection device comprises a position-of-interest detection unit configured to calculate a position indicated by the part of the body of the operator that is a position within an operated region in a display region of a display device, based on reference position information representing a position of at least one of an eye and a face of the operator and instruction position information indicating a position of the part of the body of the operator.

### Claim at position 11

-14. (canceled)

### Claim 15 (depends on 3)

The position-of-interest detection device according to claim 3,
wherein the user information analysis unit, by the first user specifying a first vertex in a display region of a display device within the field of view of the first user and making an operation of specifying a second vertex diagonally opposite the first vertex, is configured to detect the operation region.

### Claim 16 (depends on 15)

The position-of-interest detection device according to claim 15,
wherein position-of-interest detection device comprises a position-of-interest detection unit configured to associate a size of an operation region detected by the user information analysis unit in case that the first user is viewed from a display device with a size of an operated region in a display region of the display device and calculate, based on the association, a corresponding position within an operated region from the position of the part of the body of the first user within the operation region.

### Claim 17 (depends on 9)

The position-of-interest detection device according to claim 9,
wherein position-of-interest detection device comprises a position-of-interest detection unit configured to associate a size of an operation region detected by the user information analysis unit in case that the first user is viewed from a display device with a size of an operated region in a display region of the display device and calculate, based on the association, a corresponding position within an operated region from the position of the part of the body of the first user within the operation region.

### Claim 18 (depends on 10)

The position-of-interest detection device according to claim 10,
wherein, in case that the part of the body is included in the operation region, the user information analysis unit is configured to detect user information that includes information indicating a shape of the part of the body of the first user, the position-of-interest detection device comprising a control unit configured to execute processing corresponding user information detected by the user information analysis unit.

### Claim 19 (depends on 15)

The position-of-interest detection device according to claim 15,
wherein, in case that the part of the body is included in the operation region, the user information analysis unit is configured to detect user information that includes information indicating a shape of the part of the body of the first user, the position-of-interest detection device comprising a control unit configured to execute processing corresponding user information detected by the user information analysis unit.

### Claim 20 (depends on 19)

The position-of-interest detection device according to claim 19,
wherein position-of-interest detection device comprises a position-of-interest detection unit configured to associate a size of an operation region detected by the user information analysis unit in case that the first user is viewed from a display device with a size of an operated region in a display region of the display device and calculate, based on the association, a corresponding position within an operated region from the position of the part of the body of the first user within the operation region.

### Claim 21 (depends on 9)

The position-of-interest detection device according to claim 9,
wherein, in case that the part of the body is included in the operation region, the user information analysis unit is configured to detect user information that includes information indicating a shape of the part of the body of the first user, the position-of-interest detection device comprising a control unit configured to execute processing corresponding user information detected by the user information analysis unit.

### Claim 22 (depends on 21)

The position-of-interest detection device according to claim 21,
wherein position-of-interest detection device comprises a position-of-interest detection unit configured to associate a size of an operation region detected by the user information analysis unit in case that the first user is viewed from a display device with a size of an operated region in a display region of the display device and calculate, based on the association, a corresponding position within an operated region from the position of the part of the body of the first user within the operation region.

### Claim 23

A position-of-interest detection method comprising:
acquiring position information indicating a position of a part of a body of each user indicated in an image captured by an imaging device; and
detecting an operation region where a user can operate by using a part of a body, based on the position information; and
identifying as at least one operator candidate at least one user having the part of the body indicated by the position information in case that the detection of the operation region was possible;
identifying, of the at least one operator candidate, as an operator a first user including the part of the body in the operation region; and
identifying as at least one user who cannot perform operation at least one second user other than the first user.

### Claim 24

A non-transitory computer readable recording medium storing a position-of-interest detection program executing:
acquiring position information indicating a position of a part of a body of each user indicated in an image captured by an imaging device; and
detecting an operation region where a user can operate by using a part of a body, based on the position information; and
identifying as at least one operator candidate at least one user having the part of the body indicated by the position information in case that the detection of the operation region was possible;
identifying, of the at least one operator candidate, as an operator a first user including the part of the body in the operation region; and
identifying as at least one user who cannot perform operation at least one second user other than the first user.
