# US 2021/0173473 A1 · Input apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173473 A1
- Document ID: US20210173473A1
- Status: Published application
- Kind: A1
- Application number: 17/269,079
- Filed: 2019-06-11
- Published: 2021-06-10
- Earliest claimed: 2018-08-21
- Assignees: Ntt Docomo, Inc.
- Applicants: Ntt Docomo, Inc.
- Inventors: Shigeru AKAMATSU; Koichi ASANO
- Web page: https://patentgrep.com/patent/US20210173473A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An input apparatus 10 has: a determiner 33 configured to determine a reference plane, on which a plurality of virtual keys are arranged, based on fingertip positions of at least three fingers from among fingertip positions of a plurality of fingers in an initial state; a virtual key setter 34 configured to set, on the reference plane, a plurality of detection ranges that correspond to respective ones of the plurality of virtual keys and that each detect a pressing of a corresponding virtual key based on a fingertip position of a specific finger from among the fingertip positions of the at least three fingers in the initial state; and a pressed key specifier 35 configured to specify a virtual key that is pressed, from among the plurality of virtual keys, according to a positional relationship between the fingertip positions of the plurality of fingers in an input operation, and the plurality of detection ranges set on the reference plane for each of the plurality of virtual keys.

## Claims

### Claim at position 1

1: An input apparatus comprising:
a determiner configured to determine a reference plane, on which a plurality of virtual keys are arranged, based on fingertip positions of at least three fingers from among fingertip positions of a plurality of fingers in an initial state;
a virtual key setter configured to set, on the reference plane, a plurality of detection ranges that correspond to respective ones of the plurality of virtual keys and that each detect a pressing of a corresponding virtual key based on a fingertip position of a specific finger from among the fingertip positions of the at least three fingers in the initial state; and
a pressed key specifier configured to specify a virtual key that is pressed, from among the plurality of virtual keys, according to a positional relationship between the fingertip positions of the plurality of fingers in an input operation, and the plurality of detection ranges set on the reference plane for each of the plurality of virtual keys.

### Claim at position 2 (depends on 1)

2: The input apparatus according to claim 1, wherein the determiner is configured to determine a provisional reference plane based on the fingertip positions of the three fingers in the initial state, to determine the reference plane by correcting the provisional reference plane based on a fingertip position of at least one finger, other than the three fingers, from among the fingertip positions of the plurality of fingers.

### Claim at position 3 (depends on 1)

3: The input apparatus according to claim 1, wherein:
the fingertip positions of the at least three fingers include a fingertip position of a little finger, a fingertip position of a ring finger, and a fingertip position of a thumb; and
the determiner is configured to determine the reference plane based on the fingertip position of the little finger, the fingertip position of the ring finger, and the fingertip position of the thumb.

### Claim at position 4 (depends on 1)

4: The input apparatus according to claim 1, wherein the virtual key setter is configured to set the plurality of detection ranges on a per finger basis.

### Claim at position 5 (depends on 1)

5: The input apparatus according to claim 1, wherein the virtual key setter is configured to set a detection range for use for specifying that a next virtual key is pressed, based on the fingertip position of the specific finger and a virtual key immediately previous pressing of which is specified by the pressed key specifier, from among the plurality of virtual keys.

### Claim at position 6 (depends on 1)

6: The input apparatus according to claim 1, wherein the pressed key specifier comprises:
an estimation model configured to estimate a virtual key that is pressed, from among the plurality of virtual keys, based on:
fingertip position data indicative of the fingertip positions of the plurality of fingers;
palm shape data indicative of a shape of a palm; and
the plurality of detection ranges; and
a learner configured to reflect, to the estimation model, whether the virtual key estimated based on the estimation model is correct or incorrect.

### Claim at position 7 (depends on 6)

7: The input apparatus according to claim 6, further comprising a hand shape recognizer configured to, based on output data that is output from a sensor, generate hand shape data representative of the shape of a hand in three dimensions,
wherein the fingertip position data and the palm shape data that are input to the estimation model are specified based on the hand shape data.

### Claim at position 8 (depends on 1)

8: The input apparatus according to claim 1, further comprising a display configured to display, on a virtual keyboard on which the plurality of virtual keys are arranged, an image of a virtual key that is not pressed and an image of the virtual key that is pressed and is specified by the pressed key specifier, such that the image of the virtual key that is not pressed and the image of the virtual key that is pressed are distinguishable from each other.

### Claim at position 9 (depends on 1)

9: The input apparatus according to claim 1, wherein:
the determiner is configured to determine, based on fingertip positions of at least three fingers of a right hand in the initial state, a first reference plane corresponding to the right hand as the reference plane, and determines, based on fingertip positions of at least three fingers of a left hand in the initial state, a second reference plane corresponding to the left hand as the reference plane;
the virtual key setter is configured to:
set, on the first reference plane corresponding to the right hand, the plurality of detection ranges as a plurality of detection ranges for the right hand, based on a fingertip position of a specific finger of the right hand in the initial state from among the fingertip positions of the at least three fingers of the right hand, and
set, on the second reference plane corresponding to the left hand, the plurality of detection ranges as a plurality of detection ranges for the left hand, based on a fingertip position of a specific finger of the left hand in the initial state from among the fingertip positions of the at least three fingers of the left hand; and
the pressed key specifier is configured to:
specify, according to a positional relationship between fingertip positions of a plurality of fingers of the right hand in the input operation and the plurality of detection ranges for the right hand, a virtual key that is pressed by the right hand from among the plurality of virtual keys, and
specify, according to a positional relationship between fingertip positions of a plurality of fingers of the left hand in the input operation and the plurality of detection ranges for the left hand, a virtual key that is pressed by the left hand from among the plurality of virtual keys.

### Claim at position 10 (depends on 2)

10: The input apparatus according to claim 2, wherein:
the fingertip positions of the at least three fingers include a fingertip position of a little finger, a fingertip position of a ring finger, and a fingertip position of a thumb; and
the determiner is configured to determine the reference plane based on the fingertip position of the little finger, the fingertip position of the ring finger, and the fingertip position of the thumb.
