# US 2017/0285761 A1 · Character input method, program for character input, recording medium, and information-processing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0285761 A1
- Document ID: US20170285761A1
- Status: Published application
- Kind: A1
- Application number: 15/509,698
- Filed: 2016-08-12
- Published: 2017-10-05
- Earliest claimed: 2015-09-15
- Assignees: OMRON Corporation
- Applicants: OMRON Corporation
- Inventors: Hideki Yagi
- Web page: https://patentgrep.com/patent/US20170285761A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0236: {using selection techniques to select from displayed items}
- G06F 3/042: by opto-electronic means
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 40/274: Converting codes to words; Guess-ahead of partial word inputs
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The layout of character keys each having a plurality of characters allocated thereto is established on a virtual surface (first layer) including a detection position of a gesture that satisfies predetermined conditions, and when a gesture moving along the first layer is detected, a selection position with respect to the layout of character keys is moved in accordance with the gesture movement. When the movement direction of the gesture is switched to a direction away from the first layer under the condition that a prescribed character key in the layout is selected, each character allocated to the character key being selected is arranged outside the first layer at individually different positions relative to a virtual axis passing through the character key. Thereafter, in response to detection of a gesture moving toward any character, a character disposed at a moving destination is selected as an input character.

## Claims

### Claim 1

A character input method for detecting a gesture having a predetermined form as an operation for character input by means of a gesture recognition device that recognizes a gesture performed in space, and determining a character to be input on the basis of the detection results in a computer configured to perform a prescribed process in response to input of characters, wherein
the computer is configured to register first definition information for layout of a plurality of character keys on a virtual plane, each having a plurality of characters allocated thereto, and second definition information for layout of each character allocated to each of the arranged character keys outside the virtual plane at individually different positions relative to a virtual axis passing through the character key, wherein
the computer is configured to perform:
step 1 of establishing a layout of the plurality of character keys by applying the first definition information to the virtual plane including a detection position of a gesture in response to detection of a gesture that satisfies predetermined conditions;
step 2 of moving a selection position with respect to the layout of character keys in accordance with a gesture movement under the condition that the gesture moving along the virtual plane on which the layout of character keys is established is detected; and
step 3 of selecting a character disposed at a moving destination of the gesture as a character to be input in response to detection of a gesture moving toward any of the plurality of characters arranged on the basis of the second definition information with respect to the character key being selected after the movement direction of the gesture detected is switched from a direction along the virtual plane on which the character keys are established to a direction away from the virtual plane under the condition that a prescribed character key in the layout is selected.

### Claim 2 (depends on 1)

The character input method according to claim 1, wherein the second definition information implies distribution of the plurality of characters allocated to the same character key on a second virtual plane along the virtual plane.

### Claim 3 (depends on 1)

The character input method according to claim 1,
wherein a maximum of five keys is allocated to each character key arranged on the virtual plane, and
wherein the second definition information implies distributing each character except for one character among the plurality of characters allocated to the same character key in a range not including a position intersecting with the virtual axis on the second virtual plane along the virtual plane, while disposing the one remaining character at the position intersecting with the virtual axis on a third virtual plane opposite the character keys with the second virtual plane interposed between the virtual plane and the third virtual plane.

### Claim 4

The character input method according to claim. 1,
wherein step 2 includes a process of displaying an image of a region that is a part of an image showing the layout of the character keys with a character key selected along a movement direction of the gesture as a center, and
wherein step 3 includes a process of showing an image representing the positional relationship of each character allocated to the selected character key in place of the display in step 2 on the basis of the second definition information.

### Claim 5 (depends on 4)

The character input method according to claim 4, wherein the computer performs step 4 of extracting candidates for character string to be input adapting to the input character and displaying a list of the extracted candidates on the display in response to selection of an input character in step 3, while performing step 5 of updating a display indicating a selection position in the list under a state in which the list is displayed, in accordance with a gesture movement in response to detection of a gesture having a form different from the above-described gesture, moving along the virtual plane on which the character keys are arranged.

### Claim 6 (depends on 1)

The character input method according to claim 1,
wherein the gesture recognition device is provided to recognize a gesture that moves a hand,
wherein the computer starts to perform step 2 with a position of any character key in the layout of character keys established in step 1 as an initial selection position, after performing step 1 in response to detection of a one-finger hand gesture on the basis of the recognition results of the gesture recognition device, and
wherein step 2 is shifted to step 3 when it is detected that the one-finger hand gesture begins to move in a direction along the virtual axis that passes through the character key being selected.

### Claim 7 (depends on 1)

The character input method according to claim 1,
wherein the first definition information and the second definition information are registered in the computer for a plurality of types of virtual keyboards having different types of characters allocated to each character key,
wherein a virtual keyboard to be activated is switched in response to detection of a gesture having a prescribed form different from the gesture relating to each of steps 1 through 3, and
wherein the computer performs each of steps 1 through 3 using the first definition information and the second definition information corresponding to the activated virtual keyboard.

### Claim 8 (depends on 1)

The character input method according to claim 1,
wherein a display region for input character string equipped with a cursor indicating an input position is provided on the display connected to the computer, and
wherein when an input character is selected in step 2, the selected input character is inserted ahead of the cursor in the display region for input character string,

### Claim 9 (depends on 8)

The character input method according to claim 8,
wherein a position of the cursor is moved in response to detection of a first gesture having a form different from the gesture relating to each of steps 1 through 3, and
wherein a character ahead of the cursor is deleted in response to detection of a second gesture having a form different from the gesture relating to each of steps 1 through 3 and the first gesture under a state in which an input character string having a prescribed length is displayed in the display region for input character string.

### Claim 10

An information-processing device comprising: a gesture recognition device for recognizing a gesture performed in space; a character input device for detecting a gesture of predetermined form as an operation for character input by means of the gesture recognition device, and determining a character to be input on the basis of the detection results; and a display, wherein
the character input device includes:
a definition information storage unit configured to register first definition information for layout of a plurality of character keys on a virtual plane, each having a plurality of characters allocated thereto; and second definition information for layout of each character allocated to each of the arranged character keys outside the virtual plane at individually different positions relative to a virtual axis passing through the character key;
a character key layout establishing unit configured to establish a layout of the plurality of character keys by applying the first definition information to the virtual plane including a detection position of a gesture in response to detection of a gesture that satisfies predetermined conditions;
a character key selection unit configured to move a selection position with respect to the layout of Character keys in accordance with a gesture movement under the condition that the gesture moving along the virtual plane on which the layout of character keys is established is detected;
an input character selection unit configured to select a character disposed at a moving destination of the gesture as a character to be input in response to detection of a gesture moving toward any of the plurality of characters arranged on the basis of the second definition information with respect to the character key being selected after the movement direction of the gesture detected is switched from a direction along the virtual plane on which the character keys are established to a direction away from the virtual plane under the condition that a prescribed character key in the layout is selected; and
a display control unit configured to display an image showing a character key or a character that can be selected by the gesture being detected in conjunction with operations of the character key selection unit and the input character selection unit.

### Claim 11 (depends on 10)

The information-processing device according to claim 10, wherein the display control unit displays an image of a region that is a part of an image showing the layout of the character keys with a character key selected along a movement direction of the gesture as a center, and shows an image representing the positional relationship of each character allocated to the selected character key on the display in response to start of the process of the input character selection unit, in place of the display of character keys, on the basis of the second definition information.

### Claim 12 (depends on 10)

The information-processing device according to claim 10,
wherein the character input device further comprises a candidate extraction unit configured to extract candidates for input character string adapting to an input character in response to selection of the input character using the input character selection unit, and
wherein the display control unit displays a list of the candidates extracted by the candidate extraction unit on the display while updating a selection position of candidates in the list under a state in which the list is displayed, in accordance with a gesture movement in response to detection of a gesture having a form different from a gesture relating to the process of the character key selection unit, moving along the virtual plane on which the Character keys are arranged.

### Claim 13 (depends on 11)

The information-processing device according to claim 11,
wherein the character input device further comprises a candidate extraction unit configured to extract candidates for input character string adapting to an input character in response to selection of the input character using the input character selection unit, and
wherein the display control unit displays a list of the candidates extracted by the candidate extraction unit on the display while updating a selection position of candidates in the list under a state in which the list is displayed, in accordance with a gesture movement in response to detection of a gesture having a form different from a gesture relating to the process of the character key selection unit, moving along the virtual plane on which the character keys are arranged.

### Claim 14

(canceled)

### Claim 15

A non-temporary computer-readable recording medium that records a computer program for character input configured to cause a computer in an information-processing device equipped with a gesture recognition device for recognizing a gesture performed in space to function as a character input device that detects a gesture of predetermined form as an operation for character input by means of the gesture recognition device, and determines a character to be input on the basis of the detection results, wherein
the character input device includes:
a definition information storage unit configured to register first definition information for layout of a plurality of character keys on a virtual plane, each having a plurality of characters allocated thereto, and second definition information for layout of each character allocated to each of the arranged character keys outside the virtual plane at individually different positions relative to a virtual axis passing through the character key;
a character key layout establishing unit configured to establish a layout of the plurality of character keys by applying the first definition information to -the virtual plane including a detection position of a gesture in response to detection of a gesture that satisfies predetermined conditions;
a character key selection unit configured to move a selection position with respect to the layout of character keys in accordance with movement of the gesture under the condition that the gesture moving along the virtual plane on which the layout of character keys is established is detected; and
an input Character selection unit configured to select a character disposed at a moving destination of the gesture as a character to be input in response to detection of a gesture moving toward any of the plurality of characters arranged on the basis of the second definition information with respect to the character key being selected after the movement direction of the gesture detected is switched from a direction along the virtual plane on which the character keys are established to a direction away from the virtual plane under the condition that a prescribed character key in the layout is selected.
