# US 10,120,452 B2 · Information processing apparatus for recognizing operation input by gesture of object and control method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,452 B2 - Document ID: US10120452B2 - Status: Granted - Kind: B2 - Application number: 14/990,634 - Filed: 2016-01-07 - Published: 2016-07-14 - Granted: 2018-11-06 - Earliest claimed: 2015-01-09 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Masafumi Yoshida; Motoki Nakama - Web page: https://patentgrep.com/patent/US10120452B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means - G06F 3/0421: {by interrupting or reflecting a light beam, e.g. optical touch-screen} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An information processing apparatus includes an obtainment unit configured to obtain information indicating a proximity state of an object and a predetermined operation surface, a setting unit configured to set a condition regarding the proximity state for determining whether the object is released from the operation surface based on a moving speed of the object in a period during which the object is regarded as touching the operation surface for input by the information obtained by the obtainment unit, and a determination unit configured to determine that the object is released from the operation surface in response to that the information obtained by the obtainment unit satisfies the condition set by the setting unit. ## Claims ### Claim 1 An information processing apparatus comprising: one or more memories storing instructions; and one or more processors that, when executing the instructions, causes the information processing apparatus to: obtain information indicating a proximity state of an object and a predetermined operation surface, based on information of sensing the predetermined operation surface from above; set a condition regarding the proximity state for determining whether the object is released from the operation surface based on a moving speed and a release threshold value of the object in a period during which the object is regarded as touching the operation surface for input by the obtained information, wherein the release threshold value changes depending on the moving speed; and determine that the object is released from the operation surface in response to that the obtained information satisfies the set condition. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the instructions further cause the information processing apparatus to set a condition to be set when a moving speed of the object is faster than a reference speed stricter than a condition to be set when a moving speed of the object is slower than the reference speed. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the instructions further cause the information processing apparatus to ease the condition in a case where a moving speed of the object exceeds the reference speed and then is slowed down below the reference speed again. ### Claim 4 (depends on 2) The information processing apparatus according to claim 2, wherein the condition is a threshold value of a magnitude of a degree of the proximity state, and the instructions further cause the information processing apparatus to set a threshold value to be set when a moving speed of the object is faster than the reference speed greater than a threshold value to be set when a moving speed of the object is slower than the reference speed. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, wherein the instructions further cause the information processing apparatus to obtain a threshold value corresponding to a moving speed of the object in a period during which the object is regarded as touching the operation surface for input from among a plurality of threshold values stored in advance as candidates of the condition and sets the threshold value obtained as the condition. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the instructions further cause the information processing apparatus to obtain a distance between the operation surface and the object, set a threshold value of the distance between the operation surface and the object as the condition, and in a case where a distance from the operation surface to the object exceeds the set threshold value, determine that the object is released from the operation surface. ### Claim 7 (depends on 6) The information processing apparatus according to claim 6, wherein, in a case where a distance between the operation surface and the object is smaller than a predetermined touch threshold value, the instructions further cause the information processing apparatus to determine as a state in which the object touches the operation surface, the predetermined touch threshold value is a value independent from a threshold value set. ### Claim 8 (depends on 6) The information processing apparatus according to claim 6, wherein, in a case where a state in which a distance from the operation surface to the object exceeds a threshold value set continues longer than a predetermined time length, the instructions further cause the information processing apparatus to determine that the object is released from the operation surface. ### Claim 9 (depends on 6) The information processing apparatus according to claim 6, wherein, in a case where a state in which a distance between the operation surface and the object exceeds a threshold value set continues longer than a time length specified in response to a time length during which the object touches the operation surface, the instructions further cause the information processing apparatus to determine that the object is released from the operation surface. ### Claim 10 (depends on 6) The information processing apparatus according to claim 6, wherein the instructions further cause the information processing apparatus to obtain information indicating the distance using an infrared image obtained by capturing an image of a space including the object. ### Claim 11 (depends on 6) The information processing apparatus according to claim 6, wherein the instructions further cause the information processing apparatus to obtain information indicating the distance using a range image obtained by capturing an image of a space including the object. ### Claim 12 (depends on 1) The information processing apparatus according to claim 1, wherein the instructions further cause the information processing apparatus to recognize a completion of one touch input in response to determination that the object is released from the operation surface. ### Claim 13 (depends on 12) The information processing apparatus according to claim 12, wherein the one touch input is a series of position information pieces of the object from a time point when the object is regarded as touched the operation surface to a time point when the object is regarded as released therefrom. ### Claim 14 A method for controlling an information processing apparatus, the method comprising: obtaining information indicating a proximity state of an object and a predetermined operation surface, based on information of sensing the predetermined operation surface from above; setting a condition regarding the proximity state for determining whether the object is released from the operation surface based on a moving speed and a release threshold value of the object in a period during which the object is regarded as touching the operation surface for input by the obtained information, wherein the release threshold value changes depending on the moving speed; and determining that the object is released from the operation surface in response to that the obtained information satisfies the set condition.