# US 10,372,223 B2 · Method for providing user commands to an electronic processor and related processor program and electronic circuit > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,223 B2 - Document ID: US10372223B2 - Status: Granted - Kind: B2 - Application number: 15/105,564 - Filed: 2014-12-17 - Published: 2016-11-03 - Granted: 2019-08-06 - Earliest claimed: 2013-12-18 - Assignees: Nu-Tech SAS Di Michele Marco & C. - Applicants: Nu-Tech SAS Di De Michele Marco & C. - Inventors: Marco De Michele - Web page: https://patentgrep.com/patent/US10372223B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06V 40/107: {Static hand or arm} - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract It is disclosed a method for providing user commands to an electronic processor, wherein a first command corresponds to the pressure of a first predetermined button of a mouse and a second command corresponds to the release of the button. An image detection device in communication with the electronic processor is able to detect a sequence of images of a person using the electronic processor. The method comprises the following steps: A) identifying a hand of the person; B) detecting movement of the hand corresponding to pinching of the pad of the thumb and of the pad of another finger; C) generating the first user command and sending it to the electronic processor; D) detecting movement of the hand corresponding to spreading of the pad of the thumb and of the pad of the other finger; E) generating the second user command and sending it to the electronic processor. ## Claims ### Claim 1 A method for providing user commands to an electronic processor, wherein a first user command corresponds to a pressure of a first predetermined button of a “mouse” and a second user command corresponds to a release of said first predetermined button, the method comprising the following steps in sequence: A) identifying a hand of said person with an image detection device in communication with the electronic processor, wherein the image detection device is configured to detect a sequence of images of said hand using the electronic processor, B) detecting movement of said hand corresponding to pinching of a pad of a thumb of said hand and of a pad of a first predetermined other finger of said hand from said sequence of images, said detection including identifying and tracking the thumb and the first predetermined other finger, said detection of the pinching movement further including identifying a tracked distance between the pad of the thumb and the pad of the first predetermined other finger at subsequent instants; C) generating said first user command and sending said first command to said electronic processor, D) detecting movement of said hand corresponding to spreading of the pad of the thumb of said hand and of the pad of said first predetermined other finger of said hand from said sequence of images, said detection of the spreading movement including identifying a tracked distance between the pad of the thumb and the pad of the first predetermined other finger at subsequent instants, and E) generating said second user command and sending said second user command to said electronic processor. ### Claim 2 (depends on 1) The method according to claim 1, wherein a third user command corresponds to a pressure of a second predetermined button of the “mouse” and a fourth user command corresponds to the release of said second predetermined button, comprising, after Step A) the further steps of: F) detecting movement of said hand corresponding to pinching of the pad of the thumb of said hand and of a pad of a second predetermined other finger of said hand based on the sequence of images, G) generating a third user command and sending the third user command to said electronic processor, H) detecting movement of said hand corresponding to spreading of the pad of the thumb of said hand and of the pad of said second predetermined other finger of said hand, I) generating a fourth user command and sending said fourth user command to said electronic processor. ### Claim 3 (depends on 1) The method according to claim 1, wherein detection of the movement of the hand corresponding to pinching and spreading of the pad of the thumb and the pad of the first predetermined other finger comprises a comparison of the tracked distance between the pad of the thumb and the pad of the first predetermined other finger with a pinch threshold distance and with a spread threshold distance, respectively. ### Claim 4 (depends on 2) The method according to claim 2, wherein detection of the movement of the hand corresponding to pinching or spreading of the pad of the thumb and the pad of the second predetermined other finger comprises a comparison of a distance between said two fingers of the hand with a pinch threshold distance or a spread threshold distance. ### Claim 5 (depends on 1) The method according to claim 1, wherein detection of the movement of the hand corresponding to pinching or spreading of the pad of the thumb and the pad of the first predetermined other finger comprises a comparison of a pinch speed or a spread speed of the pad of the thumb and the pad of the first predetermined other finger with at least one threshold speed and checking of a monotonicity of the movement. ### Claim 6 (depends on 2) The method according to claim 2, wherein detection of the movement of the hand corresponding to pinching or spreading of the pad of the thumb and the pad of the second predetermined other finger comprises a comparison of a pinch speed or a spread speed of the pad of the thumb and the pad of the second predetermined other finger with at least one threshold speed and checking of a monotonicity of the movement. ### Claim 7 (depends on 3) The method according to claim 3, wherein detection of the movement of the hand corresponding to pinching or spreading of the pad of the thumb and the pad of the first predetermined other finger comprises comparison of a pinch speed or a spread speed of the pad of the thumb and the pad of the first predetermined other finger with at least one threshold speed and checking of a monotonicity of the movement. ### Claim 8 (depends on 4) The method according to claim 4, wherein detection of the movement of the hand corresponding to pinching or spreading of the pad of the thumb and the pad of the second predetermined other finger comprises a comparison of a pinch speed or a spread speed of the pad of the thumb and the pad of the second predetermined other finger with at least one threshold speed and checking of a monotonicity of the movement. ### Claim 9 (depends on 1) The method according to claim 1, comprising, after step A, the further steps of: J) detecting movements of said hand corresponding to translations of a palm of said hand, and simultaneously generating corresponding user commands and sending the corresponding user commands to said electronic processor, said user commands corresponding to translations of said “cursor” on a screen of said electronic processor. ### Claim 10 (depends on 1) The method according to claim 1, comprising, after step A, the further steps of: J1) detecting movements of said hand corresponding to a first predetermined kind of movement of the hand and/or fingers and simultaneously generating corresponding user commands and sending the corresponding user commands to the electronic processor, the user commands corresponding to maintaining fixed the position of the “cursor” on the screen of the electronic processor, while the hand is repositioned. ### Claim 11 (depends on 10) The method according to claim 10, wherein said first predetermined kind of movement of the hand and/or fingers is a closing of the hand into a fist. ### Claim 12 (depends on 1) The method according to claim 1, comprising, after step A, the further steps of: K) detecting movements of said hand corresponding to rotations of one of the fingers of said hand, and simultaneously generating corresponding user commands and sending the corresponding user commands to said electronic processor, said user commands corresponding to rotations of a “wheel” of said “mouse”. ### Claim 13 (depends on 1) The method according to claim 1, wherein said electronic processor comprises a three-dimensional graphical user interface. ### Claim 14 (depends on 1) The method according to claim 1, wherein said electronic processor is part of a “smart phone” or a “tablet”, and said image detection device is integrated inside the “smart phone” or the “tablet”. ### Claim 15 (depends on 1) A non-transitory processor program adapted to perform the steps of the method according to claim 1, when said processor program is run on the image detection device. ### Claim 16 (depends on 1) A non-transitory processor program adapted to perform the steps of the method according to claim 1, when said processor program is run on an electronic processor of a smartphone or of a tablet. ### Claim 17 (depends on 1) An electronic circuit adapted to perform the steps of the method according to claim 1. ### Claim 18 (depends on 1) Method according to claim 1, wherein in step B) the pinching includes the contact of the pad of the thumb with the pad of the first predetermined other finger. ### Claim 19 A method for providing user commands to an electronic processor, wherein a first user command corresponds to a pressure of a first predetermined button of a “mouse” and a second user command corresponds to the release of said first predetermined button, the method comprising the following steps in sequence, A) identifying a hand of said person with an image detection device in communication with the electronic processor, wherein the image detection device is configured to detect a sequence of images of said hand using the electronic processor; B) detecting movement of said hand corresponding to pinching of a pad of a thumb of said hand and of a pad of a first predetermined other finger of said hand from said sequence of images, said detection including identifying and tracking the thumb and the first predetermined other finger, said detection of the pinching movement further including a comparison of a decreasing distance between the pad of the thumb and the pad of the first predetermined other finger with a pinch threshold distance at subsequent instants; C) generating said first user command and sending said first command to said electronic processor; D) detecting movement of said hand corresponding to spreading of the pad of the thumb of said hand and of the pad of said first predetermined other finger of said hand from said sequence of images, said detection of the spreading movement further including a comparison of an increasing distance between the pad of the thumb and the pad of the first predetermined other finger with a spread threshold distance at subsequent instants; E) generating said second user command and sending said second user command to said electronic processor.