# US 2014/0157210 A1 · Gesture Based Interface System and Method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0157210 A1 - Document ID: US20140157210A1 - Status: Published application - Kind: A1 - Application number: 14/176,054 - Filed: 2014-02-08 - Published: 2014-06-05 - Earliest claimed: 2011-08-11 - Assignees: Eyesight Mobile Technologies Ltd. - Inventors: Itay Katz; Nadav Israel; Tamir Anavi; Shahaf Grofit; Itay Bar-Yosef - Web page: https://patentgrep.com/patent/US20140157210A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A user interface apparatus for controlling any kind of a device. Images obtained by an image sensor in a region adjacent to the device are input to a gesture recognition system which analyzes images obtained by the image sensor to identify one or more gestures. A message decision maker generates a message based upon an identified gesture and a recognition mode of the gesture recognition system. The recognition mode is changed under one or more various conditions. ## Claims ### Claim at position 1 1-67. (canceled) ### Claim 68 A system comprising: at least one processor configured to: receive at least one image from at least one image sensor; detect, in the at least one image, data corresponding to an anatomical structure of a user; identify, in the at least one image, information corresponding to a suspected hand gesture by the user; and discount the information corresponding to the suspected hand gesture if the data corresponding to the anatomical structure of the user is not identified in the at least one image. ### Claim 69 (depends on 68) The system of claim 68, wherein the anatomical structure includes at least one of a face, an eye, a hand, or a portion of a hand. ### Claim 70 (depends on 68) The system of claim 68, wherein the anatomical structure has a predefined spatial relationship to a hand of the user. ### Claim 71 (depends on 70) The system of claim 70, wherein the at least one processor is further configured to: specify the predefined spatial arrangement based, at least in part, on a vector from a substantially central location on a hand of the user to a substantially central location of the anatomical structure, the vector having at least one of a magnitude in a predefined range and a direction in a predefined range. ### Claim 72 (depends on 68) The system of claim 68, wherein the at least one processor is further configured to: discount the information corresponding to the suspected hand gesture if a proportion of the size of a hand of the user relative to the size of the anatomical structure is outside of a predetermined range. ### Claim 73 (depends on 68) The system of claim 68, wherein the at least one processor is further configured to: compare a relative size and spatial relationship of a hand of the user to the anatomical structure. ### Claim 74 (depends on 73) The system of claim 73, wherein the at least one processor is further configured to: adjust a gesture recognition algorithm based, at least in part, on the comparison. ### Claim 75 (depends on 73) The system of claim 73, wherein the at least one processor is further configured to: discount the information corresponding to the suspected hand gesture based, at least in part, on the comparison. ### Claim 76 (depends on 68) The system of claim 68, wherein the at least one processor is further configured to: compare a skin color of a hand of the user with a skin color of the anatomical structure; and discount the information corresponding to the suspected hand gesture if an insufficient skin color match is determined. ### Claim 77 (depends on 68) The system of claim 68, wherein the at least one processor is further configured to: determine a first region surrounding a first body part in the at least one image; determine a second region in the at least one image obtained by a predefined transformation of the first region; construct a first histogram associated with an attribute of the pixels in the first region; construct a second histogram associated with an attribute of the pixels in the second region; and detect a second body part in the at least one image based, at least in part, on the first histogram and the second histogram. ### Claim 78 (depends on 77) The system of claim 77, wherein the second region is offset from the first region by a predefined vector. ### Claim 79 (depends on 77) The system of claim 77, wherein at least one of a dimension and location of the second region is based, at least in part, on at least one of a dimension and location of the first region. ### Claim 80 (depends on 68) The system of claim 68, wherein the at least one processor is further configured to: output, to a display, information that is activatable via the hand gesture; and provide at least one of an audible and visual cue to the user that the system is activatable via the hand gesture. ### Claim 81 (depends on 80) The system of claim 80, wherein the at least one processor is further configured to: output an alert that information on the display is not activatable via the hand gesture, ### Claim 82 (depends on 68) The system of claim 68, wherein the hand gesture is associated with a command, wherein the at least one processor is further configured to: implement the command; and provide feedback that the command was recognized. ### Claim 83 (depends on 82) The system of claim 82, wherein the feedback includes at least one of a moving indicator, a visual indicator that approximates a direction of the hand gesture, a swelling icon, an audible signal, haptic feedback, directional vibration, air tactile feedback, ultrasonic feedback, and audible feedback, ### Claim 84 (depends on 88) The system of claim 88, wherein the at least one processor is further configured to: provide an indication including at least one of an indication the system is ready to recognize gestures, an indication the system is ready to recognize one or more predefined gestures, an indication the system is not ready to recognize gestures, and an indication ambient light conditions do not permit gesture recognition. ### Claim 85 (depends on 84) The system of claim 84, wherein the indication is a visual indication including at least one of an icon displayed on a display screen, a change in an icon on a display screen, a change in color of an icon on a display screen, and an indication light. ### Claim 86 (depends on 68) The system of claim 68, wherein the anatomical structure includes at least one anatomical structure other than a hand of the user. ### Claim 87 A non-transitory computer-readable medium including instructions that, when executed by at least one processor, cause the processor to perform operations comprising: receiving at feast one image from at least one image sensor; detecting, in the at least one image, data corresponding to an anatomical structure of a user; identifying, in the at least one image, information corresponding to a suspected hand gesture by the user; and discounting the information corresponding to the suspected hand gesture if the data corresponding to the anatomical structure of the user is not identified in the at least one image. ### Claim 88 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the anatomical structure includes at least one of a face, an eye, a hand, or a portion of a hand. ### Claim 89 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the anatomical structure has a predefined spatial relationship to a hand of the user. ### Claim 90 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the instructions, when executed by at least one processor, further cause the processor to perform at least one operation comprising: discounting the information corresponding to the suspected hand gesture if a proportion of the size of a hand of the user relative to the size of the anatomical structure is outside of a predetermined range. ### Claim 91 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the instructions, when executed by at least one processor, further cause the processor to perform at least one operation comprising: comparing a relative size and spatial relationship of a hand of the user to the anatomical structure. ### Claim 92 (depends on 91) The non-transitory computer-readable medium of claim 91, wherein the instructions, when executed by at least one processor, further cause the processor to perform at least one operation comprising: adjusting a gesture recognition algorithm based, at least in part, on the comparison. ### Claim 93 (depends on 91) The non-transitory computer-readable medium of claim 91, wherein the instructions, when executed by at least one processor, further cause the processor to perform at least one operation comprising: discounting the information corresponding to the suspected hand gesture based, at least in part, on the comparison, ### Claim 94 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the instructions, when executed by at least one processor, further cause the processor to perform operations comprising; determining a first region surrounding a first body part in the at least one image; determining a second region In the at least one Image obtained by a predefined transformation of the first region; constructing a first histogram associated with an attribute of the pixels in the first region; constructing a second histogram associated with an attribute of the pixels in the second region; and detecting a second body part in the at least one image based, at least in part, on the first histogram and the second histogram. ### Claim 95 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the instructions, when executed by at least one processor, further cause the processor to perform operations comprising: outputting, to a display, information that is activatable via the hand gesture; and providing at least one of an audible and visual cue to the user that the system is activatable via the hand gesture. ### Claim 96 (depends on 87) The non-transitory computer-readable medium of claim 87, wherein the anatomical structure includes at least one anatomical structure other than a hand of the user. ### Claim 97 A gesture recognition method, comprising: receiving at least one image from at least one image sensor; detecting, in the at least one image, data corresponding to an anatomical structure of a user; identifying, in the at least one image, information corresponding to a suspected hand gesture by the user; and discounting the information corresponding to the suspected hand gesture if the data corresponding to the anatomical structure of the user is not identified in the at least one image.