# US 7,466,308 B2 · Disposing identifying codes on a user's hand to provide input to an interactive display application > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 7,466,308 B2 - Document ID: US7466308B2 - Status: Granted - Kind: B2 - Application number: 10/879,905 - Filed: 2004-06-28 - Published: 2006-01-12 - Granted: 2008-12-16 - Earliest claimed: 2004-06-28 - Assignees: Microsoft Corporation - Inventors: Joel P. Dehlin - Web page: https://patentgrep.com/patent/US7466308B2 ## CPC - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 2203/0331: Finger worn pointing device - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Input for controlling an application is provided to a computer system having an interactive display surface with an optical vision system for sensing objects. An optical code selected to be detectable by the interactive display surface when positioned adjacent to the interactive display surface is associated with a control function. The optical code is provided on an article configured to be removably affixed to at least a portion of a user's hand. When the portion of the user's hand is moved to a position adjacent to the interactive display surface, the optical vision system detects the optical code and invokes the control function associated with the optical code. Thus, a user can provide input to the interactive display surface with movements of the user's hand. A different optical code may be affixed to each digit of the user's hand, enabling the user to selectively invoke a plurality of control functions. ## Claims ### Claim 1 A method for providing an input to an application executing on a computer system having an interactive display surface, comprising the steps of: (a) providing a digital video camera mounted behind the display surface, the display surface being translucent, the digital video camera being responsive to infrared (IR) light and the digital video camera being responsive only to IR light reflected from an article in contact with or a short distance above the display surface; (b) providing an infrared (IR) light source comprising a plurality of IR light emitting diodes (LEDs) mounted such that the IR light produced by the LEDs is directed toward the underside of the display surface; (c) disposing a baffle between the IR light source and the digital video camera to prevent IR light that is directly emitted from the IR light source from entering the digital video camera; (d) associating a set of orthogonal X and Y axes with the display surface; (e) determining an identifying code selected to be detectable by the interactive display surface when the identifying code is positioned adjacent to the interactive display surface by a user engaging the interactive display surface; (f) selecting an article, the article being configured to be removably affixed to at least a portion of a user's hand so that the article need not be grasped by the user when engaging the interactive display surface; and (g) providing the identifying code on the article, such that when the article is positioned adjacent to the interactive display surface by the user appropriately moving the at least the portion of the user's hand, the interactive display surface detects the identifying code. ### Claim 2 (depends on 1) The method of claim 1, wherein the identifying code includes at least one of a bar code, a matrix code, a radial code, a gray scale code, an identifiable color, and a distinctive shape. ### Claim 3 (depends on 1) The method of claim 1, wherein the identifying code is associated with a response in the application, further comprising the step of invoking the response upon detecting the identifying code positioned adjacent to the interactive display surface. ### Claim 4 (depends on 1) The method of claim 1, wherein the article includes a digit cap configured to be worn on an end of a user's digit. ### Claim 5 (depends on 1) The method of claim 1, wherein the article includes a layer configured with a first surface that is removably adhered to a user's digit, and a second surface that is opposite the first surface and is provided with the identifying code. ### Claim 6 (depends on 1) The method of claim 1, wherein the article includes a hand covering configured to cover at least a portion of a palm of a user's hand. ### Claim 7 (depends on 6) The method of claim 6, wherein the hand covering includes one of a glove, a mitten, a mitt, and a panel attachable to the user's hand. ### Claim 8 (depends on 6) The method of claim 6, further comprising the steps of (a) providing a plurality of identifying codes at a plurality of locations on the hand covering, each of the plurality of identifying codes being associated with a different response in the application; and (b) invoking a response associated with the identifying code provided at a location upon detecting the identifying code at the location positioned adjacent to the interactive display surface, by the user's hand. ### Claim 9 (depends on 1) The method of claim 1, wherein the identifying code is provided on the article by at least one of the steps of forming, molding, printing, and depositing the identifying code on the article. ### Claim 10 (depends on 1) The method of claim 1, wherein the identifying code is provided on the article by forming the identifying code on an intermediate medium and attaching the intermediate medium to the article. ### Claim 11 A method for providing an input to an application executing on a computer system coupled with an interactive display surface, the method comprising the steps of: (a) providing a digital video camera mounted behind the display surface, the display surface being translucent, the digital video camera being responsive to infrared (IR) light and the digital video camera being responsive only to IR light reflected from an article in contact with or a short distance above the display surface; (b) providing an infrared (IR) light source comprising a plurality of IR light emitting diodes (LEDs) mounted such that the IR light produced by the LEDs is directed toward the underside of the display surface; (c) disposing a baffle between the IR light source and the digital video camera to prevent IR light that is directly emitted from the IR light source from entering the digital video camera; (d) associating a set of orthogonal X and Y axes with the display surface; (e) determining an optical code selected to be identifiable by the interactive display surface when the optical code is positioned adjacent to the interactive display surface; (f) disposing the optical code on a portion of a user's hand; (g) configuring the application to invoke a particular response upon detection of the optical code adjacent to the interactive display surface; (h) detecting the optical code when the optical code is positioned adjacent to the interactive display surface as a result of a movement of the user's hand; and (i) invoking the response upon detection of the optical code. ### Claim 12 (depends on 11) The method of claim 11, further comprising the steps of: (a) determining a plurality of optical codes configured to be identifiable by the interactive display surface when each optical code is positioned adjacent to the interactive display surface; (b) disposing the plurality of optical codes at a plurality of portions of a user's hand; (c) configuring the application to invoke a specific response upon detection of any of the plurality of optical codes adjacent to the interactive display surface, each optical code being associated with a different specific response; (d) detecting any of the plurality of optical codes that is moved to a position adjacent to the interactive display surface as a result of a movement of the user's hand; and (e) invoking each specific response associated with any of the optical codes that were thus detected. ### Claim 13 (depends on 11) The method of claim 11, wherein the optical code includes at least one of a bar code, a matrix code, a radial code, a gray scale code, an identifiable color, and a distinctive shape. ### Claim 14 (depends on 11) The method of claim 11, wherein the optical code is selected to be detectable in response to infrared light reflected by the optical code. ### Claim 15 (depends on 11) The method of claim 11, wherein the optical code is disposed on the portion of the user's hand by: (a) selecting an article, the article being configured to be removably affixed to at least a portion of a user's hand; (b) providing the optical code on the article; and (c) removably affixing the article to the portion of the user's hand. ### Claim 16 (depends on 15) The method of claim 15, wherein the article includes a digit cap configured to be worn on an end of a user's digit. ### Claim 17 (depends on 15) The method of claim 15, wherein the article includes a layer having a first surface configured to be removably adhered to a user's digit, and having a second surface provided with the optical code that is detectable when positioned adjacent to the interactive display surface. ### Claim 18 (depends on 15) The method of claim 15, wherein the article includes a hand covering configured to cover at least a portion of a palm of a user's hand. ### Claim 19 (depends on 18) The method of claim 18, wherein the hand covering includes one of a glove, a mitten, a mitt, and a panel attachable to the user's hand. ### Claim 20 (depends on 18) The method of claim 18, further comprising the steps of (a) providing a plurality of different optical codes at a plurality of locations on the hand covering, each of the plurality of different optical codes being associated with a corresponding different response in the application being executed; (b) detecting any of the plurality of different optical codes being positioned adjacent to the interactive display surface; and (c) carrying out each response associated with any of the plurality of different optical codes that was thus detected. ### Claim 21 (depends on 15) The method of claim 15, wherein the optical code is provided on the article by at least one of the steps of forming, molding, printing, and depositing the optical code on the article. ### Claim 22 (depends on 15) The method of claim 15, wherein the optical code is provided on the article by forming the optical code on an intermediate medium and attaching the intermediate medium to the article. ### Claim 23 A system for providing an input to an application executing on a computer system coupled with an interactive display surface, the system comprising: (a) an identifying code selected to be detectable by the interactive display surface when the identifying code is positioned adjacent to the interactive display surface; (b) an attachment device adapted to removably affix the identifying code to a portion of a user's hand (c) a digital video camera mounted behind the display surface, the display surface being translucent, the digital video camera being responsive to infrared (IR) light and the digital video camera being responsive only to IR light reflected from an article in contact with or a short distance above the display surface; (d) an infrared (IR) light source comprising a plurality of IR light emitting diodes (LEDs) mounted such that the IR light produced by the LEDs is directed toward the underside of the display surface; (e) a baffle disposed between the IR light source and the digital video camera to prevent IR light that is directly emitted from the IR light source from entering the digital video camera; and (f) a set of orthogonal X and Y axes associated with the display surface. ### Claim 24 (depends on 23) The system of claim 23, wherein the identifying code includes at least one of a bar code, a matrix code, a radial code, a gray scale code, an identifiable color, and a distinctive shape. ### Claim 25 (depends on 23) The system of claim 23, wherein the identifying code is associated with a response in the application, said response being invoked upon the IR light sensor detecting the IR light reflected by the identifying code positioned adjacent to the interactive display surface. ### Claim 26 (depends on 23) The system of claim 23, wherein the attachment device includes a deformable digit cap adapted to be worn on an end of a user's digit. ### Claim 27 (depends on 23) The system of claim 23, wherein the attachment device includes a layer having a first surface adapted to be removably adhered to a user's digit, and a second surface on which the identifying code is provided. ### Claim 28 (depends on 23) The system of claim 23, wherein the attachment device includes a hand covering adapted to cover at least a portion of a palm of a user's hand. ### Claim 29 (depends on 28) The system of claim 28, wherein the hand covering includes one of a glove, a mitten, a mitt, and a panel adapted to be attach to a user's hand. ### Claim 30 (depends on 28) The system of claim 28, wherein a plurality of different identifying codes are disposed at a plurality of locations on the hand covering, each of the plurality of different identifying codes being associated with a specific response in the application that is invoked upon detecting that a user's hand has positioned the identifying code associated with the response adjacent to the interactive display surface. ### Claim 31 (depends on 23) The system of claim 23, wherein the identifying code is provided on the attachment device by at least one of forming, molding, printing, and depositing the identifying code on the attachment device. ### Claim 32 (depends on 23) The system of claim 23, wherein the identifying code is provided on the attachment device by forming the identifying code on an intermediate medium and attaching the intermediate medium to the attachment device.