# US 2014/0198049 A1 · Method and apparatus for determining user input in a three-dimensional field > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0198049 A1 - Document ID: US20140198049A1 - Status: Published application - Kind: A1 - Application number: 14/213,576 - Filed: 2014-03-14 - Published: 2014-07-17 - Earliest claimed: 2013-01-14 - Inventors: Lai Xue; Darren Lim - Web page: https://patentgrep.com/patent/US20140198049A1 ## CPC - G06F 1/1662: {Details related to the integrated keyboard} - G06F 1/1686: {the I/O peripheral being an integrated camera} - G06F 1/169: {the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes (G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0233: {Character input methods} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 3/0426: {tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract In accordance with one implementation, a method is illustrated that allows a computing device to determine a user input. The method includes detecting one or more user input objects in a 3-dimensional field relative to a 2-dimensional surface. The method also includes determining coordinates for the one or more user input objects relative to the 2-dimensional surface. And, the method further includes determining a user input based on the coordinates. ## Claims ### Claim 1 A method of determining user input in a 3D field relative to a 2D surface, the method comprising: detecting one or more user input objects in a 3-dimensional field relative to a 2-dimensional surface; determining coordinates for the one or more user input objects relative to the 2-dimensional surface; determining a user input based on the coordinates. ### Claim 2 (depends on 1) The method of claim 1 and further comprising: mapping coordinates corresponding to the position of at least one of the input objects relative to the 2-dimensional surface to a display surface. ### Claim 3 (depends on 1) The method of claim 1 wherein the detecting one or more user input objects comprises: utilizing capacitive sensors in keys of a keyboard to detect the one or more user input objects. ### Claim 4 (depends on 3) The method of claim 3 wherein the keys of the keyboard delineate the 2 dimensional surface. ### Claim 5 (depends on 1) The method of claim 1 and further comprising: utilizing at least one camera to detect the one or more user input objects. ### Claim 6 (depends on 1) The method of claim 1 and further comprising: utilizing optical sensors in keys of a keyboard to detect the one or more user input objects. ### Claim 7 (depends on 6) The method of claim 6 wherein the keys of the keyboard delineate the 2 dimensional surface. ### Claim 8 (depends on 1) The method of claim 1 wherein determining a user input comprises determining a hover event. ### Claim 9 (depends on 1) The method of claim 1 wherein determining a user input comprises determining a touch event. ### Claim 10 (depends on 1) The method of claim 1 and further comprising: turning off a hover mode when a touch event is detected. ### Claim 11 (depends on 1) The method of claim 1 and further comprising: displaying a user input on the display surface. ### Claim 12 One or more computer-readable storage media encoding computer-executable instructions for executing on a computer system a computer process, the computer process comprising: detecting one or more user input objects in a 3-dimensional field relative to a 2-dimensional surface; determining coordinates for the one or more user input objects relative to the 2-dimensional surface; determining a user input based on the coordinates. ### Claim 13 (depends on 12) The one or more computer-readable storage media of claim 12 wherein the computer process further comprises: mapping coordinates corresponding to the position of at least one of the input objects relative to the 2-dimensional surface to a display surface. ### Claim 14 (depends on 17) The one or more computer-readable storage media of claim 17 wherein the detecting one or more user input objects comprises: utilizing capacitive sensors in keys of a keyboard to detect the one or more user input objects. ### Claim 15 (depends on 12) The one or more computer-readable storage media of claim 12 wherein the computer process further comprises: utilizing at least one camera to detect the one or more user input objects. ### Claim 16 (depends on 12) The one or more computer-readable storage media of claim 12 wherein the computer process further comprises: utilizing optical sensors in keys of a keyboard to detect the one or more user input objects. ### Claim 17 (depends on 12) The one or more computer-readable storage media of claim 12 wherein determining a user input comprises determining a hover event. ### Claim 18 (depends on 12) The one or more computer-readable storage media of claim 12 wherein determining a user input comprises determining a touch event. ### Claim 19 (depends on 12) The one or more computer-readable storage media of claim 12 wherein the computer process further comprises: turning off a hover mode when a touch event is detected. ### Claim 20 (depends on 12) The one or more computer-readable storage media of claim 12 wherein the computer process further comprises: displaying a user input on the display surface. ### Claim 21 An apparatus comprising: a 2-dimensional surface; an object detection circuit configured to detect one or more user input objects in a 3-dimensional field relative to the 2-dimensional surface and configured to determine coordinates of one or more input objects relative to the 2-dimensional surface; and a user input detector configured to determine a user input based on the coordinates. ### Claim 22 (depends on 21) The apparatus as claimed in claim 21 and further comprising: a display surface; and a mapper configured to map coordinates corresponding to the position of at least one of the input objects relative to the 2-dimensional surface to the display surface. ### Claim 23 (depends on 21) The apparatus as claimed in claim 21 wherein the 2-dimensional surface comprises a keyboard comprising keys having capacitive sensors. ### Claim 24 (depends on 21) The apparatus as claimed in claim 21 wherein the object detection circuit comprises one or more cameras. ### Claim 25 (depends on 21) The apparatus as claimed in claim 21 wherein the object detection circuit comprises a keyboard comprising keys having optical sensors. ### Claim 26 (depends on 21) The apparatus as claimed in claim 21 wherein the user input detector is configured to determine a hover event. ### Claim 27 (depends on 21) The apparatus as claimed in claim 21 wherein the user input detector is configured to determine a touch event. ### Claim 28 (depends on 31) The apparatus as claimed in claim 31 and further comprising a display controller configured to display user input on the display based on the coordinates. ### Claim 29 (depends on 28) The apparatus as claimed in claim 28 wherein the display controller is further configured to vary a display element characteristic based on a change in a proximity of at least one input object to the 2-dimensional surface. ### Claim 30 (depends on 29) The apparatus as claimed in claim 29 wherein the display controller is configured to vary a diameter of a circle used for the display element.