# US 2014/0155165 A1 · Game controller on mobile touch-enabled devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0155165 A1 - Document ID: US20140155165A1 - Status: Published application - Kind: A1 - Application number: 14/173,802 - Filed: 2014-02-05 - Published: 2014-06-05 - Earliest claimed: 2011-10-04 - Assignees: Microsoft Corporation - Applicants: Microsoft Corporation - Inventors: Monty Lee Hammontree; Tyler Edward Gibson; Emmanuel John Athans - Web page: https://patentgrep.com/patent/US20140155165A1 ## CPC - A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle - A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes - A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) - A63F 13/2145: the surface being also a display device, e.g. touch screens - A63F 13/285: Generating tactile feedback signals via the game input device, e.g. force feedback - A63F 13/426: involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun - A63F 13/533: for prompting the player, e.g. by displaying a game menu - A63F 13/92: Video game devices specially adapted to be hand-held while playing - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes - A63F 2300/1075: using a touch screen - A63F 2300/308: Details of the user interface - A63F 2300/6045: for mapping control signals received from the input arrangement into game commands - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Various technologies described herein pertain to controlling a game with a mobile touch-enabled device. A thumbstick and a mode selection button can be rendered on a display of the mobile touch-enabled device. The thumbstick can be rendered on a reassignable area of the display and the mode selection button can be rendered on a mode selection area of the display. A touch (e.g., drag) from the mode selection area to the reassignable area can be detected, and an operation in the game can be controlled with the thumbstick represented as being at a depressed height in response to the touch in the reassignable area while the touch is detected without discontinuity of contact from starting the drag. Further, upon detecting discontinuation of the touch, a different operation in the game can be controlled with the thumbstick represented as being at a default height in response to a subsequent touch. ## Claims ### Claim 1 A method of controlling a game with a mobile touch-enabled device, comprising: rendering a trigger button on a display of the mobile touch-enabled device; receiving first data from a sensor of the mobile touch-enabled device indicative of an amount of tilt of a corner of the mobile touch-enabled device relative to a predetermined plane; controlling a first operation in the game as a function of the amount of the tilt of the corner of the mobile touch-enabled device; and rendering depression of the trigger button on the display of the mobile touch-enabled device as a function of the amount of the tilt of the corner of the mobile touch-enabled device. ### Claim 2 (depends on 1) The method of claim 1, wherein the amount of tilt of the corner of the mobile touch-enabled device maps to analog input information for the game, and a level of the analog input information for the game remains constant when the amount of the tilt of the corner of the mobile touch-enabled device remains constant relative to the predetermined plane. ### Claim 3 (depends on 1) The method of claim 1, further comprising rendering the trigger button on a layer above game data on the display of the mobile touch-enabled device. ### Claim 4 (depends on 1) The method of claim 1, further comprising: rendering a second trigger button on the display of the mobile touch-enabled device; receiving second data from the sensor of the mobile touch-enabled device indicative of a second amount of tilt of a second corner of the mobile touch-enabled device relative to the predetermined plane; controlling a second operation in the game as a function of the second amount of the tilt of the second corner of the mobile touch-enabled device; and rendering depression of the second trigger button on the display of the mobile touch-enabled device as a function of the second amount of the tilt of the second corner of the mobile touch-enabled device. ### Claim 5 (depends on 1) The method of claim 1, further comprising: rendering a bumper on the display of the mobile touch-enabled device; receiving second data from at least one of the sensor or a disparate sensor of the mobile touch-enabled device, the second data indicative of rotation of the mobile touch-enabled device in a plane defined by a surface of the display relative to a rest pose; controlling a second operation in the game as a function of the rotation of the mobile touch-enabled device, wherein the rotation of the mobile touch-enabled device maps to discrete input information for the game; and rendering visual feedback related to the bumper on the display of the mobile touch-enabled device as a function of the rotation of the mobile touch-enabled device. ### Claim 6 (depends on 5) The method of claim 5, wherein one of clockwise rotation or counterclockwise rotation of the mobile touch-enabled device is mapped to the second operation in the game, and wherein the other one of clockwise rotation or counterclockwise rotation of the mobile touch-enabled device is mapped to a third operation in the game. ### Claim 7 (depends on 1) The method of claim 1, further comprising: receiving a series of images from a camera coupled with the mobile touch-enabled device; tracking movement of a hand of a user from the series of images; and controlling a second operation in the game as a function of the movement of the hand of the user. ### Claim 8 (depends on 1) The method of claim 1, further comprising identifying a rest pose of the mobile touch-enabled device, wherein a surface of the display of the mobile touch-enabled device in the rest pose defines the predetermined plane. ### Claim 9 (depends on 8) The method of claim 8, wherein the rest pose is identified as at least one of a preset orientation of the mobile touch-enabled device, an orientation of the mobile touch-enabled device at a time of powering on the mobile touch-enabled device, an orientation of the mobile touch-enabled device at a time of starting the game, or an orientation of the mobile touch-enabled device after a predetermined amount of time has lapsed without tilting the mobile touch-enabled device. ### Claim 10 (depends on 1) The method of claim 1, further comprising: rendering a thumbstick on a reassignable area of the display of the mobile touch-enabled device; rendering a mode selection button on a mode selection area of the display of the mobile touch-enabled device, wherein the reassignable area and the mode selection area are non-overlapping; and switching the thumbstick from being represented at a default height to being represented at a depressed height in response to a first touch, wherein the first touch is a drag from the mode selection area of the display to the reassignable area of the display. ### Claim 11 (depends on 10) The method of claim 10, further comprising controlling a second operation in the game with the thumbstick represented at the depressed height in response to a second touch, wherein the second touch is detected within the reassignable area of the display, and wherein the first touch and the second touch are detected without discontinuity of contact. ### Claim 12 (depends on 11) The method of claim 11, further comprising controlling a second operation in the game with the thumbstick represented at the default height in response to a third touch, wherein the third touch is detected within the reassignable area of the display, and wherein the discontinuity of the contact is detected between the first touch and the third touch. ### Claim 13 (depends on 10) The method of claim 10, further comprising rendering movement of the thumbstick within the reassignable area of the display of the mobile touch-enabled device responsive to a second touch detected within the reassignable area of the display. ### Claim 14 A mobile touch-enabled device, comprising: a display; a sensor; and a graphical user interface rendered on the display responsive to touch related data received from the display and data from the sensor, the graphical user interface comprising: visual information related to a game; and a trigger button on a trigger area of the display, wherein the trigger button is rendered above the visual information related to the game on the display; wherein the sensor detects an amount of tilt of the mobile touch-enabled device; wherein a first operation in the game is manipulated as a function of the amount of the tilt of the mobile touch-enabled device; and wherein depression of the trigger button is depicted as a function of the amount of the tilt of the mobile touch-enabled device. ### Claim 15 (depends on 14) The mobile touch-enabled device of claim 14, the graphical user interface further comprising: a thumbstick on a reassignable area of the display, wherein the thumbstick is rendered above the visual information related to the game on the display; and a mode selection button on a mode selection area of the display, wherein the mode selection button is rendered above the visual information related to the game on the display, and wherein the reassignable area and the mode selection area are non-overlapping; wherein the thumbstick switches from being represented at a default height to being represented at a depressed height in response to a drag from the mode selection area of the display to the reassignable area of the display. ### Claim 16 (depends on 15) The mobile touch-enabled device of claim 15, the graphical user interface further comprising: a toggle button on a toggle area of the display, wherein the toggle button is rendered above the visual information related to the game on the display; and a directional pad on the reassignable area, wherein the directional pad is rendered above the visual information related to the game on the display; wherein the graphical user interface switches between the directional pad on the reassignable area and the thumbstick on the reassignable area in response to a touch within the toggle area of the display. ### Claim 17 (depends on 15) The mobile touch-enabled device of claim 15, wherein the thumbstick switches from being represented at the depressed height to being represented at the default height in response to a discontinuation of contact subsequent to the drag. ### Claim 18 (depends on 15) The mobile touch-enabled device of claim 15, wherein differing operations in the game are manipulated in response to a touch in the reassignable area depending upon whether the thumbstick is represented at the default height or at the depressed height. ### Claim 19 A computer-readable storage medium including computer-executable instructions that, when executed by a processor, cause the processor to perform acts including: rendering a trigger button on a display of a mobile touch-enabled device; receiving data from a sensor of the mobile touch-enabled device indicative of an amount of tilt of the mobile touch-enabled device relative to a predetermined plane; controlling a first operation in the game as a function of the amount of the tilt of the mobile touch-enabled device; and rendering depression of the trigger button on the display of the mobile touch-enabled device as a function of the amount of the corner of the mobile touch-enabled device. ### Claim 20 (depends on 19) The computer-readable storage medium of claim 19, wherein the computer-executable instructions, when executed by the processor, further cause the processor to perform acts including: rendering a thumbstick on a reassignable area of the display of the mobile touch-enabled device, wherein the thumbstick is represented at a default height; rendering a mode selection button on a mode selection area of the display of the mobile touch-enabled device, wherein the reassignable area and the mode selection area are non-overlapping; switching the thumbstick from being represented at the default height to being represented at a depressed height in response to a drag from the mode selection area of the display to the reassignable area of the display; and switching the thumbstick from being represented at the depressed height to being represented at the default height in response to a discontinuation of contact subsequent to the drag.