# US 8,540,573 B2 · Game object control using pointing inputs to rotate a displayed virtual object control device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,540,573 B2 - Document ID: US8540573B2 - Status: Granted - Kind: B2 - Application number: 13/476,740 - Filed: 2012-05-21 - Published: 2012-09-13 - Granted: 2013-09-24 - Earliest claimed: 2005-10-05 - Assignees: Nintendo Co., Ltd. - Applicants: Robert Champagne; Shigeki Yamashiro; Shigeru Miyamoto; Claude Comair - Inventors: Robert Champagne; Shigeki Yamashiro; Shigeru Miyamoto; Claude Comair - Web page: https://patentgrep.com/patent/US8540573B2 ## CPC - A63F 13/10 - A63F 13/2145: the surface being also a display device, e.g. touch screens - A63F 13/00: Video games, i.e. games using an electronically generated display having two or more dimensions - A63F 13/245: specially adapted to a particular type of game, e.g. steering wheels - A63F 13/285: Generating tactile feedback signals via the game input device, e.g. force feedback - A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle - A63F 13/45: Controlling the progress of the video game - A63F 13/803: Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks - A63F 13/98: Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) - G09B 9/04: for teaching control of land vehicles - A63F 2300/204: the platform being a handheld device - A63F 2300/301: using an additional display connected to the game console, e.g. on the controller - A63F 2300/6045: for mapping control signals received from the input arrangement into game commands - A63F 2300/8017: Driving on land or water; Flying - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract A vehicle simulation such as for example a driving game can be provided by displaying an image of a steering wheel on a touch sensitive screen. Touch inputs are used to control the rotational orientation of displayed steering wheel. The rotational orientation of the displayed steering wheel is used to apply course correction effects to a simulated vehicle. Selective application of driver assist and different scaling of touch inputs may be provided. ## Claims ### Claim 1 A method of controlling a virtual object in a video game, comprising: using at least one processor, displaying an image of at least a portion of a virtual hand-manipulable control device on a display; using the at least one processor, receiving user pointing inputs; using the at least one processor, converting the received user pointing inputs into rotation of the displayed virtual control device thereby enabling a video game player to virtually manipulate said displayed virtual control device using said pointing inputs, including rotating the displayed virtual control device image by an amount and in a direction determined at least in part based on the detected pointing inputs; and using the at least one processor, controlling a movement path of a displayed object in said video game in response to displayed virtual control device image rotation. ### Claim 2 (depends on 1) The method of claim 1, wherein the processor uses the user pointing inputs to define an initial vector and a final vector relative to a predetermined point, and wherein the rotating comprises rotating the displayed virtual control device by an amount responsive to the angle between the initial vector and the final vector. ### Claim 3 (depends on 1) The method of claim 1, further including selectively applying user assist in response to detection of said user pointing inputs within a predetermined zone on the display. ### Claim 4 (depends on 1) The method of claim 1, further including simulating vibration of the displayed virtual control device. ### Claim 5 (depends on 1) The method of claim 1, wherein the converting includes changing the scaling of the inputs depending at least in part on a type of pointing device used to provide the pointing inputs. ### Claim 6 (depends on 1) The method of claim 1, wherein the virtual control device comprises a vehicular steering wheel and the pointing inputs comprise touch screen positional pointing inputs. ### Claim 7 A simulation apparatus comprising: a display screen displaying a display cursor; an input device for moving the display cursor in response to pointing inputs; a first graphics processing unit that displays an image of a simulated control device on a first part of the display; a second graphics processing unit that displays an image of a simulated object on a second part of the display; and a processor, coupled to the first and second graphics processing units and to pointing device, the processor changing the displayed image of the simulated control device in a predetermined manner by a predetermined amount responsive to a user moving the display cursor using pointing inputs and animating the simulated control device thereby enabling the user to virtually manipulate and move the simulated control device using the pointing inputs, and applying a corresponding course correction to said simulated object displayed on the second part of the display. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the processor is adapted to receive inputs from a handheld pointing device and provide the display changes at least in part in response thereto. ### Claim 9 (depends on 7) The apparatus of claim 7, further comprising means for selectively providing control assist and blending the assist with the control input to generate the corresponding course correction. ### Claim 10 (depends on 7) The apparatus of claim 7, wherein the simulated control device comprises a steering wheel. ### Claim 11 (depends on 7) The apparatus of claim 7, wherein said simulated control device comprises a visual target. ### Claim 12 (depends on 7) The apparatus of claim 7, wherein the processor reduces course correction amount over time in response to detecting absence of pointing inputs. ### Claim 13 (depends on 7) The apparatus of claim 7, wherein the processor calculates a delta steering value based on scaled left/right movement of the pointing input. ### Claim 14 (depends on 7) The apparatus of claim 7, wherein the processor calculates an angle that the simulated object should be pointed to be aligned with a predetermined path. ### Claim 15 A non-transitory storage device storing information including instructions for controlling a virtual object in a video game, the stored instructions comprising: first instructions controlling at least one processor to display an image of at least a portion of a virtual hand-manipulable control device on a display; second instructions controlling at least one processor to receive user inputs pointing at said display; third instructions controlling at least one processor to convert the received user pointing inputs into rotation of the displayed virtual control device thereby enabling a video game player to virtually manipulate said displayed virtual control device using said pointing inputs, including rotating the displayed virtual control device image by an amount and in a direction determined at least in part based on the detected pointing inputs; and fourth instructions controlling the processor to use displayed virtual control device image rotation to control a movement path of a displayed object in said video game. ### Claim 16 A display device comprising: a handheld housing having a touch screen thereon; and a processor coupled to the touch screen, the processor displaying a virtual control device on the touch screen, the processor receiving touch inputs from the touch screen and rotating the virtual control device by a rotational amount and in a rotational direction determined at least in part based on the received touch screen inputs; the processor controlling the touch screen to also display a virtual object and to control or alter a movement path of the displayed virtual object in response to the rotational amount and rotational direction of the displayed virtual control device. ### Claim 17 (depends on 16) The display device of claim 16 wherein the displayed virtual control device comprises a steering wheel and the displayed virtual object comprises a virtual vehicle. ### Claim 18 (depends on 16) The display device of claim 16 wherein the touch inputs do not touch the displayed virtual control device but nevertheless define an angle of rotation of the virtual control device. ### Claim 19 (depends on 16) The display device of claim 16 wherein the processor divides the touch screen into zones, different zones corresponding to different input control scales to indicate how much control is exerted for the same amount of touch input position change.