# US 2024/0189709 A1 · Using images of upper body motion only to generate running vr character > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2024/0189709 A1 - Document ID: US20240189709A1 - Status: Published application - Kind: A1 - Application number: 18/064,824 - Filed: 2022-12-12 - Published: 2024-06-13 - Earliest claimed: 2022-12-12 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment LLC - Inventors: Daisuke Kawamura; Udupi Ramanath Bhat - Web page: https://patentgrep.com/patent/US20240189709A1 ## CPC - A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes - A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A video game player's upper body pose and/or motion can be used for controlling lower body motion of a game character. For example, arm swinging can translate to video game character running. Raising both hands above the user's head can translate to video game character jumping. Leaning to the left or right can translate to video game character movement in the left or right directions, respectively. Additionally, raising a single hand can translate to selecting a user interface button. ## Claims ### Claim 1 An apparatus comprising: at least one processor configured to: receive input from a camera; based on the input, identify at least one factor related to a user's upper body; and based on identification of the at least one factor related to the user's upper body, control lower body motion of a video game character according to the at least one factor. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the at least one factor comprises an upper body lean to one of: the left, the right. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the processor is configured to: based on identification of the upper body lean, control the lower body motion of the video game character to move in a direction indicated by the upper body lean. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the at least one factor comprises upper body arm motion. ### Claim 5 (depends on 4) The apparatus of claim 4, wherein the upper body arm motion comprises arm pumping, and wherein the processor is configured to: based on identification of the arm pumping, control the lower body motion of the video game character to run. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the at least one factor comprises two hands above the user's head, and wherein the processor is configured to: based on identification of the two hands above the user's head, control the lower body motion of the video game character to jump. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the input is first input, and wherein the processor is further configured to: receive second input from the camera; based on the second input from the camera, identify a raised hand; and based on identification of the raised hand, begin presenting a video game in which the video game character is controlled according to the at least one factor. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the input is first input, and wherein the processor is further configured to: receive second input from the camera; and based on the second input indicating a raised left hand, select a first selector presented on a left-hand side of a display. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the processor is configured to: based on the second input indicating a raised right hand, select a second selector presented on a right-hand side of a display, the second selector being different from the first selector. ### Claim 10 (depends on 1) The apparatus of claim 1, comprising the camera. ### Claim 11 (depends on 10) The apparatus of claim 10, wherein the camera is a depth-sensing camera. ### Claim 12 A method, comprising: receiving input from a camera; based on the input, identifying at least one factor related to a user's upper body; and based on identifying the at least one factor related to the user's upper body, controlling execution of a computer simulation to indicate lower body motion of a simulation character according to the at least one factor. ### Claim 13 (depends on 12) The method of claim 12, wherein the computer simulation comprises a game. ### Claim 14 (depends on 12) The method of claim 12, wherein the at least one factor comprises an upper body lean to one of: the left, the right; and wherein the method comprises: based on identifying the upper body lean, controlling execution of the computer simulation to indicate the lower body motion of the simulation character to move in a direction indicated by the upper body lean. ### Claim 15 (depends on 12) The method of claim 12, wherein the at least one factor comprises arm swinging; and wherein the method comprises: based on identifying the arm swinging, controlling execution of the computer simulation to indicate the simulation character as running. ### Claim 16 (depends on 12) The method of claim 12, wherein the at least one factor comprises two hands above the user's head, and wherein the method comprises: based on identifying the two hands above the user's head, controlling execution of the computer simulation to indicate the simulation character as jumping. ### Claim 17 (depends on 12) The method of claim 12, wherein the input is first input, and wherein the method further comprises: receiving second input from the camera; and based on the second input indicating a raised hand, selecting a selector presented on a display. ### Claim 18 A device comprising: at least one computer storage that is not a transitory signal and that comprises instructions executable by at least one processor to: receive input from a camera; based on the input, identify at least one factor related to a user's upper body; and based on identification of the at least one factor related to the user's upper body, control execution of a computer simulation to indicate lower body motion in the computer simulation according to the at least one factor. ### Claim 19 (depends on 18) The device of claim 18, wherein the lower body motion comprises running. ### Claim 20 (depends on 18) The device of claim 18, wherein the lower body motion comprises jumping.