# US 10,872,453 B2 · Rendering of virtual hand pose based on detected hand input > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,872,453 B2 - Document ID: US10872453B2 - Status: Granted - Kind: B2 - Application number: 16/731,855 - Filed: 2019-12-31 - Published: 2020-04-30 - Granted: 2020-12-22 - Earliest claimed: 2017-09-29 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment Inc. - Inventors: Yutaka Yokokawa - Web page: https://patentgrep.com/patent/US10872453B2 ## CPC - G06T 13/40: of characters, e.g. humans, animals or virtual beings - G06F 3/012: {Head tracking input arrangements} - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method is provided, including the following operations: receiving, from a controller device, controller input that identifies postures of at least two fingers of the user's hand; determining a similarity of the controller input to a predefined target input; rendering in a virtual space a virtual hand that corresponds to the controller device, wherein when the similarity exceeds a predefined threshold, then, in response the virtual hand is animated so that a pose of the virtual hand transitions to a predefined hand pose, such that postures of fingers of the virtual hand transition to predefined finger postures of the predefined hand pose, and wherein when the similarity does not exceed the predefined threshold, then the virtual hand is rendered so that the pose of the virtual hand dynamically changes in response to changes in the controller input. ## Claims ### Claim 1 A method, comprising: receiving, from a controller device that is held by a user's hand, controller input that identifies postures of at least two fingers of the user's hand; determining a similarity of the controller input by the at least two fingers of the user's hand that holds the controller device to a predefined target input; rendering in a virtual space a virtual hand that corresponds to the controller device, wherein when the similarity exceeds a predefined threshold, then, in response the virtual hand is animated so that a pose of the virtual hand transitions to a predefined hand pose, such that postures of fingers of the virtual hand transition to predefined finger postures of the predefined hand pose, and wherein when the similarity does not exceed the predefined threshold, then the virtual hand is rendered so that the pose of the virtual hand dynamically changes in response to changes in the controller input. ### Claim 2 (depends on 1) The method of claim 1, wherein the postures of fingers of the virtual hand are independent of a location and orientation of the virtual hand in the virtual space. ### Claim 3 (depends on 2) The method of claim 2, wherein the postures of the virtual fingers are defined by amounts of one or more of flexion, extension, abduction, adduction, and/or circumduction of the virtual fingers. ### Claim 4 (depends on 1) The method of claim 1, wherein rendering the virtual hand so that the pose of the virtual hand dynamically changes in response to changes in the controller input includes changing the posture of at least one virtual finger of the virtual hand in response to a change in the controller input that detects a change in posture of at least one of the plurality of fingers. ### Claim 5 (depends on 1) The method of claim 1, wherein the rendering of the predefined hand pose is maintained for a duration when the similarity continues to exceed the predefined threshold, such that changes in the controller input that do not cause the similarity to not exceed the predefined threshold do not result in changes in the pose of the virtual hand. ### Claim 6 (depends on 1) The method of claim 1, wherein the postures of the at least two fingers of the user's hand are independent of a location and orientation of the user's hand in a local environment. ### Claim 7 (depends on 6) The method of claim 6, wherein the postures of the at least two fingers of the user's hand are defined by amounts of one or more of flexion, extension, abduction, adduction, and/or circumduction of the at least two fingers of the user's hand. ### Claim 8 (depends on 1) The method of claim 1, wherein determining the similarity includes determining deviations of values of the controller input from corresponding values of the predefined target input. ### Claim 9 A non-transitory computer readable medium having program instructions embodied thereon that, when executed by at least one computing device, cause said at least one computing device to perform a method including the following operations: receiving, from a controller device that is held by a user's hand, controller input that identifies postures of at least two fingers of the user's hand; determining a similarity of the controller input by the at least two fingers of the user's hand that holds the controller device to a predefined target input; rendering in a virtual space a virtual hand that corresponds to the controller device, wherein when the similarity exceeds a predefined threshold, then, in response the virtual hand is animated so that a pose of the virtual hand transitions to a predefined hand pose, such that postures of fingers of the virtual hand transition to predefined finger postures of the predefined hand pose, and wherein when the similarity does not exceed the predefined threshold, then the virtual hand is rendered so that the pose of the virtual hand dynamically changes in response to changes in the controller input. ### Claim 10 (depends on 9) The non-transitory computer readable medium of claim 9, wherein the postures of fingers of the virtual hand are independent of a location and orientation of the virtual hand in the virtual space. ### Claim 11 (depends on 10) The non-transitory computer readable medium of claim 10, wherein the postures of the virtual fingers are defined by amounts of one or more of flexion, extension, abduction, adduction, and/or circumduction of the virtual fingers. ### Claim 12 (depends on 9) The non-transitory computer readable medium of claim 9, wherein rendering the virtual hand so that the pose of the virtual hand dynamically changes in response to changes in the controller input includes changing the posture of at least one virtual finger of the virtual hand in response to a change in the controller input that detects a change in posture of at least one of the plurality of fingers. ### Claim 13 (depends on 9) The non-transitory computer readable medium of claim 9, wherein the rendering of the predefined hand pose is maintained for a duration when the similarity continues to exceed the predefined threshold, such that changes in the controller input that do not cause the similarity to not exceed the predefined threshold do not result in changes in the pose of the virtual hand. ### Claim 14 (depends on 9) The non-transitory computer readable medium of claim 9, wherein the postures of the at least two fingers of the user's hand are independent of a location and orientation of the user's hand in a local environment. ### Claim 15 (depends on 14) The non-transitory computer readable medium of claim 14, wherein the postures of the at least two fingers of the user's hand are defined by amounts of one or more of flexion, extension, abduction, adduction, and/or circumduction of the at least two fingers of the user's hand. ### Claim 16 (depends on 9) The non-transitory computer readable medium of claim 9, wherein determining the similarity includes determining deviations of values of the controller input from corresponding values of the predefined target input. ### Claim 17 A system, comprising: a controller device, that is held by a user's hand, that generates controller input that identifies postures of at least two fingers of the user's hand; a computing device that determines a similarity of the controller input by the at least two fingers of the user's hand that holds the controller device to a predefined target input, and wherein the computing device renders in a virtual space a virtual hand that corresponds to the controller device, wherein when the similarity exceeds a predefined threshold, then, in response the virtual hand is animated so that a pose of the virtual hand transitions to a predefined hand pose, such that postures of fingers of the virtual hand transition to predefined finger postures of the predefined hand pose, and wherein when the similarity does not exceed the predefined threshold, then the virtual hand is rendered so that the pose of the virtual hand dynamically changes in response to changes in the controller input. ### Claim 18 (depends on 17) The system of claim 17, wherein the postures of fingers of the virtual hand are independent of a location and orientation of the virtual hand in the virtual space. ### Claim 19 (depends on 18) The system of claim 18, wherein the postures of the virtual fingers are defined by amounts of one or more of flexion, extension, abduction, adduction, and/or circumduction of the virtual fingers. ### Claim 20 (depends on 17) The system of claim 17, wherein rendering the virtual hand so that the pose of the virtual hand dynamically changes in response to changes in the controller input includes changing the posture of at least one virtual finger of the virtual hand in response to a change in the controller input that detects a change in posture of at least one of the plurality of fingers.