# US 2025/0148831 A1 · System for assigning aliases to signs and objects in video data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0148831 A1 - Document ID: US20250148831A1 - Status: Published application - Kind: A1 - Application number: 18/500,767 - Filed: 2023-11-02 - Published: 2025-05-08 - Earliest claimed: 2023-11-02 - Assignees: Lenovo (Singapore) Pte. Ltd. - Applicants: Lenovo (Singapore) Pte. Ltd. - Inventors: Jampierre Vieira Rocha; Silvan Ferreira da Silva Junior; Jayne de Morais Silva; Guiherme de Magalhães Pupio - Web page: https://patentgrep.com/patent/US20250148831A1 ## CPC - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components - G06V 10/764: using classification, e.g. of video objects - G06V 40/107: {Static hand or arm} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A system receives an image that includes a person executing a sign. The system determines whether the sign is a sign of a sign language, the sign points to an object in the image, the sign indicates that the person wants to assign an alias to the sign of the sign language or the object in the image, and/or whether the sign uses the alias. After this determination, the system executes an action based on whether the sign comprises the sign of the sign language, the sign identifying the object in the image, the sign assigning the alias, or the sign using the alias. ## Claims ### Claim 1 A computerized process comprising: receiving into a computer processor an image from an image sensing device, the image comprising a person executing a sign using one or more hands of the person; determining whether the sign is a sign of a sign language; determining whether the sign points to an object in the image; determining whether the sign indicates that the person wants to assign an alias to the sign of the sign language or the object in the image; determining whether the sign uses the alias; and executing an action based on whether the sign comprises the sign of the sign language, the sign identifying the object in the image, the sign assigning the alias, or the sign using the alias. ### Claim 2 (depends on 1) The computerized process of claim 1, wherein an output of the determinations of whether the sign comprises a sign of the sign language, the sign identifying the object, the sign assigning the alias, or the sign using the alias, is placed into a queue for further processing. ### Claim 3 (depends on 1) The computerized process of claim 1, wherein the determination of whether the sign comprises the sign of the sign language, the sign identifying the object, the sign assigning the alias, or the sign using the alias, uses a keypoint extractor module to extract keypoints on the one or more hands of the person. ### Claim 4 (depends on 1) The computerized process of claim 1, wherein the determining whether the sign is a sign of a sign language comprises using a sign classification model. ### Claim 5 (depends on 1) The process of claim 1, wherein the determining that the person wants to assign the alias to the sign of the sign language comprises receiving the sign of the sign language, determining a distance between a first finger of a first hand of the person and a distance between a second finger of a second hand of the person, determining that the distance is less than a threshold, and assigning the second finger as the alias. ### Claim 6 (depends on 1) The computerized process of claim 1, wherein the determining whether the sign points to an object in the image comprises identifying the sign as a pointing gesture, identifying the object in the image pointed to by the pointing gesture, and assigning the alias to the object. ### Claim 7 (depends on 6) The computerized process of claim 6, wherein the assigning the alias to the object comprises receiving from the person a pointing of a first finger on a first hand to a second finger on a second hand, and assigning the alias to the second finger on the second hand. ### Claim 8 (depends on 1) The computerized process of claim 1, wherein the determining whether the sign uses the alias comprises determining a distance between a first finger of a first hand of the person and a distance between a second finger of a second hand of the person, determining that the distance is less than a threshold, and recognizing the second finger as the alias. ### Claim 9 (depends on 1) The computerized process of claim 1, comprising receiving a clearing sign, the clearing sign causing a clearing of one or more aliases. ### Claim 10 (depends on 1) The computerized process of claim 1, comprising receiving a plurality of signs after an assigning of the alias to the sign of the sign language or the object in the image; and maintaining the alias. ### Claim 11 A non-transitory machine-readable medium comprising instructions that when executed by a processor execute a process comprising: receiving into a computer processor an image from an image sensing device, the image comprising a person executing a sign using one or more hands of the person; determining whether the sign is a sign of a sign language; determining whether the sign points to an object in the image; determining whether the sign indicates that the person wants to assign an alias to the sign of the sign language or the object in the image; determining whether the sign uses the alias; and executing an action based on whether the sign comprises the sign of the sign language, the sign identifying the object in the image, the sign assigning the alias, or the sign using the alias. ### Claim 12 (depends on 11) The non-transitory machine-readable medium of claim 11, wherein an output of the determinations of whether the sign comprises a sign of the sign language, the sign identifying the object, the sign assigning the alias, or the sign using the alias, is placed into a queue for further processing. ### Claim 13 (depends on 11) The non-transitory machine-readable medium of claim 11, wherein the determination of whether the sign comprises the sign of the sign language, the sign identifying the object, the sign assigning the alias, or the sign using the alias, uses a keypoint extractor module to extract keypoints on the one or more hands of the person. ### Claim 14 (depends on 11) The non-transitory machine-readable medium of claim 11, wherein the determining that the person wants to assign the alias to the sign of the sign language comprises receiving the sign of the sign language, determining a distance between a first finger of a first hand of the person and a distance between a second finger of a second hand of the person, determining that the distance is less than a threshold, and assigning the second finger as the alias. ### Claim 15 (depends on 11) The non-transitory machine-readable medium of claim 11, wherein the determining whether the sign points to an object in the image comprises identifying the sign as a pointing gesture, identifying the object in the image pointed to by the pointing gesture, and assigning the alias to the object; and wherein the assigning the alias to the object comprises receiving from the person a pointing of a first finger on a first hand to a second finger on a second hand, and assigning the alias to the second finger on the second hand. ### Claim 16 (depends on 11) The non-transitory machine-readable medium of claim 11, wherein the determining whether the sign uses the alias comprises determining a distance between a first finger of a first hand of the person and a distance between a second finger of a second hand of the person, determining that the distance is less than a threshold, and recognizing the second finger as the alias. ### Claim 17 (depends on 11) The non-transitory machine-readable medium of claim 11, comprising instructions for receiving a clearing sign, the clearing sign causing a clearing of one or more aliases. ### Claim 18 (depends on 11) The non-transitory machine-readable medium of claim 11, comprising instructions for receiving a plurality of signs after an assigning of the alias to the sign of the sign language or the object in the image; and maintaining the alias. ### Claim 19 A system comprising: a computer processor; and a memory coupled to the computer processor; wherein the computer processor and memory are operable for: receiving into the computer processor an image from an image sensing device, the image comprising a person executing a sign using one or more hands of the person; determining whether the sign is a sign of a sign language; determining whether the sign points to an object in the image; determining whether the sign indicates that the person wants to assign an alias to the sign of the sign language or the object in the image; determining whether the sign uses the alias; and executing an action based on whether the sign comprises the sign of the sign language, the sign identifying the object in the image, the sign assigning the alias, or the sign using the alias. ### Claim 20 (depends on 19) The system of claim 19, wherein an output of the determinations of whether the sign comprises a sign of the sign language, the sign identifying the object, the sign assigning the alias, or the sign using the alias, is placed into a queue for further processing.