System for assigning aliases to signs and objects in video data

A non-transitory machine-readable medium comprising instructions that when executed by a processor execute a process comprising:

• receiving into a computer processor an image from an image sensing device, the image comprising a person executing a sign using one or more hands of the person;
• determining whether the sign is a sign of a sign language;
• determining whether the sign points to an object in the image;
• determining whether the sign indicates that the person wants to assign an alias to the sign of the sign language or the object in the image;
• determining whether the sign uses the alias;
• and
• executing an action based on whether the sign comprises the sign of the sign language, the sign identifying the object in the image, the sign assigning the alias, or the sign using the alias.

A system comprising:

• a computer processor;
• and
• a memory coupled to the computer processor;
• wherein the computer processor and memory are operable for:
• receiving into the computer processor an image from an image sensing device, the image comprising a person executing a sign using one or more hands of the person;
• determining whether the sign is a sign of a sign language;
• determining whether the sign points to an object in the image;
• determining whether the sign indicates that the person wants to assign an alias to the sign of the sign language or the object in the image;
• determining whether the sign uses the alias;
• and
• executing an action based on whether the sign comprises the sign of the sign language, the sign identifying the object in the image, the sign assigning the alias, or the sign using the alias.