Real-time gesture detection and recognition

A device, comprising:

• one or more memories;
• and
• one or more processors, operatively coupled to the one or more memories, to:
• receive a request associated with a gesture translation service,
• wherein the request includes:
• text data that describes one or more gestures, or
• image data or multimedia data that depict the one or more gestures;
• determine whether the gesture translation service is a first type of gesture translation service or a second type of gesture translation service based on information included in the request,
• wherein:
• the first type of gesture translation service involves translating the text data to an image or multimedia format, and
• the second type of gesture translation service involves translating the image data or the multimedia data to a text format;
• determine whether to perform a set of filtering and conversion techniques based on whether the gesture translation service is the second type of gesture translation service,
• wherein the set of filtering and conversion techniques, when performed, cause a set of frames to be created that include modified image data identifying a grayscale or black and white depiction of the one or more gestures and cause one or more graphical representations of the one or more gestures identified by the modified image data to be generated;
• determine whether to perform a first matching technique or a second matching technique based on whether the gesture translation service is the first type of gesture translation service or the second type of gesture translation service;
• select, using the first matching technique or the second matching technique, a first identifier based on determining to perform the first matching technique or a second identifier based on determining to perform the second matching technique,
• wherein the first identifier is associated with particular text data that describes one or more corresponding gestures, and
• wherein the second identifier is associated with a graphical representation of the one or more corresponding gestures;
• identify response data using the first identifier or the second identifier,
• wherein the response data is stored in association with the first identifier and is particular image data or particular multimedia data that depicts the one or more corresponding gestures or the response data is stored in association with the second identifier and is the particular text data that describes the one or more corresponding gestures;
• and
• cause the response data to be displayed via an interface.

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• one or more instructions that, when executed by one or more processors of a device, cause the one or more processors to:
• receive, as part of a gesture translation service, data that depicts one or more gestures,
• wherein the data is image data or multimedia data;
• convert a first set of frames to a second set of frames that include modified data identifying a grayscale or black and white depiction of the one or more gestures;
• generate one or more graphical representations of the one or more gestures identified by the modified data;
• select, using a matching technique, a graphical representation of one or more corresponding gestures,
• wherein the graphical representation of the one or more corresponding gestures matches or satisfies a threshold level of similarity with the one or more graphical representations of the one or more gestures identified by the modified data;
• identify response data that is representative of the one or more corresponding gestures based on the response data being stored in association with the graphical representation that has been selected or an identifier for the graphical representation that has been selected;
• and
• provide the response data that is representative of the one or more corresponding gestures to be displayed via an interface,
• wherein the response data is displayed as text data or audio data.