Contextual in-game element recognition, annotation and interaction based on remote user input

A method for annotating a video frame generated by a video game, the method comprising:

• executing a video game overlay concurrently with the video game, the executing the video game overlay including:
• receiving a remote user input from one or more remote devices over a network;
• applying a video game model that associates element tags with elements of the video game to:
• parse the remote user input and extract therefrom an element tag corresponding to the video game;
• and
• identify an element of the video game that corresponds to the element tag;
• and
• annotating the video frame based on the identified element and a location of the identified element.

A computer program product comprising a computer-readable memory having computer program logic recorded thereon that when executed by at least one processor causes the at least one processor to perform a method comprising:

• executing a video game overlay concurrently with the video game, the executing the video game overlay comprising:
• receiving a remote user input from one or more remote devices over a network;
• applying a video game model that associates element tags with elements of the video game to:
• parse the remote user input and extract therefrom an element tag corresponding to the video game;
• and
• identifying an element of the video game that corresponds to the element tag;
• and
• annotating the video frame based on the identified element and a location of the identified element.