Methods and systems of combining video content with one or more augmentations

A video content augmentation system configured on a client device, the video content augmentation system comprising:

• one or more computer processors;
• memory storing computer-executable instructions that, when executed by the one or more computer processors, cause the one or more computer processors to perform operations comprising:
• receiving, from an external server, video data corresponding to an event, the video data comprising video content and a plurality of transparent bounding boxes;
• presenting, on a graphical user interface, the video content;
• detecting a user selection of a portion of the graphical user interface;
• determining a red, green, blue, alpha (RGBA) value associated with the user selection of the portion of the graphical user interface;
• selecting a particular transparent bounding box from among the plurality of transparent bounding boxes by determining that an RGBA value associated with the particular transparent bounding box corresponds to the RGBA value associated with the user selection of the portion of the graphical user interface;
• transmitting an indicator of the particular transparent bounding box to a renderer;
• receiving, from the renderer, one or more augmentation images associated with the particular transparent bounding box;
• receiving, from the renderer, video frame data and location data associated with the one or more augmentation images;
• and
• presenting the one or more augmentation images on the graphical user interface based on the video frame data and the location data.

A non-transitory computer-readable medium storing computer-executable instructions for:

• determining a plurality of objects within each frame of a plurality of video frames of video content;
• assigning a plurality of bounding boxes to the plurality of objects, wherein each bounding box is associated with a respective object represented in one or more frames of the plurality of video frames;
• assigning a respective red, green, blue, alpha (RGBA) value to each bounding box of the plurality of bounding boxes;
• transmitting, to a client device, video data corresponding to an event, the video data comprising the video content, the plurality of bounding boxes, and the assigned RGBA values;
• receiving, from the client device, an indicator of a particular bounding box identified from among the plurality of bounding boxes, wherein the particular bounding box is identified based on the assigned RGBA values of the plurality of bounding boxes;
• determining a particular object within a frame of the plurality of video frames of the video content based on the indicator of the particular bounding box;
• determining a current augmentation state for the particular object;
• selecting an augmentation image from among a plurality of augmentation images associated with the particular object based on the current augmentation state for the particular object;
• determining video frame data and location data associated with the particular object;
• and transmitting the augmentation image, the video frame data, and the location data to the client device.