Back to results
US 12,720,004 B2Granted
Automatically generating colors for overlaid content of videos
AssigneeGoogle Inc.
InventorDongeek Shin
Life of this patent
Estimating the term…
Abstract
Methods and systems for color recommendations for overlaid text in a video are provided herein. A video for upload is received. The video includes a plurality of frames having overlaid content. Data related to the video is provided as input to a machine learning model. One or more outputs obtained from the machine learning model is used to determine a color value that improves one or more presentation characteristics of the overlaid content within the video. A color associated with the determined color value is provided to a user for the overlaid content.
Claims20
A method comprising:
- receiving, via a user interface of a mobile application, a video for upload, wherein the video comprises a plurality of frames each having primary video content and one or more overlaid content items including additional information about the primary video content;
- generating data related to the video based on a location of each overlaid content item of the one or more overlaid content items within a corresponding frame and an initial color of each overlaid content item within the corresponding frame;
- providing the data related to the video as input to a machine learning model trained to generate, for each of the one or more overlaid content items, a respective improved color value based at least on a color of the primary video content behind a respective overlaid content item;
- obtaining one or more outputs of the machine learning model, the one or more outputs comprising, for each of the one or more overlaid content items, the respective improved color value;
- for each overlaid content item of the one or more overlaid content items, determining, based on the one or more outputs of the machine learning model, an improved color value that improves one or more presentation characteristics of the one or more overlaid content items within the video;
- and
- providing, via the user interface of the mobile application, a modified color for each of the one or more overlaid content items based on a respective improved color value.
4 more elements
A system comprising:
- a memory device;
- and
- a processing device coupled to the memory device, wherein the processing device is to perform operations comprising:
- receiving, via a user interface of a mobile application, a video for upload, wherein the video comprises a plurality of frames each having primary video content and one or more overlaid content items including additional information about the primary video content;
- generating data related to the video based on a location of each overlaid content item of the one or more overlaid content items within a corresponding frame and an initial color of each overlaid content item within the corresponding frame;
- providing the data related to the video as input to a machine learning model trained to generate, for each of the one or more overlaid content items, a respective improved color value based at least on a color of the primary video content behind a respective overlaid content item;
- obtaining one or more outputs of the machine learning model, the one or more outputs comprising, for each of the one or more overlaid content items, the respective improved color value;
- for each overlaid content item of the one or more overlaid content items, determining, based on the one or more outputs of the machine learning model, an improved color value that improves one or more presentation characteristics of the one or more overlaid content items within the video;
- and
- providing, via the user interface of the mobile application, a modified color for each of the one or more overlaid content items based on a respective improved color value.
7 more elements
A non-transitory computer-readable medium comprising instructions that, responsive to execution by a processing device, cause the processing device to perform operations comprising:
- receiving, via a user interface of a mobile application, a video for upload, wherein the video comprises a plurality of frames each having primary video content and one or more overlaid content items including additional information about the primary video content;
- generating data related to the video based on a location of each overlaid content item of the one or more overlaid content items within a corresponding frame and an initial color of each overlaid content item within the corresponding frame;
- providing the data related to the video as input to a machine learning model trained to generate, for each of the one or more overlaid content items, a respective improved color value based at least on a color of the primary video content behind a respective overlaid content item;
- obtaining one or more outputs of the machine learning model, the one or more outputs comprising, for each of the one or more overlaid content items, the respective improved color value;
- for each overlaid content item of the one or more overlaid content items, determining, based on the one or more outputs of the machine learning model, an improved color value that improves one or more presentation characteristics of the one or more overlaid content items within the video;
- and
- providing, via the user interface of the mobile application, a modified color for each of the one or more overlaid content items based on a respective improved color value.
4 more elements
Dependencies are inferred from the claim text.