# US 12,002,436 B2 · Methods, systems, and media for modifying user interface colors in connection with the presentation of a video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,436 B2 - Document ID: US12002436B2 - Status: Granted - Kind: B2 - Application number: 18/094,623 - Filed: 2023-01-09 - Published: 2023-05-25 - Granted: 2024-06-04 - Earliest claimed: 2017-04-18 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Maegan Clawges; Samuel Keene - Web page: https://patentgrep.com/patent/US12002436B2 ## CPC - H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering - G06T 5/92: based on global image properties - G06T 7/90: Determination of colour characteristics - G06T 11/60: Creating or editing images; Combining images with text - G09G 5/06: using colour palettes, e.g. look-up tables - H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)} - H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts} - G09G 2320/0242: Compensation of deficiencies in the appearance of colours - G09G 2320/066: for control of contrast - G09G 2320/0666: for control of colour parameters, e.g. colour temperature - G09G 2354/00: Aspects of interface with display user - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Methods, systems, and media for modifying user interface colors are provided. In some embodiments, the method comprises: receiving a video and color palette information, wherein each color of the color palette information indicates a color of an element of a user interface in which the video is to be presented; identifying a first color for the element, wherein the first color corresponds to a first portion of the video; causing the first portion of the video to be presented, wherein the element of the user interface having the first color is presented; identifying a second color for the element, wherein the second color corresponds to a second portion of the video; and modifying an appearance of the element by changing the color of the element from the first color to the second color while presenting the second portion of the video. ## Claims ### Claim 1 A method for color palette extraction for videos, the method comprising: identifying, using a server that includes a hardware processor, a content item; clustering a plurality of pixels of the content item based on a color of each of the pixels in the plurality of pixels into one of a plurality of clusters; determining a main color for the content item by determining color component values of a color indicating scale for each of the pixels associated with the at least one cluster of the plurality of clusters and determining the main color for the content item to include an average color component value for each color component of the color indicating scale based on the color component values; and modifying an appearance of a user interface element of a user interface that presents the content item by changing the color of the user interface element to the determined main color. ### Claim 2 (depends on 1) The method of claim 1, further comprising selecting the at least one cluster of the plurality of clusters based on a number of pixels associated with each of the plurality of clusters. ### Claim 3 (depends on 1) The method of claim 1, further comprising selecting the at least one cluster of the plurality of clusters based on similarity to content color data of the content item. ### Claim 4 (depends on 1) The method of claim 1, wherein the appearance of the user interface element of the user interface is modified by blending the color of the user interface element with the main color of the one or more selected clusters. ### Claim 5 (depends on 4) The method of claim 4, further comprising determining whether a user device has a capability to blend colors of user interface elements. ### Claim 6 (depends on 5) The method of claim 5, further comprising: determining that the user device does not have the capability to blend colors of user interface elements; and in response to determining that the user device does not have the capability to blend colors of user interface elements, applying a transparency value to the user interface element. ### Claim 7 A system for color palette extraction for videos, the system comprising: a hardware processor that: identifies a content item; clusters a plurality of pixels of the content item based on a color of each of the pixels in the plurality of pixels into one of a plurality of clusters; determines a main color for the content item by determining color component values of a color indicating scale for each of the pixels associated with the at least one cluster of the plurality of clusters and determining the main color for the content item to include an average color component value for each color component of the color indicating scale based on the color component values; and modifies an appearance of a user interface element of a user interface that presents the content item by changing the color of the user interface element to the determined main color. ### Claim 8 (depends on 7) The system of claim 7, wherein the hardware processor further selects the at least one cluster of the plurality of clusters based on a number of pixels associated with each of the plurality of clusters. ### Claim 9 (depends on 7) The system of claim 7, wherein the hardware processor further selects the at least one cluster of the plurality of clusters based on similarity to content color data of the content item. ### Claim 10 (depends on 7) The system of claim 7, wherein the appearance of the user interface element of the user interface is modified by blending the color of the user interface element with the main color of the one or more selected clusters. ### Claim 11 (depends on 10) The system of claim 10, wherein the hardware processor further determines whether a user device has a capability to blend colors of user interface elements. ### Claim 12 (depends on 11) The system of claim 11, wherein the hardware processor further: determines that the user device does not have the capability to blend colors of user interface elements; and in response to determining that the user device does not have the capability to blend colors of user interface elements, applies a transparency value to the user interface element. ### Claim 13 A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for method for color palette extraction for videos, the method comprising: identifying a content item; clustering a plurality of pixels of the content item based on a color of each of the pixels in the plurality of pixels into one of a plurality of clusters; determining a main color for the content item by determining color component values of a color indicating scale for each of the pixels associated with the at least one cluster of the plurality of clusters and determining the main color for the content item to include an average color component value for each color component of the color indicating scale based on the color component values; and modifying an appearance of a user interface element of a user interface that presents the content item by changing the color of the user interface element to the determined main color. ### Claim 14 (depends on 13) The method of claim 13, wherein the method further comprises selecting the at least one cluster of the plurality of clusters based on a number of pixels associated with each of the plurality of clusters. ### Claim 15 (depends on 13) The method of claim 13, wherein the method further comprises selecting the at least one cluster of the plurality of clusters based on similarity to content color data of the content item. ### Claim 16 (depends on 13) The method of claim 13, wherein the appearance of the user interface element of the user interface is modified by blending the color of the user interface element with the main color of the one or more selected clusters. ### Claim 17 (depends on 16) The method of claim 16, wherein the method further comprises determining whether a user device has a capability to blend colors of user interface elements. ### Claim 18 (depends on 17) The method of claim 17, wherein the method further comprises: determining that the user device does not have the capability to blend colors of user interface elements; and in response to determining that the user device does not have the capability to blend colors of user interface elements, applying a transparency value to the user interface element.