# US 11,307,749 B1 · Managing content of a user interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,307,749 B1 - Document ID: US11307749B1 - Status: Granted - Kind: B1 - Application number: 17/147,850 - Filed: 2021-01-13 - Granted: 2022-04-19 - Earliest claimed: 2021-01-13 - Assignees: Dell Products L.P. - Applicants: Dell Products L.P. - Inventors: Ryan Nicholas Comer; Tyler Ryan Cox; Marc Randall Hammons; Richard William Schuckle; Jake Mitchell Leland - Web page: https://patentgrep.com/patent/US11307749B1 ## CPC - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06V 10/761: {Proximity, similarity or dissimilarity measures} - G06F 7/24: Sorting, i.e. extracting data from one or more carriers, rearranging the data in numerical or other ordered sequence, and rerecording the sorted data on the original carrier or on a different carrier or set of carriers {sorting methods in general}(G06F7/36 takes precedence) - G06F 16/583: using metadata automatically derived from the content - G06F 18/213: Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods - G06F 18/22: Matching criteria, e.g. proximity measures - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Managing content of a user interface, including identifying an UI application that provides for display a UI on a display device, the UI application providing a primary content item for inclusion by the UI; identifying a request for a secondary content item to be included within the UI, and in response, identifying one or more secondary content items; performing content feature extraction of the primary content item to identify primary content features; performing content feature extraction of the secondary content items to identify secondary content features; comparing the primary content features and the secondary content features to identify similarities therebetween; sorting the secondary content features based on the similarity between the secondary content features and the primary content features; identifying a particular secondary content item of the one or more secondary content items; updating the UI to include the particular secondary content item within the UI. ## Claims ### Claim 1 A computer-implemented method of managing content of a user interface, the method comprising: identifying a user interface (UI) application that provides for display a UI on a display device, the UI application providing a primary content item for inclusion by the UI; identifying a request for a secondary content item to be included within the UI; in response to the request: identifying one or more secondary content items; performing content feature extraction of the primary content item to identify primary content features; performing content feature extraction of the secondary content items to identify secondary content features; comparing the primary content features and the secondary content features to identify similarities between the secondary content features and the primary content features; sorting the secondary content features based on the similarity between the secondary content features and the primary content features; identifying, based on the sorting, a particular secondary content item of the one or more secondary content items; and updating the UI to include the particular secondary content item within the UI. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising identifying, based on the sorting, the particular secondary content item of two or more secondary content items. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, wherein sorting further includes ranking the secondary content features based on the similarity between each secondary content feature and the primary content features, and wherein identifying the particular secondary content item further includes identifying a highest ranked secondary content feature and identifying the particular secondary content item that corresponds to the highest ranked secondary content item. ### Claim 4 (depends on 2) The computer-implemented method of claim 2, further comprising: identifying additional primary content items previously provided for display on the UI of the display device by the UI application; performing content feature extraction of the additional primary content items to identify additional primary content features; identifying previous interactions of a user with the additional primary content items; and applying a machine learning model to identify user preferences of the user based on the previous interactions of the user with the additional primary content items. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, further comprising: comparing the user preferences and the secondary content features to identify similarities between the secondary content features and the user preferences; sorting the secondary content features based on the similarity between the secondary content features and the user preferences; identifying, based on the sorting, an additional particular secondary content item of the two or more secondary content items; and updating the UI to include the additional particular secondary content item within the UI. ### Claim 6 (depends on 2) The computer-implemented method of claim 2, further comprising: modifying the particular secondary content item based on the primary content features. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein modifying the particular content item includes adding a color filter to the particular content item based on a main color of the primary content features. ### Claim 8 (depends on 2) The computer-implemented method of claim 2, wherein the particular secondary content item is a video content item, the method further comprising: sorting frames of the video content item based on a similarity between the secondary content features and the primary content features; identifying, based on the sorting, a particular frame of the particular secondary content item; and updating the UI to include the particular frame of the particular secondary content item within the UI. ### Claim 9 (depends on 2) The computer-implemented method of claim 2, wherein performing content feature extraction of the primary content item to identify primary content features further includes performing scale-invariant feature transform of the primary content item to identify primary content features, and wherein performing content feature extraction of the secondary content item to secondary primary content features further includes performing scale-invariant feature transform of the secondary content item to identify secondary content features. ### Claim 10 An information handling system comprising a processor having access to memory media storing instructions executable by the processor to perform operations comprising, comprising: identifying a user interface (UI) application that provides for display a UI on a display device, the UI application providing a primary content item for inclusion by the UI; identifying a request for a secondary content item to be included within the UI; in response to the request: identifying one or more secondary content items; performing content feature extraction of the primary content item to identify primary content features; performing content feature extraction of the secondary content items to identify secondary content features; comparing the primary content features and the secondary content features to identify similarities between the secondary content features and the primary content features; sorting the secondary content features based on the similarity between the secondary content features and the primary content features; identifying, based on the sorting, a particular secondary content item of the one or more secondary content items; and updating the UI to include the particular secondary content item within the UI. ### Claim 11 (depends on 10) The information handling system of claim 10, the operations further comprising identifying, based on the sorting, the particular secondary content item of two or more secondary content items. ### Claim 12 (depends on 11) The information handling system of claim 11, wherein sorting further includes ranking the secondary content features based on the similarity between each secondary content feature and the primary content features, and wherein identifying the particular secondary content item further includes identifying a highest ranked secondary content feature and identifying the particular secondary content item that corresponds to the highest ranked secondary content item. ### Claim 13 (depends on 11) The information handling system of claim 11, the operations further comprising: identifying additional primary content items previously provided for display on the UI of the display device by the UI application; performing content feature extraction of the additional primary content items to identify additional primary content features; identifying previous interactions of a user with the additional primary content items; and applying a machine learning model to identify user preferences of the user based on the previous interactions of the user with the additional primary content items. ### Claim 14 (depends on 13) The information handling system of claim 13, the operations further comprising: comparing the user preferences and the secondary content features to identify similarities between the secondary content features and the user preferences; sorting the secondary content features based on the similarity between the secondary content features and the user preferences; identifying, based on the sorting, an additional particular secondary content item of the two or more secondary content items; and updating the UI to include the additional particular secondary content item within the UI. ### Claim 15 (depends on 11) The information handling system of claim 11, the operations further comprising: modifying the particular secondary content item based on the primary content features. ### Claim 16 (depends on 15) The information handling system of claim 15, wherein modifying the particular content item includes adding a color filter to the particular content item based on a main color of the primary content features. ### Claim 17 (depends on 11) The information handling system of claim 11, wherein the particular secondary content item is a video content item, the operations further comprising: sorting frames of the video content item based on a similarity between the secondary content features and the primary content features; identifying, based on the sorting, a particular frame of the particular secondary content item; and updating the UI to include the particular frame of the particular secondary content item within the UI. ### Claim 18 (depends on 11) The information handling system of claim 11, wherein performing content feature extraction of the primary content item to identify primary content features further includes performing scale-invariant feature transform of the primary content item to identify primary content features, and wherein performing content feature extraction of the secondary content item to secondary primary content features further includes performing scale-invariant feature transform of the secondary content item to identify secondary content features. ### Claim 19 A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising: identifying a user interface (UI) application that provides for display a UI on a display device, the UI application providing a primary content item for inclusion by the UI; identifying a request for a secondary content item to be included within the UI; in response to the request: identifying one or more secondary content items; performing content feature extraction of the primary content item to identify primary content features; performing content feature extraction of the secondary content items to identify secondary content features; comparing the primary content features and the secondary content features to identify similarities between the secondary content features and the primary content features; sorting the secondary content features based on the similarity between the secondary content features and the primary content features; identifying, based on the sorting, a particular secondary content item of the one or more secondary content items; and updating the UI to include the particular secondary content item within the UI. ### Claim 20 (depends on 19) The computer-readable medium of claim 19, the operations further comprising identifying, based on the sorting, the particular secondary content item of two or more secondary content items.