# US 12,223,280 B2 · Identifying multimedia asset similarity using blended semantic and latent feature > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,280 B2 - Document ID: US12223280B2 - Status: Granted - Kind: B2 - Application number: 18/093,924 - Filed: 2023-01-06 - Published: 2023-05-25 - Granted: 2025-02-11 - Earliest claimed: 2012-02-17 - Assignees: Adeia Media Solutions Inc. - Applicants: Adeia Media Solutions Inc. - Inventors: David Arthur; Doug Mittendorf - Web page: https://patentgrep.com/patent/US12223280B2 ## CPC - G06F 40/30: Semantic analysis - G06F 16/41: Indexing; Data structures therefor; Storage structures - G06F 16/43: Querying - G06F 16/489: {using time information} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods and system for determining a similarity relationship between a plurality of digital assets and a target digital asset comprises creating a normalized semantic feature vector associated with a search query, discovering the target asset based on the normalized semantic feature vector, generating a normalized latent feature vector associated with the target asset, comparing the normalized semantic feature vector with semantic feature vectors for each of the digital assets to generate a semantic comparison value, comparing the normalized target latent feature vector with latent feature vectors for each of the digital assets to generate a latent comparison value, blending the semantic comparison vector value with the latent feature comparison vector value to create a target comparison value for each of the digital assets, and reporting the digital assets having the highest target comparison values to the user or group of users. ## Claims ### Claim 1 A method comprising: receiving a search query comprising one or more terms; generating, at a computing device, a plurality of target features based on the search query, the plurality of target features comprising: target semantic features based on the one or more terms; and target latent features based on user information associated with the one or more terms; executing, based on the plurality of target features, the search query for a plurality of digital assets stored at a database; retrieving, from the database based on the executed search query, identifiers of the plurality of digital assets; for each digital asset of the plurality of digital assets: generating, at the computing device, a semantic feature score based on a respective digital asset and the target semantic features; generating, at the computing device, a latent feature score based on the respective digital asset and the target latent features; generating, at the computing device, a first factor proportional to an amount of user information collected for the respective digital asset; generating, at the computing device, a second factor that is modified as a function of the first factor, wherein an increase in the first factor corresponds to a decrease in the second factor, wherein an increase in the second factor corresponds to a decrease in the first factor, and wherein the first factor and the second factor add to one hundred percent; and generating, at the computing device, a comparison score for the respective digital asset, wherein generating the comparison score comprises blending the latent feature score weighted by the first factor and the semantic feature score weighted by the second factor; and causing to be displayed, at a display associated with the computing device, an ordered list of identifiers of the plurality of digital assets ordered at least partially based on the comparison scores of the plurality of digital assets. ### Claim 2 (depends on 1) The method of claim 1, further comprising normalizing the comparison scores for the plurality of digital assets, and wherein the ordered list is ordered at least partially based on the normalized comparison scores of the plurality of digital assets. ### Claim 3 (depends on 1) The method of claim 1, wherein the amount of user information comprises a number of user interactions and user activities collected for the respective digital asset of the plurality of digital assets. ### Claim 4 (depends on 1) The method of claim 1, further comprising: in response to determining that the amount of user information collected for the respective digital asset of the plurality of digital assets has increased: increasing the first factor based on the increased amount of user information; and wherein the second factor is reduced based on the increase of the first factor. ### Claim 5 (depends on 1) The method of claim 1, wherein generating the semantic feature score comprises comparing the target semantic features to semantic features based on one or more terms of metadata describing contents of the respective digital asset of the plurality of digital assets. ### Claim 6 (depends on 1) The method of claim 1, wherein generating the latent feature score comprises comparing the target latent features to latent features based on the user information collected for the respective digital asset of the plurality of digital assets. ### Claim 7 (depends on 1) The method of claim 1, wherein the user information comprises user information associated with the one or more terms of the search query. ### Claim 8 (depends on 1) The method of claim 1, wherein the plurality of target features comprises one or more of: title, creation date, director, producer, writer, production studio, actors, characters, dialog, subject matter, genre, objects, settings, locations, themes, or legal clearance to third party copyrighted material associated with the search query. ### Claim 9 (depends on 1) The method of claim 1, further comprising, for the one or more terms, performing one or more of: tokenizing, stemming, determining synonyms, lower-casing, spell correcting, generating a searchable index, or generating a searchable inverted index. ### Claim 10 (depends on 1) The method of claim 1, wherein the user information comprises one or more of: user ratings, user feedback, user recommendations, and user reviews. ### Claim 11 A system comprising: display circuitry configured to display one or more digital assets; and a computing device comprising control circuitry configured to: receive a search query comprising one or more terms; generate, at the computing device, a plurality of target features based on the search query, the plurality of target features comprising: target semantic features based on the one or more terms; and target latent features based on user information associated with the one or more terms; execute, based on the plurality of target features, the search query for a plurality of digital assets stored at a database; retrieve, from the database based on the executed search query, identifiers of the plurality of digital assets; for each digital asset of the plurality of digital assets: generate, at the computing device, a semantic feature score based on a respective digital asset and the target semantic features; generate, at the computing device, a latent feature score based on the respective digital asset and the target latent features; generate, at the computing device, a first factor proportional to an amount of user information collected for the respective digital asset; generate, at the computing device, a second factor that is modified as a function of the first factor, wherein an increase in the first factor corresponds to a decrease in the second factor, wherein an increase in the second factor corresponds to a decrease in the first factor, and wherein the first factor and the second factor add to one hundred percent; and generate, at the computing device, a comparison score for the respective digital asset, wherein the control circuitry is configured to blend the latent feature score weighted by the first factor and the semantic feature score weighted by the second factor; and cause to be displayed, via the display circuitry, an ordered list of identifiers of the plurality of digital assets ordered at least partially based on the comparison scores of the plurality of digital assets. ### Claim 12 (depends on 11) The system of claim 11, wherein the control circuitry is further configured to normalize the comparison scores for the plurality of digital assets, and wherein the ordered list is ordered at least partially based on the normalized comparison scores of the plurality of digital assets. ### Claim 13 (depends on 11) The system of claim 11, wherein the amount of user information comprises a number of user interactions and user activities collected for the respective digital asset of the plurality of digital assets. ### Claim 14 (depends on 11) The system of claim 11, wherein the control circuitry is further configured to: in response to determining that the amount of user information collected for the respective digital asset of the plurality of digital assets has increased: increase the first factor based on the increased amount of user information; and wherein the second factor is reduced based on the increase of the first factor. ### Claim 15 (depends on 11) The system of claim 11, wherein the control circuitry, when generating the semantic feature score, is configured to compare the target semantic features to semantic features based on one or more terms of metadata describing contents of the respective digital asset of the plurality of digital assets. ### Claim 16 (depends on 11) The system of claim 11, wherein the control circuitry, when generating the latent feature score, is configured to compare the target latent features to latent features based on the user information collected for the respective digital asset of the plurality of digital assets. ### Claim 17 (depends on 11) The system of claim 11, wherein the user information comprises user information associated with the one or more terms of the search query. ### Claim 18 (depends on 11) The system of claim 11, wherein the plurality of target features comprises one or more of: title, creation date, director, producer, writer, production studio, actors, characters, dialog, subject matter, genre, objects, settings, locations, themes, or legal clearance to third party copyrighted material associated with the search query. ### Claim 19 (depends on 11) The system of claim 11, wherein the control circuitry is further configured to, for the one or more terms, perform one or more of: tokenizing, stemming, determining synonyms, lower-casing, spell correcting, generating a searchable index, or generating a searchable inverted index. ### Claim 20 (depends on 11) The system of claim 11, wherein the user information comprises one or more of: user ratings, user feedback, user recommendations, and user reviews.