Grouping a first set of video items to efficiently match against a second set of video items using embedding similarity

One or more storage media storing instructions which, when executed by one or more processors, cause:

• identifying a first plurality of video items;
• identifying metadata of each video item in the first plurality of video items;
• by inserting the metadata of each video item into a machine-learned embedding generator, generating an embedding for each video item in the first plurality of video items;
• generating a plurality of groups of the first plurality of video items, wherein each video item in the first plurality of video items is assigned to a group in the plurality of groups based on the embedding generated for said each video item;
• identifying a second plurality of video items;
• generating an embedding for each video item in the second plurality of video items;
• for each particular video item in the second plurality of video items:
• for each group of the plurality of groups;
• comparing the embedding of said each particular video item with an embedding associated with said each group to generate a group score;
• adding the group score to a set of group scores;
• identifying a particular group, in the plurality of groups, that is associated with the highest group score in the set of group scores;
• for each video item in the particular group:
• comparing the embedding of said each particular video item with an embedding associated with said each video item in the particular group to generate a video pair score;
• adding the video pair score to a set of video pair scores;
• based on the set of video pair scores, storing a mapping that associates said each particular video item with one or more video items in the particular group;
• adding the mapping to a set of mappings.