Two-tower neural network for content-audience relationship prediction
AssigneeMicrosoft Technology Licensing, LLC
InventorsXueqian Tang, Lijun Peng, Jiarui Wang, Yi Zhang, Yi Wu, Arvind Subramaniam
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsXueqian Tang, Lijun Peng, Jiarui Wang, Yi Zhang, Yi Wu, Arvind Subramaniam
Estimating the term…
In an example embodiment, a generator model such as a large language model (LLM) is leveraged to generate embeddings for both pieces of content and users. The embeddings map the pieces of content and the users into the same latent n-dimensional space. The embeddings are then fine-tuned using a two-tower deep neural network, with one of the towers representing users and the other tower representing content. The two-tower deep neural network is trained to optimize the embeddings over some shared goal, such as user engagement with content, and uses information such as user interactions with content in that process. A clustering technique, such as K-nearest neighbor (kNN) can then be used to identify a grouping of top user/content pairs based on similarity between users and content, as reflected in the embeddings. For a given piece of content, therefore, the top users from that cluster can then be recommended as an audience for the content.
A system comprising:
A method comprising:
A non-transitory machine-readable storage medium comprising instructions which, when implemented by one or more machines, cause the one or more machines to perform operations comprising:
Dependencies are inferred from the claim text.