A non-transitory computer-readable medium storing (a) a set of parameters for a domain-neutral representation model and a set of parameters for a first-domain scoring model, and (b) a set of computer-executable instructions, wherein the sets of parameters are produced by a process executed by a computing system comprising:
- accessing training data that comprises a plurality of examples, wherein the plurality of examples comprises:
- a set of first-domain examples, wherein each first-domain example comprises data describing a historical interaction within a first domain, wherein each first-domain example comprises a feature set describing an instance where content of a first format is presented to a user and a label describing whether the user interacted with the content of the first format;
- and
- a set of second-domain examples, wherein each first-domain example comprises data describing a historical interaction within a first domain, wherein each second-domain example comprises a feature set describing an instance where content of a second format is presented to a user and a label describing whether the user interacted with the content of the second format;
- generating a domain-neutral representation for each example of the plurality of examples by inputting the feature set of each example to a domain-neutral representation model;
- for each domain-neutral representation corresponding to a first domain example of the set of first domain examples:
- generating a first domain score for the first domain example by inputting the domain-neutral representation of the first domain example to a first domain scoring model;
- and
- updating parameters of the domain-neutral representation model and the first domain scoring model based on the first domain score and the label of the first domain example;
- for each domain-neutral representation corresponding to a second domain example of the set of second domain examples:
- generating a second domain score for the second domain example by inputting the domain-neutral representation of the second domain example to a second domain scoring model;
- and
- updating the parameters the domain-neutral representation model based on the second domain score and the label of the second domain example;
- generating a domain-neutrality score for each domain-neutral representation by inputting the domain-neutral representation into a domain-neutrality scoring model, wherein the domain-neutrality score represents how domain-neutral the domain-neutral representation is;
- updating the parameters of the domain-neutral representation model based on a domain-neutrality score;
- and
- storing a final set of parameters for the domain-neutral representation model and the first-domain scoring model on the computer-readable medium;
- and
- wherein the computer-executable instructions, when executed, cause a computer to perform operations comprising:
- receiving a query from a client device associated with a user of an online system;
- accessing a set of candidate content of the first format stored by the online system;
- generating a domain-neutral representation for each of the set of candidate content of the first format by applying the domain-neutral representation model to the query and the set of candidate content of the first format, wherein generating a domain-neutral representation comprises applying the final set of parameters for the domain-neutral representation model to a feature set for the query and a feature set a candidate content of the first format of the set of candidate content of the first format;
- applying the first domain scoring model to each domain-neutral representation to generate a first domain score for each of the set of candidate content of the first format, wherein applying the first domain scoring model to a domain-neutral representation comprises applying the set of parameters for the first domain scoring model to the domain-neutral representation;
- ranking the set of candidate content of the first format based on the generated set of first domain scores;
- and
- transmitting a subset of the set of candidate content of the first format to the client device for display to the user in response to the query.