Back to results
US 2025/0061506 A1Published application
Systems and methods for generating recommendations using contextual bandit models with non-linear oracles
AssigneeIntuit Inc.
InventorsShankar SANKARARAMAN, Isaac STORCH
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for generating recommendations using contextual bandit models with non-linear oracles.
Claims20
A computing system for generating recommendations comprising:
- a processor;
- and
- a non-transitory computer-readable storage device storing computer-executable instructions, the instructions operable to cause the processor to perform operations comprising:
- detecting a presence of a user on a content platform;
- generating a recommendation for the user via a contextual bandit model and a non-linear machine learning model, the recommendation comprising one or more recommended items, the non-linear machine learning model operating as an oracle for the contextual bandit model and being trained to predict future rewards for the one or more recommended items;
- and
- collecting a reward from an interaction between the user and the one or more recommended items to re-train the non-linear machine learning model.
4 more elements
A computer-implemented method, performed by at least one processor, for generating recommendations comprising:
- detecting a presence of a user on a content platform;
- generating a recommendation for the user via a contextual bandit model and a non-linear machine learning model, the recommendation comprising one or more recommended items, the non-linear machine learning model operating as an oracle for the contextual bandit model and being trained to predict future rewards for the one or more recommended items;
- and
- collecting a reward from an interaction between the user and the one or more recommended items to re-train the non-linear machine learning model.
1 more element
A computer-implemented method, performed by at least one processor, for training a model to generate recommendations comprising:
- collecting a reward from an interaction between a user and one or more recommended items, the one or more recommended items being generated by a contextual bandit model;
- concatenating user features associated with the user, item features associated with the one or more recommended items, and context features to generate a vector;
- assigning the collected reward to the vector to generate a vector-reward pair;
- and
- training, with the vector-reward pair, a non-linear machine learning model to predict future rewards for the one or more recommended items, wherein the training utilizes a plurality of weights of the user features, item features, and context features in a hyperparameter search space and the non-linear machine learning model operates as an oracle for the contextual bandit model.
2 more elements
Dependencies are inferred from the claim text.