Warm start generalized additive mixed-effect (game) framework
AssigneeMicrosoft Technology Licensing, LLC
InventorsYiming Ma, Alex Shelkovnykov, Josh Fleming, Bee-Chung Chen, Bo Long
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsYiming Ma, Alex Shelkovnykov, Josh Fleming, Bee-Chung Chen, Bo Long
Estimating the term…
In an example embodiment, a warm-start training solution is used to dramatically reduce the computational resources needed to train when retraining a generalized additive mixed-effect (GAME) model. The problem of retraining time is particularly applicable to GAME models, since these models take much longer to train as the data grows. In the past, the strategy to reduce computational resources during retraining was to use less training data, but this affects the model quality, especially for GAME models, which rely on fine-grained sub-models at, for example, member or item levels. The present solution addresses the computational resources issues without sacrificing GAME model accuracy.
A system comprising:
A computerized method comprising:
A non-transitory machine-readable storage medium comprising instructions which, when implemented by one or more machines, cause the one or more machines to perform operations comprising:
Dependencies are inferred from the claim text.
Drawings are temporarily unavailable. Open the PDF at USPTO
From the US filing history. Foreign family members aren’t listed.
Machine learning
Querying, e.g. by the use of web search engines: search customisation based on user profiles and personalisation
Using genetic models: evolutionary algorithms, e.g. genetic algorithms or genetic programming
Knowledge representation; Symbolic representation: frames
About 13 years 5 months of term left · ends 10 Apr 2040 (estimated)
The present disclosure generally relates to technical problems encountered in providing machine learning on computer systems. More specifically, the present disclosure relates to a warm start GAME framework.
The rise of the Internet has occasioned two disparate yet related phenomena: the increase in the presence of social networking services, with their corresponding member profiles visible to large numbers of people, and the increase in the use of these social networking services to perform searches or obtain information. An example of a common search or recommendation provided on a social networking service is the search for jobs that have been posted on, or linked to by, the social networks.
A technical problem encountered by social networking services in managing online job searches is that determining how to serve the most appropriate and relevant information with minimal delay becomes significantly challenging as the number of sources and volumes of information shared via the social networking services grows at an unprecedented pace. This includes determining how to recommend, for example, job openings and course offerings as well as determining which feed items to surface in an online feed.
Some embodiments of the technology are illustrated, by way of example and not limitation, in the figures of the accompanying drawings.
FIG. 1 is a block diagram illustrating a client-server system in accordance with an example embodiment.
FIG. 2 is a block diagram showing the functional components of a social networking service, including a data processing module referred to herein as a search engine, for use in generating and providing search results for a search query, consistent with some embodiments of the present disclosure.
Overview
The present disclosure describes, among other things, methods, systems, and computer program products that individually provide various functionality. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the various aspects of different embodiments of the present disclosure. It will be evident, however, to one skilled in the art, that the present disclosure may be practiced without all of the specific details.
In an example embodiment, a warm-start training solution is used to dramatically reduce the computational resources needed to train when retraining a GAME model. The problem of retraining time is particularly applicable to GAME models, since these models take much longer to train as the data grows. In the past, the strategy to reduce computational resources during retraining was to use less training data, but this affects the model quality, especially for GAME models, which rely on fine-grained sub-models at, for example, member or item levels. The present solution addresses the computational resources issues without sacrificing GAME model accuracy.