Weak neural architecture search (nas) predictor
AssigneeMicrosoft Technology Licensing, LLC
InventorsXiyang DAI, Dongdong CHEN, Yinpeng CHEN, Mengchen LIU, Ye YU, Zicheng LIU, Mei CHEN, Lu YUAN, Junru WU
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsXiyang DAI, Dongdong CHEN, Yinpeng CHEN, Mengchen LIU, Ye YU, Zicheng LIU, Mei CHEN, Lu YUAN, Junru WU
Estimating the term…
A neural architecture search (NAS) with a weak predictor comprises: receiving network architecture scoring information; iteratively sampling a search space, wherein the sampling comprises: generating a set of candidate architectures within the search space; learning a first predictor; evaluating performance of the candidate architectures; and based on at least the performance of the set of candidate architectures and the network architecture scoring information, refining the search space to a smaller search space; based on at least the network architecture scoring information, thresholding the performance of candidate architectures to determine scored output candidate architectures; and reporting the scored output candidate architectures. In some examples, the candidate architectures each comprise a machine learning (ML) model, for example a neural network (NN). In some examples, searching continues to iterate until stopping criteria is met, such as a specified maximum number of iterations or a set of candidate architectures achieves a performance goal.
A method of neural architecture search (NAS), the method comprising:
A system for neural architecture search (NAS), the system comprising:
One or more computer storage devices having computer-executable instructions stored thereon, which, on execution by a computer, cause the computer to perform operations comprising:
Dependencies are inferred from the claim text.