Device and method for searching neural network architecture using supernet
AssigneeUIF (University Industry Foundation), Yonsei University
InventorsBum Sub HAM, Young Min OH
Life of this patent
Estimating the term…
Abstract
A method for searching a neural network architecture using supernets comprises the steps of: (a) searching for subnets that can be extracted from a set search space; (b) counting the number of non-linear activation functions included in each subnet for each of the searched subnets; (c) grouping the searched subnets based on the counted number of non-linear activation functions; (d) assigning the subnet groups to multiple supernets; (e) searching for a neural network having an optimal architecture based on operation blocks of the subnet groups assigned to each of the multiple supernets.
Claims16
A method for searching a neural network architecture, the method comprising the steps of:
- (a) searching for subnets that can be extracted from a set search space;
- (b) counting the number of non-linear activation functions included in each subnet for each of the searched subnets;
- (c) grouping the searched subnets based on the counted number of non-linear activation functions;
- (d) assigning the subnet groups to multiple supernets;
- (e) searching for a neural network having an optimal architecture based on operation blocks of the subnet groups assigned to each of the multiple supernets.
A device for searching a neural network architecture, the device including:
- a processor;
- and
- at least one memory connected to the processor,
- wherein the processor executes the steps of:
- (a) searching for subnets that can be extracted from a set search space;
- (b) counting the number of non-linear activation functions included in each subnet for each of the searched subnets;
- (c) grouping the searched subnets based on the counted number of non-linear activation functions;
- (d) assigning the subnet groups to multiple supernets;
- (e) searching for a neural network having an optimal architecture based on operation blocks of the subnet groups assigned to each of the multiple supernets.
Dependencies are inferred from the claim text.