# US 2025/0156727 A1 · Multi-branch network architecture searching system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156727 A1
- Document ID: US20250156727A1
- Status: Published application
- Kind: A1
- Application number: 18/421,577
- Filed: 2024-01-24
- Published: 2025-05-15
- Earliest claimed: 2023-11-10
- Assignees: Industrial Technology Research Institute
- Applicants: Industrial Technology Research Institute
- Inventors: Chih-Neng LIU; Ming-Yu SHIH
- Web page: https://patentgrep.com/patent/US20250156727A1

## CPC

- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A multi-branch network architecture searching method includes: obtaining a training dataset with a plurality of input data; obtaining block design elements for blocks, wherein the blocks forms an architecture of a neural network, and the blocks are configured to perform a feature extraction on the input data to generate an output data; for each hyperparameter of the neural network, obtaining at least one hyperparameter setting value; inputting the training dataset, block design elements, and the at least one hyperparameter setting value into a hyperparameter optimization algorithm to generate a hyperparameter combination, wherein the hyperparameter combination includes one of the at least one hyperparameter setting corresponding to each hyperparameter; executing the neural network based on the hyperparameter combination and inputting a test dataset to evaluate a model performance of the neural network; and outputting the hyperparameter combination when the model performance reaches a threshold.

## Claims

### Claim 1

A multi-branch network architecture searching method, applicable to an electronic device comprising a processor, comprising:
obtaining a training dataset, wherein the training dataset includes a plurality of input data;
obtaining a plurality of block design elements for a plurality of blocks, wherein the plurality of blocks forms an architecture of a neural network, and the plurality of blocks are configured to perform a feature extraction on the plurality of input data to generate an output data;
for each of a plurality of hyperparameters of the neural network, obtaining at least one hyperparameter setting value;
inputting the training dataset, the plurality of block design elements, and the at least one hyperparameter setting value into a hyperparameter optimization algorithm to generate a hyperparameter combination, wherein the hyperparameter combination includes one of the at least one hyperparameter setting value corresponding to each of the plurality of hyperparameters;
executing the neural network based on the hyperparameter combination and inputting a test dataset to evaluate a model performance of the neural network; and
outputting the hyperparameter combination when the model performance reaches a threshold.

### Claim 2 (depends on 1)

The multi-branch network architecture searching method of claim 1, wherein the plurality of blocks comprises a plurality of normal blocks and a plurality of reduction blocks, each of the plurality of normal blocks is configured to preserve a dimension of one of the plurality of input data, and each of the plurality of reduction blocks is configured to reduce the dimension of one of the plurality of input data.

### Claim 3 (depends on 2)

The multi-branch network architecture searching method of claim 2, wherein the architecture of the neural network comprises a stem and at least one branch, and the plurality of hyperparameters of the neural network comprises at least one of the following: a number of blocks of the stem, a number of channels of the stem, a number of the at least one branch, a number of blocks of each of the at least one branch, a number of channels of each of the at least one branch, and a position of the plurality of reduction blocks of each of the at least one branch.

### Claim 4 (depends on 3)

The multi-branch network architecture searching method of claim 3, wherein the number of the blocks of each of the at least one branch is at least one.

### Claim 5 (depends on 1)

The multi-branch network architecture searching method of claim 1, wherein the hyperparameter optimization algorithm comprises at least one of the following: Tree-Structured Parzen Estimation, Bayesian Optimization, Grid Search, Random Optimization, Sequential Model-Based Algorithm Configuration, and Metis.

### Claim 6 (depends on 1)

The multi-branch network architecture searching method of claim 1, wherein the model performance comprises at least one of the following: model accuracy, false negative rate (FNR), true negative rate (TNR), parameter size, and inference speed.

### Claim 7

A multi-branch network architecture searching system applicable to an electronic device comprising a processor, comprising:
an input module configured to obtain a training dataset, a plurality of block design elements of a plurality of blocks, at least one hyperparameter setting value of each of a plurality of hyperparameters of a neural network, and a test dataset, wherein the training dataset includes a plurality of input data, the plurality of blocks forms an architecture of the neural network, the plurality of blocks is configured to perform a feature extraction on one of the plurality of input data to generate an output data.
a computing module communicably connected to the input module, wherein the computing module is configured to execute a hyperparameter optimization algorithm according to the training dataset, the plurality of block design elements, and the at least one hyperparameter setting value to generate a hyperparameter combination, the hyperparameter combination comprises one of the at least one hyperparameter setting value corresponding to each of the plurality of hyperparameters; and
a neural network module communicably connected to the input module and the computing module, wherein the neural network module is configured to execute a neural network based on the hyperparameter combination and input the test dataset to evaluate a model performance of the neural network, and the computing module is further configured to output the hyperparameter combination when the model performance reaches a threshold.

### Claim 8 (depends on 7)

The multi-branch network architecture searching system of claim 7, wherein the plurality of blocks comprises a plurality of normal blocks and a plurality of reduction blocks, each of the plurality of normal blocks is configured to preserve a dimension of one of the plurality of input data, and each of the plurality of reduction blocks is configured to reduce the dimension of the plurality of input data.

### Claim 9 (depends on 8)

The multi-branch network architecture searching system of claim 8, wherein the architecture of the neural network comprises a stem and at least one branch, and the plurality of hyperparameters of the neural network comprises at least one of the following: a number of blocks of the stem, a number of channels of the stem, a number of the at least one branch, a number of blocks of each of the at least one branch, a number of channels of each of the at least one branch, and a position of the plurality of reduction blocks of each of the at least one branch.

### Claim 10 (depends on 9)

The multi-branch network architecture searching system of claim 9, wherein the number of blocks of each of the at least one branch is at least one.

### Claim 11 (depends on 7)

The multi-branch network architecture searching system of claim 7, wherein the hyperparameter optimization algorithm comprises at least one of the following: Tree-Structured Parzen Estimation, Bayesian Optimization, Grid Search, Random Optimization, Sequential Model-Based Algorithm Configuration, and Metis.

### Claim 12 (depends on 7)

The multi-branch network architecture searching system of claim 7, wherein the model performance comprises at least one of the following: model accuracy, false negative rate (FNR), true negative rate (TNR), parameter size, and inference speed.
