# US 2026/0065145 A1 · Training method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065145 A1
- Document ID: US20260065145A1
- Status: Published application
- Kind: A1
- Application number: 19/059,327
- Filed: 2025-02-21
- Published: 2026-03-05
- Earliest claimed: 2024-09-04
- Assignees: Hon Hai Precision Industry Co., Ltd.
- Applicants: Hon Hai Precision Industry Co., Ltd.
- Inventors: Tejender Singh Rawat; Chia-Lung HUNG; Wei-Cheng YU; Yi-Kai HSIAO
- Web page: https://patentgrep.com/patent/US20260065145A1

## CPC

- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06F 30/32: Circuit design at the digital level (reconfigurable circuits G06F30/34)
- G06N 3/047: Probabilistic or stochastic networks
- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method is used for training a reinforcement learning (RL) model to predict a breakdown voltage (BV) of a semiconductor device with a guard ring. The method comprises determining a set of structural parameters of the semiconductor device; preparing a training dataset formed by a plurality of manufacturing parameters of the semiconductor device, wherein the plurality of manufacturing parameters comprise a dose concentration and at least one dose energy of implanting a guard ring (GR) on the semiconductor device; and training the RL model using the training dataset by maximizing a reward function calculated based on a between a predicted BV value generated by the RL model and a target BV value corresponding to the plurality of manufacturing parameters.

## Claims

### Claim 1

A method for training a reinforcement learning (RL) model to predict a breakdown voltage (BV) of a semiconductor device with a guard ring, the method comprising:
determining a set of structural parameters of the semiconductor device;
preparing a training dataset formed by a plurality of manufacturing parameters of the semiconductor device, wherein the plurality of manufacturing parameters comprise a dose concentration and at least one dose energy of implanting a guard ring (GR) on the semiconductor device; and
training the RL model using the training dataset by maximizing a reward function calculated based on a between a predicted BV value generated by the RL model and a target BV value corresponding to the plurality of manufacturing parameters.

### Claim 2 (depends on 1)

The method of claim 1, wherein the RL model uses an extreme Gradient Boosting (XGBoost) regression model for comparison.

### Claim 3 (depends on 2)

The method of claim 2, wherein the RL model is a metamodel integrating the XGBoost model with a Tree-structured Parzen Estimator (TPE).

### Claim 4 (depends on 3)

The method of claim 3, wherein the TPE is selected as an optimization algorithm.

### Claim 5 (depends on 1)

The method of claim 1, wherein a reward function of the RL model is expressed as:
r
=
-
❘
"\[LeftBracketingBar]"
output
-
target
❘
"\[RightBracketingBar]"
wherein r is a reward value, output is the predicted BV value, and target is the target BV value.

### Claim 6 (depends on 5)

The method of claim 5, wherein advantage actor-critic (A2C) and proximal policy optimization (PPO) agents are deployed for training the RL model.

### Claim 7 (depends on 6)

The method of claim 6, wherein performance of the agents is monitored by tracking a cumulative reward obtained in each episode.

### Claim 8 (depends on 7)

The method of claim 7, wherein the agent's objective is to maximize the cumulative reward.

### Claim 9 (depends on 6)

The method of claim 6, wherein the agents are trained using an auto network architecture consisting of 3 dense layers with 128 neurons in each of the dense layer.

### Claim 10 (depends on 1)

The method of claim 1, wherein a loss function of the RL model is expressed as:
Loss
=
1
N
⁢
∑
i
=
1
N
⁢
(
y
i
-
y
ι
ˆ
)
2
+
∑
j
=
1
J
⁢
Ω
⁡
(
δ
j
)
Ω
⁡
(
δ
)
=
α
⁢
❘
"\[LeftBracketingBar]"
δ
❘
"\[RightBracketingBar]"
+
1
2
⁢
β
⁢

ω

2
wherein N is a number of data points, yi denotes an actual output for an i-th data point, ŷi represents a predicted output for the i-th data point, J denotes a number of trees in the RL model, Ω denotes a regularization term applied to each tree to penalize a complexity of the RL model, β denotes a L2 norm coefficient and α denotes L1 norm coefficient, |δ| denotes a number of leaves of the tree δ, and ω denotes a vector of values attributed to each leaf.
