# US 2023/0176542 A1 · Method and device for monitoring production equipment and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0176542 A1
- Document ID: US20230176542A1
- Status: Published application
- Kind: A1
- Application number: 17/807,862
- Filed: 2022-06-20
- Published: 2023-06-08
- Earliest claimed: 2021-12-08
- Assignees: Changxin Memory Technologies, Inc.
- Applicants: Changxin Memory Technologies, Inc.
- Inventors: Shanshan HUA
- Web page: https://patentgrep.com/patent/US20230176542A1

## CPC

- G05B 19/4063: Monitoring general control system (G05B19/4062 takes precedence)
- G05B 19/4184: {characterised by fault tolerance, reliability of production system}
- G05B 2219/31455: Monitor process status
- G05B 2219/37001: Measuring problems
- Y02P 90/30: Computing systems specially adapted for manufacturing
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

A method and device for monitoring production equipment and a storage medium includes: a measurement result of production equipment to be monitored is acquired; the measurement result of the production equipment to be monitored is evaluated on at least one evaluation dimension to obtain an evaluation result on each evaluation dimension; and a production state of the production equipment to be monitored is determined based on the evaluation result on the at least one evaluation dimension. The production state includes a normal state and an abnormal state. The at least one evaluation dimension includes at least one of a process level of products, a statistical significance of products or a distribution trend of products.

## Claims

### Claim 1

A method for monitoring production equipment, applied to a monitoring device and comprising:
acquiring a measurement result of production equipment to be monitored;
evaluating the measurement result of the production equipment to be monitored on at least one evaluation dimension, to obtain an evaluation result on each evaluation dimension; and
determining a production state of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension,
wherein the production state comprises a normal state and an abnormal state, and the at least one evaluation dimension comprises at least one of a process level of products, a statistical significance of products or a distribution trend of products.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining a target group the production equipment to be monitored belongs to;
determining, in a case that the target group only comprises the production equipment to be monitored, that the at least one evaluation dimension is the process level of products;
determining, in a case that the target group comprises one piece of production equipment other than the production equipment to be monitored, that the at least one evaluation dimension is one of:
the process level of products; or
the process level of products and the statistical significance of products; and
determining, in a case that the target group comprises at least two pieces of production equipment other than the production equipment to be monitored, that the at least one evaluation dimension is one of:
the process level of products;
the process level of products and the statistical significance of products; or
the process level of products, the statistical significance of products and the distribution trend of products.

### Claim 3 (depends on 2)

The method of claim 2, wherein the determining the target group the production equipment to be monitored belongs to comprises:
acquiring a measurement result set, the measurement result set comprising measurement results of products produced by each piece of production equipment on a production line in a production state;
grouping measurement results corresponding to same production equipment and same process parameters into one group; and
determining the target group the production equipment to be monitored belongs to.

### Claim 4 (depends on 1)

The method of claim 1, wherein the evaluation dimension comprises the process level of products,
wherein the evaluating the measurement result of the production equipment to be monitored on the at least one evaluation dimension to obtain the evaluation result on each evaluation dimension comprises:
determining a parameter value of the process level based on the measurement result of the production equipment to be monitored; and
comparing the parameter value of the process level and a first preset threshold to obtain an evaluation result on a dimension about the process level of products;
and wherein the determining the production state of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension comprises:
determining that the production state of the production equipment to be monitored is an abnormal state in a case that the parameter value of the process level is less than or equal to the first preset threshold.

### Claim 5 (depends on 1)

The method of claim 1, wherein the evaluation dimension comprises the statistical significance of products,
and wherein the evaluating the measurement result of the production equipment to be monitored on the at least one evaluation dimension to obtain the evaluation result on each evaluation dimension comprises:
acquiring the measurement result of the production equipment to be monitored and a measurement result of reference equipment;
judging whether the measurement result of the production equipment to be monitored satisfies a normal distribution and whether the measurement result of the reference equipment satisfies the normal distribution, respectively by use of a first hypothesis testing method; and
judging, in a case that the measurement result of the production equipment to be monitored does not satisfy the normal distribution or the measurement result of the reference equipment does not satisfy the normal distribution, whether a difference between the production equipment to be monitored and the reference equipment is significant by use of a second hypothesis testing method to obtain an evaluation result on a dimension about the statistical significance of products.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
determining a target group the production equipment to be monitored belongs to;
determining production equipment in the target group except the production equipment to be monitored as a reference equipment set; and
determining production equipment of which an average value of a measurement result satisfies a condition relative to a preset target value in the reference equipment set as reference equipment.

### Claim 7 (depends on 5)

The method of claim 5, wherein the judging whether the measurement result of the production equipment to be monitored satisfies the normal distribution and whether the measurement result of the reference equipment satisfies the normal distribution, respectively by use of the first hypothesis testing method comprises:
judging whether the measurement result of the production equipment to be monitored satisfies the normal distribution and whether the measurement result of the reference equipment satisfies the normal distribution, respectively by use of the first hypothesis testing method;
determining that the measurement result does not satisfy the normal distribution in a case that a Probability-value (P-value) of the first hypothesis testing method is less than or equal to a second preset threshold; and
determining that the measurement result satisfies the normal distribution in a case that the P-value of the first hypothesis testing method is greater than the second preset threshold.

### Claim 8 (depends on 5)

The method of claim 5, wherein the evaluating the measurement result of the production equipment to be monitored on the at least one evaluation dimension to obtain the evaluation result on each evaluation dimension further comprises:
judging whether variances of the production equipment to be monitored and the reference equipment are equal by use of a third hypothesis testing method in a case that both the measurement result of the production equipment to be monitored and the measurement result of the reference equipment satisfy the normal distribution;
judging, in a case that the variances are equal, whether a difference between the production equipment to be monitored and the reference equipment is significant by use of a fourth hypothesis testing method to obtain the evaluation result on a dimension about the statistical significance of products; and
judging, in a case that the variances are unequal, whether a difference between the production equipment to be monitored and the reference equipment is significant by use of a fifth hypothesis testing method to obtain the evaluation result on the dimension about the statistical significance of products,
the fourth hypothesis testing method being different from the fifth hypothesis testing method.

### Claim 9 (depends on 8)

The method of claim 8, wherein the judging whether the variances of the production equipment to be monitored and the reference equipment are equal by use of the third hypothesis testing method comprises:
judging whether the variances of the production equipment to be monitored and the reference equipment are equal by use of the third hypothesis testing method;
determining that the measurement results do not satisfy that the variances are equal in a case that a Probability-value (P-value) of the third hypothesis testing method is less than or equal to a third preset threshold; and
determining that the measurement results satisfy that the variances are equal in a case that the P-value of the third hypothesis testing method is greater than the third preset threshold.

### Claim 10 (depends on 1)

The method of claim 1, wherein the evaluation dimension comprises the distribution trend of products;
the evaluating the measurement result of the production equipment to be monitored on the at least one evaluation dimension to obtain the evaluation result on each evaluation dimension comprises:
acquiring a upper quantile and a lower quantile of the measurement result of the production equipment to be monitored and a upper quantile and a lower quantile of measurement results of a preset reference equipment set,
determining a maximum upper quantile and minimum lower quantile corresponding to the preset reference equipment set, and
comparing the upper quantile of the production equipment to be monitored and the maximum upper quantile and comparing the lower quantile of the production equipment to be monitored and the minimum lower quantile respectively to obtain a first sub evaluation result and second sub evaluation result on a dimension about the distribution trend of products; and
the determining the production state of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension comprises:
determining that the production state of the production equipment to be monitored is a normal state in a case that the upper quantile of the production equipment to be monitored is less than the maximum upper quantile and the lower quantile of the production equipment to be monitored is greater than the minimum lower quantile, otherwise determining that the production state of the production equipment to be monitored is an abnormal state.

### Claim 11 (depends on 1)

The method of claim 1, wherein the determining the production state of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension comprises:
determining a difference score of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension;
determining that the production state of the production equipment to be monitored is an abnormal state in a case that the difference score is greater than a fourth preset threshold; and
determining that the production state of the production equipment to be monitored is a normal state in a case that the difference score is equal to the fourth preset threshold.

### Claim 12 (depends on 11)

The method of claim 11, wherein the determining the difference score of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension comprises:
acquiring a weight of each evaluation dimension;
setting that a score is 1 in a case of determining, by use of each evaluation dimension, that the production state of the production equipment to be monitored is an abnormal state, otherwise is 0; and
determining the difference score of the production equipment to be monitored, the difference score being equal to an accumulated sum of a product of the weight of each evaluation dimension and the score of a judgment result corresponding to the evaluation dimension.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
acquiring a first number of preset sets comprising production equipment on a preset date;
setting each piece of production equipment in each preset set as production equipment to be monitored;
determining the production state of each piece of production equipment to be monitored;
acquiring a second number of corresponding preset sets where the production state of the production equipment to be monitored on the evaluation dimension is an abnormal state from all preset sets on the preset date; and
determining a mismatch ratio of the preset sets judged on the evaluation dimension on the preset date based on the first number and the second number.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
acquiring an accumulated number of days when the production state of the production equipment to be monitored is an abnormal state in a preset time period; and
determining a mismatch ratio-days of the production equipment to be monitored in the preset time period based on the accumulated number of days and a number of days corresponding to the preset time period.

### Claim 15

A device for monitoring production equipment, comprising
a memory for storing a computer program; and
a processor,
wherein the processor is configured to execute the computer program to implement the following operations:
acquiring a measurement result of production equipment to be monitored;
evaluating the measurement result of the production equipment to be monitored on at least one evaluation dimension, to obtain an evaluation result on each evaluation dimension; and
determining a production state of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension,
wherein the production state comprises a normal state and an abnormal state, and the at least one evaluation dimension comprises at least one of a process level of products, a statistical significance of products or a distribution trend of products.

### Claim 16 (depends on 15)

The device of claim 15, wherein the processor is further configured to execute the computer program to:
determine a target group the production equipment to be monitored belongs to;
determine, in a case that the target group only comprises the production equipment to be monitored, that the at least one evaluation dimension is the process level of products;
determine, in a case that the target group comprises one piece of production equipment other than the production equipment to be monitored, that the at least one evaluation dimension is one of:
the process level of products; or
the process level of products and the statistical significance of products; and determine, in a case that the target group comprises at least two pieces of production equipment other than the production equipment to be monitored, that the at least one evaluation dimension is one of:
the process level of products;
the process level of products and the statistical significance of products; or
the process level of products, the statistical significance of products and the distribution trend of products.

### Claim 17 (depends on 16)

The device of claim 16, wherein the processor is further configured to execute the computer program to:
acquire a measurement result set, the measurement result set comprising measurement results of products produced by each piece of production equipment on a production line in a production state;
group measurement results corresponding to same production equipment and same process parameters into one group; and
determine the target group the production equipment to be monitored belongs to.

### Claim 18 (depends on 15)

The device of claim 15, wherein the evaluation dimension comprises the process level of products, and wherein the processor is further configured to execute the computer program to:
determine a parameter value of the process level based on the measurement result of the production equipment to be monitored;
compare the parameter value of the process level and a first preset threshold to obtain an evaluation result on a dimension about the process level of products; and
determine that the production state of the production equipment to be monitored is an abnormal state in a case that the parameter value of the process level is less than or equal to the first preset threshold.

### Claim 19 (depends on 15)

The device of claim 15, wherein the evaluation dimension comprises the statistical significance of products, and wherein the processor is further configured to execute the computer program to:
acquire the measurement result of the production equipment to be monitored and a measurement result of reference equipment;
judge whether the measurement result of the production equipment to be monitored satisfies a normal distribution and whether the measurement result of the reference equipment satisfies the normal distribution, respectively by use of a first hypothesis testing method; and
judge, in a case that the measurement result of the production equipment to be monitored does not satisfy the normal distribution or the measurement result of the reference equipment does not satisfy the normal distribution, whether a difference between the production equipment to be monitored and the reference equipment is significant by use of a second hypothesis testing method to obtain an evaluation result on a dimension about the statistical significance of products.

### Claim 20

A non-transitory computer-readable storage medium having stored therein a computer program which is executed by a processor to implement the following operations:
acquiring a measurement result of production equipment to be monitored;
evaluating the measurement result of the production equipment to be monitored on at least one evaluation dimension, to obtain an evaluation result on each evaluation dimension; and
determining a production state of the production equipment to be monitored based on the evaluation result on the at least one evaluation dimension,
wherein the production state comprises a normal state and an abnormal state, and the at least one evaluation dimension comprises at least one of a process level of products, a statistical significance of products or a distribution trend of products.
