# US 2024/0062077 A1 · Estimation of Current and Future Machine States

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0062077 A1
- Document ID: US20240062077A1
- Status: Published application
- Kind: A1
- Application number: 18/498,413
- Filed: 2023-10-31
- Published: 2024-02-22
- Earliest claimed: 2016-12-21
- Assignees: ABB Schweiz AG
- Applicants: ABB Schweiz AG
- Inventors: Andrew Cohen; Marcel Dix
- Web page: https://patentgrep.com/patent/US20240062077A1

## CPC

- G06N 5/02: Knowledge representation; Symbolic representation
- G05B 19/4155: characterised by program execution, i.e. part program or machine function execution, e.g. selection of a program
- G05B 23/0205: {by means of a monitoring system capable of detecting and responding to faults}
- G05B 23/0254: {based on a quantitative model, e.g. mathematical relationships between inputs and outputs; functions: observer, Kalman filter, residual calculation, Neural Networks}
- G06N 5/04: Inference or reasoning models
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G05B 2219/33139: Design of industrial communication system with expert system
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

Disclosed is a method for generating a prediction model. The model can be used in processing machine event data to predict behavior of a plurality of industrial machines under supervision. The prediction model can be configured to determine current and future states of the industrial machines. The method can include extracting event features from event codes and structuring the event features into feature vectors. A first dimension of a first feature vector corresponds to a first event feature, and a second dimension of the first feature vector corresponds to a second event feature. The method can also include generating the prediction model by clustering the feature vectors into a plurality of vector clusters, the vector clusters assigned to respective machine states. The prediction model can be constructed based on event data from a first industrial machine and be applied to control an operating state of a second industrial machine.

## Claims

### Claim 1

A computer-implemented method for generating a prediction model, the model being for use in processing machine event data generated by one or more of a plurality of industrial machines sharing common properties, the method comprising:
receiving an event log comprising a plurality of codes representing events that occurred during operation of at least one industrial machine of the plurality of industrial machines during an observation time interval, the event representations comprising respective time stamps and event codes;
extracting event features from the event codes and structuring the event features into feature vectors, wherein a first dimension of a first feature vector of the feature vectors corresponds to a first event feature of the extracted event features, and a second dimension of the first feature vector corresponds to a second event feature of the extracted event features; and
generating the prediction model by clustering the feature vectors into a plurality of vector clusters, the vector clusters being assigned to respective machine states,
wherein the prediction model is configured to receive, as an input, one or more of the event codes and to provide, as an output, one or more probabilities of the at least one industrial machine transitioning between a first of the machine states to a second of the machine states.

### Claim 2 (depends on 1)

The method of claim 1, wherein the event codes comprise character strings.

### Claim 3 (depends on 2)

The method of claim 2, wherein the extracted event features describe at least one of:
a frequency of a first event associated with a first of the event codes;
a frequency of the first event and a second event occurring within a predetermine time interval, the second event associated with a second of the event codes;
a frequency of the first event and the second event occurring within a predetermined number of intervening event codes.

### Claim 4 (depends on 1)

The method of claim 1, wherein extracting the event features into feature vectors comprises one or more of the following processing techniques: a skip-gram technique, continuous bag of words processing technique, a topic modelling technique, and a pairwise co-occurrence technique.

### Claim 5 (depends on 1)

The method of claim 1, wherein clustering the feature vectors comprises one or more of the following processing techniques: k-means, fuzzy c-means, expectation-maximization clustering, affinity-propagation, density based DBScan, and density-based maximum-margin clustering.

### Claim 6 (depends on 1)

The method of claim 1, wherein the prediction model comprises a state sequence model.

### Claim 7 (depends on 6)

The method of claim 6, wherein the state sequence model determines:
a current machine state and a probability of the current machine state transitioning into one of at least three known states during a finite time period of interest in the future,
a probability of a first one of the at least three known states transitioning into a second one of the least three known states,
a probability of an intrastate transition, wherein a previous machine state to the one of the at least three known states is identical to a subsequent machine state to the one of the at least three known states, and
wherein the method further comprises:
after generating the state sequence model for providing the probability of the current machine state transitioning for each of the at least three known states, each known state is assigned a semantic output meaning; and
altering the operation of the at least one of the industrial machines by a control signal using the semantic output meaning.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one industrial machine comprises a first industrial machine and the method comprises:
receiving event codes from a second industrial machine of the plurality of industrial machines;
inputting the event codes received from the second industrial machine into the prediction model and outputting, from the prediction model, one or more probabilities of the second industrial machine transitioning between the first and the second machine states.

### Claim 9 (depends on 8)

The method of claim 8, comprising controlling a motor of the second industrial machine based on the one or more probabilities of the second industrial machine transitioning between the first and second machine states.

### Claim 10 (depends on 8)

The method of claim 8, comprising controlling the second industrial machine based on the one or more probabilities of the second industrial machine transitioning between the first and second machine states.

### Claim 11 (depends on 1)

The method of claim 1, wherein the method further comprises:
providing a control signal based on the one or more probabilities of the at least one industrial machine transitioning between the first of the machine states to the second of the machine states; and
influencing an operation of the at least one industrial machine based on the control signal.

### Claim 12 (depends on 1)

The method of claim 1, wherein extracting event features from the event codes further comprises:
determining the first event feature based on a relation between a first event code of the event codes and either a second event code of the event codes or a different element of the received event log.

### Claim 13 (depends on 1)

A non-transitory computer-readable medium comprising code configured to cause a computing system comprising one or more computer devices to perform the method of claim 1.

### Claim 14 (depends on 1)

A computer system comprising one or more processors configured to perform the method of claim 1.

### Claim 15

A computer-implemented method for predicting behavior of a first industrial machine of a plurality of industrial machines, the plurality of industrial machines sharing common properties, the method comprising:
generating a prediction model by receiving historical event data comprising event codes from a second industrial machine of the plurality of industrial machines;
extracting event features from the event codes and structuring the event features into feature vectors, wherein a first dimension of a first feature vector of the feature vectors corresponds to a first event feature of the extracted event features, and a second dimension of the first feature vector corresponds to a second event feature of the extracted event features;
generating the prediction model by clustering the feature vectors into a plurality of vector clusters, the vector clusters being assigned to respective machine states;
receiving, with the prediction model, one or more of the event input codes and outputting, with the prediction model, one or more probabilities of the first industrial machine transitioning between a first of the machine states to a second of the machine states; and
adjusting a state of the first industrial machine based on the one or more probabilities.

### Claim 16 (depends on 15)

A non-transitory computer-readable medium comprising code configured to cause a computing system comprising one or more computer devices to perform the method of claim 15.

### Claim 17 (depends on 15)

A computer system comprising one or more processors configured to perform the method of claim 15.

### Claim 18

A computer-implemented method for generating a prediction model, the model being for use in processing machine event data generated by one or more of a plurality of industrial machines sharing common properties, the method comprising:
receiving an event log comprising a plurality of codes representing events that occurred during operation of at least one industrial machine of the plurality of industrial machines during an observation time interval, the event representations comprising respective time stamps and event codes;
extracting event features from the event codes and structuring the event features into feature vectors, wherein a first dimension of a first feature vector of the feature vectors corresponds to a first event feature of the extracted event features, and a second dimension of the first feature vector corresponds to a second event feature of the extracted event features;
generating the prediction model by clustering the feature vectors into a plurality of vector clusters, the vector clusters being assigned to respective machine states; and
after the prediction model has been generated, assigning a semantic meaning to at least one of the respective machine states, wherein the semantic meanings describe a meaning of the machine state,
wherein the prediction model is configured to receive, as an input, one or more of the event codes and to provide, as an output, one or more probabilities of the at least one industrial machine transitioning between a first of the machine states to a second of the machine states.

### Claim 19 (depends on 18)

The method of claim 18, wherein assigning semantic meanings to the first or second of the machine states is performed by interacting with an expert human user.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
providing a control signal based on the one or more probabilities of the at least one industrial machine transitioning between the first of the machine states to the second of the machine states.
