# US 2022/0026879 A1 · Predictive maintenance of components used in machine automation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0026879 A1
- Document ID: US20220026879A1
- Status: Published application
- Kind: A1
- Application number: 16/936,323
- Filed: 2020-07-22
- Published: 2022-01-27
- Earliest claimed: 2020-07-22
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Poorna Kale
- Web page: https://patentgrep.com/patent/US20220026879A1

## CPC

- G05B 19/4155: characterised by program execution, i.e. part program or machine function execution, e.g. selection of a program
- G05B 19/4184: {characterised by fault tolerance, reliability of production system}
- G06F 8/65: Updates (security arrangements therefor G06F21/57)
- G06N 3/049: Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/08: Learning methods
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/09: Supervised learning
- G06Q 10/20: Administration of product repair or maintenance
- G06Q 50/04: Manufacturing
- G07C 3/005: {during manufacturing process}
- G05B 2219/31229: Supervisor, leader, workstation controller, automation, machine control
- G05B 2219/32234: Maintenance planning
- G05B 2219/33027: Artificial neural network controller
- G05B 2219/34477: Fault prediction, analyzing signal trends
- G07C 5/085: {using electronic data carriers}
- Y02P 90/02: Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
- Y02P 90/30: Computing systems specially adapted for manufacturing
- Y02P 90/80: Management or planning
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- Y02P: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS

## Abstract

Systems, methods, and apparatus for prediction of maintenance service for machines. In one example, one or more sensors are configured to generate a sensor data stream during operation of a machine. An artificial neural network (ANN) is configured to receive the sensor data stream and predict a maintenance service for the machine based on the sensor data stream. For example, the ANN can be trained using the sensor data stream collected within a predetermined time period of a machine being newly-installed in an assembly line or other industrial automation facility. The machine can be considered to be operating in a normal condition during the predetermined time period such that the ANN can be trained to detect anomaly that deviates from the normal patterns of the sensor data stream. For example, the ANN can be a spiking neural network (SNN).

## Claims

### Claim 1

A system comprising:
a communication interface configured to receive, over a network, sensor data collected by at least one sensor during operation of at least one machine;
memory configured to store the received sensor data, wherein the received sensor data comprises normal data patterns associated with the operation of the at least one machine; and
a computing device configured to predict a maintenance service for the at least one machine based on an output from an artificial neural network (ANN), wherein a portion of the received sensor data is an input to the ANN, and predicting the maintenance service comprises detecting an anomaly that deviates from at least one of the normal data patterns.

### Claim 2 (depends on 1)

The system of claim 1, wherein:
the memory is a non-volatile memory device; and
the computing device is further configured to store the received sensor data in the memory using a write command, and to retrieve the portion of the received sensor data from the memory using a read command.

### Claim 3 (depends on 1)

The system of claim 1, wherein the at least sensor includes at least one of a microphone, a vibration sensor, a pressure sensor, a force sensor, a stress sensor, a deformation sensor, or an accelerometer.

### Claim 4 (depends on 1)

The system of claim 1, wherein the memory is a black box data recorder, and the computing device is further configured to:
retrieve data from the black box data recorder in response to a determination that an accident of a first type has occurred; and
train the ANN using the data retrieved from the black box data recorder, wherein the predicted maintenance service is configured to prevent a future accident of the first type.

### Claim 5 (depends on 1)

The system of claim 1, wherein the computing device is further configured to signal, via the communication interface, a controller of a first machine of the at least one machine, wherein the signaling causes the controller to vary an operating characteristic of the first machine.

### Claim 6 (depends on 5)

The system of claim 5, wherein the computing device is further configured to:
determine a configuration based on the output from the ANN; and
send the configuration to the controller, wherein the controller varies the operating characteristic based on the configuration.

### Claim 7 (depends on 1)

The system of claim 1, wherein the at least one machine is part of an assembly line to manufacture products, and the sensor data further comprises images of the products collected during or after assembly.

### Claim 8 (depends on 1)

The system of claim 1, wherein the ANN includes a spiking neural network trained to recognize the normal data patterns, and to detect the anomaly.

### Claim 9 (depends on 1)

The system of claim 1, wherein the computing device is further configured to train the ANN using the sensor data that is collected within a predetermined time of the at least one machine being installed in an automated assembly line, manufactured, serviced, or repaired.

### Claim 10 (depends on 1)

The system of claim 1, wherein the computing device is further configured to:
cause an event of a first type that affects the operation of the at least one machine;
collect first data during the event; and
train the ANN using the first data;
wherein the predicted maintenance service is associated with preventing a future event of the first type.

### Claim 11

A method comprising:
receiving, by a memory device, sensor data from at least one sensor associated with operation of at least one machine;
storing, in a non-volatile storage media of the memory device, the received sensor data; and
predicting a maintenance service for the at least one machine based on an output from an artificial neural network (ANN), wherein the ANN uses at least a portion of the received sensor data as an input.

### Claim 12 (depends on 11)

The method of claim 11, wherein the ANN comprises a spiking neural network (SNN), and predicting the maintenance service comprises detecting, based on the output from the ANN, an anomaly that deviates from normal data patterns of operation for the at least one machine.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
causing a perturbance in the operation of the at least one machine;
collecting first data from the at least one sensor after causing the perturbance;
determining a result of a first type associated with the perturbance; and
training the ANN using at least one of the first data or the determined result;
wherein predicting the maintenance service comprises identifying an action for the at least one machine, and wherein the action is configured to prevent a future result of the first type.

### Claim 14 (depends on 13)

The method of claim 13, further comprising, in response to predicting the maintenance service, causing an update of software stored on the at least one machine, wherein the software controls the operation of the at least one machine.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
identifying an occurrence of a predetermined type;
in response to identifying the occurrence, retrieving a first portion of the sensor data stored in the memory device, wherein the first portion corresponds to a predetermined period of time prior to identifying the occurrence; and
training the ANN using the first portion of the sensor data;
wherein predicting the maintenance service comprises identifying a preemptive action to perform for the at least one machine.

### Claim 16 (depends on 15)

The method of claim 15, wherein the occurrence of the predetermined type is an event that causes physical damage to the at least one machine, or a product manufactured using the at least one machine.

### Claim 17

A non-transitory computer-readable medium storing instructions which, when executed on a memory device, cause the memory device to:
receive, over a network, a sensor data stream from at least one sensor that collects data associated with operation of a machine;
store the received sensor data stream in a non-volatile memory;
predict a maintenance service based on an output from an artificial neural network (ANN), wherein a portion of the sensor data stream is an input to the ANN; and
signal, over the network and based on the predicted maintenance service, a controller of the machine to cause a change in the operation of the machine.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the ANN is configured to be self-trained via unsupervised machine learning to detect anomaly.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the instructions further cause the memory device to train the ANN; and wherein the training is based on a classification that the sensor data stream collected within a predetermined time period is normal, the ANN is configured to detect anomaly, and the ANN includes a spiking neural network.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the at least one sensor is at least one of mounted in vicinity of the machine, attached to the machine, installed in the machine, or configured to measure motion parameters of the machine.
