# US 2024/0203132 A1 · Group of neural networks ensuring integrity

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203132 A1
- Document ID: US20240203132A1
- Status: Published application
- Kind: A1
- Application number: 18/594,532
- Filed: 2024-03-04
- Published: 2024-06-20
- Earliest claimed: 2019-11-26
- Assignees: Apex Ai Industries, LLC
- Applicants: Apex AI Industries, LLC
- Inventors: Kenneth Austin Abeloe
- Web page: https://patentgrep.com/patent/US20240203132A1

## CPC

- G05B 13/027: {using neural networks only}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06F 9/44536: {Selecting among different versions}
- G06F 18/211: Selection of the most significant subset of features
- G06F 18/2193: {based on specific statistical tests}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06F 18/2413: based on distances to training or reference patterns
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/08: Learning methods
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/09: Supervised learning
- G06N 3/092: Reinforcement learning
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/771: Feature selection, e.g. selecting representative features from a multi-dimensional feature space
- H04L 9/008: {involving homomorphic encryption}
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Methods and systems for controlling an autonomous machine. The autonomous machine has sensors generating input data, while the controller includes two or more neural networks that inference using the input data and generate output data. The neural networks can be trained using an identical set of training data set. The output data from each of the neural networks are monitored to ensure that the integrity of the operation is maintained by, for example, the output data from one neural network is compared with the output data from another neural network to verify the consistency. If the comparison yields that the integrity of the system is not maintained at an acceptable level, the controller can stop using the output in controlling the autonomous machine.

## Claims

### Claim 1

A controller for controlling one or more autonomous machines each coupled to a plurality of sensors generating input data, the controller comprising:
a first neural network deployed on the autonomous machine, trained with a first training data set and configured to generate first output data after processing a set of input data;
a second neural network deployed on the autonomous machine, trained with a second training data set and configured to generate second output data after processing said set of input data; and
a comparator receiving and comparing the first output data and second output data, the comparator configured to detect a difference between the first and second output data and produce a result, wherein the controller controls the one or more autonomous machine using input that includes the first output data and the result of the comparator.

### Claim 2 (depends on 1)

The controller of claim 1, wherein the first neural network and the second neural network are deployed in different memory spaces.

### Claim 3 (depends on 1)

The controller of claim 1, wherein the first and second neural networks are deployed on different virtual machines.

### Claim 4 (depends on 1)

The controller of claim 1, wherein the one or more autonomous machines includes multiple autonomous machines, and the first neural network is deployed on one of the autonomous machines and the second neural network is deployed on another of the autonomous machines.

### Claim 5 (depends on 1)

The controller of claim 1, wherein the comparator is further configured to detect a minimum difference between the first output data and the second output data and produce the result.

### Claim 6 (depends on 2)

The controller of claim 2, wherein the controller further comprises a counter for counting instances of the comparator detecting the minimum difference between the first and second output data, and wherein the controller stops using the first output data to control the autonomous machine when the counter counts more than a predetermined number during a predetermined time period.

### Claim 7 (depends on 6)

The controller of claim 6, wherein the predetermined number is one.

### Claim 8 (depends on 1)

The controller of claim 1, wherein the first and second training data sets are identical to each other.

### Claim 9 (depends on 1)

The controller of claim 1, wherein each of the one or more autonomous machines is an autonomous land vehicle.

### Claim 10

A method of controlling an autonomous machine coupled to a plurality of sensors generating input data, comprising the steps of:
inferencing to generate first output data on a first neural network deployed on the autonomous machine and trained with a first training data set;
inferencing to generate second output data on a second neural network deployed on the autonomous machine and trained with a second training data set;
detecting a minimum difference between the first output data and second output data and producing a result; and
controlling the autonomous machine using input that includes the first output data and the result of the detecting step.

### Claim 11 (depends on 10)

The method of claim 10, wherein the first neural network and the second neural network are deployed in different memory spaces on the autonomous machine.

### Claim 12 (depends on 10)

The method of claim 10, wherein the first and second neural networks are on different virtual machines on the autonomous machine.

### Claim 13 (depends on 10)

The method of claim 10, wherein the one or more autonomous machines includes multiple autonomous machines, and the first neural network is on one of the autonomous machines and the second neural network is on another of the autonomous machines.

### Claim 14 (depends on 10)

The method of claim 10, wherein the first and second training data sets are identical to each other.

### Claim 15 (depends on 10)

The method of claim 10, further comprising counting instances of detecting the minimum difference between the first and second output data, wherein the controller stops using the first output data to control the autonomous machine when the counted instances is more than a predetermined number during a predetermined time period.

### Claim 16 (depends on 10)

The method of claim 10, wherein the autonomous machine is an autonomous land vehicle.

### Claim 17

A controller for controlling one or more autonomous machines each coupled to a plurality of sensors generating input data, the controller comprising:
a first neural network deployed on the autonomous machine, trained with a first training data set and configured to generate first output data after processing a set of input data;
a second neural network deployed on the autonomous machine, trained with a second training data set and configured to generate second output data after processing said set of input data; and
a means for comparing the first output data and second output data and detect a minimum difference between the first and second output data and produce a result, wherein the controller controls the autonomous machine using input that includes the first output data and the result.

### Claim 18 (depends on 17)

The controller of claim 17, wherein the first neural network and the second neural network are deployed in different memory spaces.

### Claim 19 (depends on 17)

The controller of claim 17, wherein the first neural network and the second neural network are deployed on different virtual machines.

### Claim 20 (depends on 17)

The controller of claim 17, wherein the one or more autonomous machines includes multiple autonomous machines, and the first neural network is deployed on one of the autonomous machines and the second neural network is deployed on another of the autonomous machines.

### Claim 21 (depends on 17)

The controller of claim 17, wherein the controller further comprises a means for counting instances of the means for comparing detecting a minimum difference between the first and second output data, wherein the controller stops using the first output data to control the autonomous machine when the means for counting counts more than a predetermined number during a predetermined time period.
