# US 2021/0174612 A1 · Closed-loop diagnostic model maturation for complex systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174612 A1
- Document ID: US20210174612A1
- Status: Published application
- Kind: A1
- Application number: 17/027,890
- Filed: 2020-09-22
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: The Boeing Company
- Applicants: The Boeing Company
- Inventors: Timothy J. Wilmering; Stanley C. Ofsthun; Seema Chopra; Nazrul Bayen; Rohit Kumar; Gurpreet Singh
- Web page: https://patentgrep.com/patent/US20210174612A1

## CPC

- G05B 23/024: {Quantitative history assessment, e.g. mathematical relationships between available data; Functions therefor; Principal component analysis [PCA]; Partial least square [PLS]; Statistical classifiers, e.g. Bayesian networks, linear regression or correlation analysis; Neural networks}
- G07C 5/0808: {Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005)}
- B64D 45/00: Aircraft indicators or protectors not otherwise provided for
- B64F 5/60: Testing or inspecting aircraft components or systems
- G06F 30/27: using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model
- G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)}
- B64D 2045/0085: {Devices for aircraft health monitoring, e.g. monitoring flutter or vibration}
- G05B 23/0267: {Fault communication, e.g. human machine interface [HMI]}
- G05B 23/0281: {Quantitative, e.g. mathematical distance; Clustering; Neural networks; Statistical analysis}
- G05B 23/0283: {Predictive maintenance, e.g. involving the monitoring of a system and, based on the monitoring results, taking decisions on the maintenance schedule of the monitored system; Estimating remaining useful life [RUL] (preventive maintenance, i.e. planning maintenance according to the available resources without monitoring the system G06Q10/06)}
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method is provided for maintaining an onboard reasoner for diagnosing failures on an aircraft that includes aircraft systems configured to report faults to the onboard reasoner. The method includes accessing diagnostic data received from an onboard computer of the aircraft that includes the onboard reasoner. An off-board reasoner builds an off-board diagnostic causal model that describes causal relationships between the failed tests and the diagnosed failure modes. The off-board diagnostic causal model is compared to the diagnostic data. Based thereon, a discrepancy is identified between the graph of the off-board diagnostic causal model, and the other graph of the onboard diagnostic causal model, to determine a new causal relationship relative to the known causal relationships. The onboard diagnostic causal model is updated to further describe the new causal relationship, including producing an updated model, and uploading the updated model to the onboard computer.

## Claims

### Claim 1

An off-board computer for maintaining an onboard reasoner for diagnosing failures on an aircraft that includes aircraft systems configured to report faults to the onboard reasoner, the off-board computer comprising:
memory configured to store computer-readable program code including an off-board reasoner; and
processing circuitry configured to access the memory and execute the computer-readable program code to cause the off-board computer to at least:
access diagnostic data received from an onboard computer of the aircraft that includes the onboard reasoner, the diagnostic data including a plurality of fault reports of failed tests reported by respective ones of the aircraft systems, and a plurality of diagnosed failure modes of at least some of the aircraft systems that caused the failed tests;
build, using the off-board reasoner, an off-board diagnostic causal model that describes causal relationships between the failed tests and the plurality of diagnosed failure modes, the off-board diagnostic causal model built using a graph-theoretic machine learning algorithm trained using historical diagnostic data;
compare the diagnostic data to the off-board diagnostic causal model; and based thereon,
determine a new causal relationship in the causal relationships described by the off-board diagnostic causal model that is new relative to the known causal relationships; and
update the onboard diagnostic causal model to further describe the new causal relationship, including the off-board computer caused to produce an updated onboard diagnostic causal model, and upload the updated onboard diagnostic causal model to the onboard computer using a loadable software airplane part upload tool set.

### Claim 2 (depends on 1)

The off-board computer of claim 1, wherein the off-board diagnostic causal model is represented by a graph that includes nodes connected by edges, the nodes representing the failed tests and the plurality of diagnosed failure modes, and the edges indicating the known causal relationships between the failed tests and the plurality of diagnosed failure modes.

### Claim 3 (depends on 1)

The off-board computer of claim 1, wherein the graph-theoretic machine learning algorithm is a graph-theoretic algorithm for finding maximal cliques.

### Claim 4 (depends on 1)

The off-board computer of claim 1, wherein the plurality of fault reports include a fault report that indicates those of the failed tests caused by a diagnosed failure mode of the plurality of diagnosed failure modes, and the off-board computer is further caused to:
diagnose, by the off-board reasoner, a corresponding failure mode of the aircraft system, from those of the failed tests caused by the diagnosed failure mode, and using the graph-theoretic machine learning algorithm and a graph; and
report any reporting any discrepancy between the corresponding failure mode and the diagnosed failure mode of the plurality of diagnosed failure modes from the diagnostic data received from the onboard computer.

### Claim 5 (depends on 1)

The off-board computer of claim 1, wherein the diagnostic data further includes maintenance messages with maintenance actions determined by the onboard reasoner for respective ones of the plurality of diagnosed failure modes, and the onboard diagnostic causal model further describes relationships between the possible failure modes and respective ones of the maintenance actions,
wherein for a particular maintenance message with a particular maintenance action for a respective diagnosed failure mode, the processing circuitry is configured to execute the computer-readable program code to cause the off-board computer to further at least:
access a maintenance record with a performed maintenance action for the respective diagnosed failure mode; and
identify a maintenance action discrepancy between the particular maintenance action and the performed maintenance action, to determine a new relationship between the respective diagnosed failure mode and the performed maintenance action, and
wherein the off-board computer caused to update the onboard diagnostic causal model further includes the off-board computer caused to update the onboard diagnostic causal model to describe the new relationship between the respective diagnosed failure mode and the performed maintenance action.

### Claim 6

A method of maintaining an onboard reasoner for diagnosing failures on an aircraft that includes aircraft systems configured to report faults to the onboard reasoner, the method comprising:
accessing diagnostic data received from an onboard computer of the aircraft that includes the onboard reasoner, the diagnostic data including a plurality of fault reports of failed tests reported by respective ones of the aircraft systems, and a plurality of diagnosed failure modes of at least some of the aircraft systems that caused the failed tests;
building, using an off-board reasoner, an off-board diagnostic causal model that describes causal relationships between the failed tests and the plurality of diagnosed failure modes, the off-board diagnostic causal model built using a graph-theoretic machine learning algorithm trained using historical diagnostic data;
comparing the diagnostic data to the off-board diagnostic causal model; and based thereon,
determining a new causal relationship in the causal relationships described by the off-board diagnostic causal model that is new relative to the known causal relationships; and
updating the onboard diagnostic causal model to further describe the new causal relationship, including producing an updated onboard diagnostic causal model, and uploading the updated onboard diagnostic causal model to the onboard computer using a loadable software airplane part upload tool set.

### Claim 7 (depends on 6)

The method of claim 6, wherein the off-board diagnostic causal model is represented by a graph that includes nodes connected by edges, the nodes representing the failed tests and the plurality of diagnosed failure modes, and the edges indicating the known causal relationships between the failed tests and the plurality of diagnosed failure modes.

### Claim 8 (depends on 6)

The method of claim 6, wherein the comparing of the diagnostic data to the off-board diagnostic causal model further comprises comparing to actual failure data, diagnostic data, and maintenance action data collected from an onboard aircraft system, which reflect actual causal relationships.

### Claim 9 (depends on 6)

The method of claim 6, wherein the graph-theoretic machine learning algorithm is a graph-theoretic algorithm for finding maximal cliques.

### Claim 10 (depends on 6)

The method of claim 6, wherein the plurality of fault reports include a fault report that indicates those of the failed tests caused by a diagnosed failure mode of the plurality of diagnosed failure modes, and the method further comprises:
diagnosing, by the off-board reasoner, a corresponding failure mode of the aircraft system, from those of the failed tests caused by the diagnosed failure mode, and using the graph-theoretic machine learning algorithm and a graph; and
reporting any reporting any discrepancy between the corresponding failure mode and the diagnosed failure mode of the plurality of diagnosed failure modes from the diagnostic data received from the onboard computer.

### Claim 11 (depends on 6)

The method of claim 6, wherein the diagnostic data further includes maintenance messages with maintenance actions determined by the onboard reasoner for respective ones of the plurality of diagnosed failure modes, and the onboard diagnostic causal model further describes relationships between the possible failure modes and respective ones of the maintenance actions, and
wherein for a particular maintenance message with a particular maintenance action for a respective diagnosed failure mode, the method further comprises:
accessing a maintenance record with a performed maintenance action for the respective diagnosed failure mode; and
identifying a maintenance action discrepancy between the particular maintenance action and the performed maintenance action, to determine a new relationship between the respective diagnosed failure mode and the performed maintenance action,
wherein updating the onboard diagnostic causal model further includes updating the onboard diagnostic causal model to describe the new relationship between the respective diagnosed failure mode and the performed maintenance action.

### Claim 12 (depends on 6)

The method of claim 6 further comprising:
receiving a fault report at the onboard computer of the aircraft that includes the onboard reasoner, from an aircraft system of the aircraft systems, the fault report indicating failed tests reported by the aircraft system;
accessing, by the onboard reasoner, the updated onboard diagnostic causal model;
diagnosing, by the onboard reasoner, a failure mode of the aircraft system or another of the aircraft systems, from the failed tests, and using a graph-theoretic algorithm and the updated onboard diagnostic causal model;
determining a maintenance action for the failure mode; and
generating, by the onboard computer, a maintenance message including at least the maintenance action.

### Claim 13 (depends on 12)

The method of claim 12, wherein the graph-theoretic algorithm is an optimal solution set (OSS) algorithm.

### Claim 14

A system for maintaining an onboard reasoner for diagnosing failures on an aircraft that includes aircraft systems configured to report faults to the onboard reasoner, the system comprising:
an onboard computer including the onboard reasoner, the onboard computer configured to send diagnostic data including a plurality of fault reports of failed tests reported by respective ones of the aircraft systems, and a plurality of diagnosed failure modes of at least some of the aircraft systems that caused the failed tests; and
an off-board computer including an off-board reasoner, the off-board computer configured to:
access the diagnostic data received from the onboard computer;
build an off-board diagnostic causal model that describes causal relationships between the failed tests and the plurality of diagnosed failure modes, the off-board diagnostic causal model built using a graph-theoretic machine learning algorithm trained using historical diagnostic data;
compare the diagnostic data to the off-board diagnostic causal model; and
based thereon,
determine a new causal relationship in the causal relationships described by the off-board diagnostic causal model that is new relative to the known causal relationships; and
update the onboard diagnostic causal model to further describe the new causal relationship, including the off-board computer configured to produce an updated onboard diagnostic causal model, and upload the updated onboard diagnostic causal model to the onboard computer using a loadable software airplane part upload tool set.

### Claim 15 (depends on 14)

The system of claim 14, wherein the off-board diagnostic causal model is represented by a graph that includes nodes connected by edges, the nodes representing the failed tests and the plurality of diagnosed failure modes, and the edges indicating the known causal relationships between the failed tests and the plurality of diagnosed failure modes.

### Claim 16 (depends on 14)

The system of claim 14, wherein the comparison of the diagnostic data to the off-board diagnostic causal model further comprises comparison to actual failure data, diagnostic data, and maintenance action data collected from an onboard aircraft system, which reflect actual causal relationships.

### Claim 17 (depends on 14)

The system of claim 14, wherein the graph-theoretic machine learning algorithm is a graph-theoretic algorithm for finding maximal cliques.

### Claim 18 (depends on 14)

The system of claim 14, wherein the plurality of fault reports include a fault report that indicates those of the failed tests caused by a diagnosed failure mode of the plurality of diagnosed failure modes, and the off-board computer is further configured to:
diagnose, by the off-board reasoner, a corresponding failure mode of the aircraft system, from those of the failed tests caused by the diagnosed failure mode, and using the graph-theoretic machine learning algorithm and a graph; and
report any reporting any discrepancy between the corresponding failure mode and the diagnosed failure mode of the plurality of diagnosed failure modes from the diagnostic data received from the onboard computer.

### Claim 19 (depends on 14)

The system of claim 14, wherein the diagnostic data further includes maintenance messages with maintenance actions determined by the onboard reasoner for respective ones of the plurality of diagnosed failure modes, and the onboard diagnostic causal model further describes relationships between the possible failure modes and respective ones of the maintenance actions,
wherein for a particular maintenance message with a particular maintenance action for a respective diagnosed failure mode, the off-board computer is configured to:
access a maintenance record with a performed maintenance action for the respective diagnosed failure mode; and
identify a maintenance action discrepancy between the particular maintenance action and the performed maintenance action, to determine a new relationship between the respective diagnosed failure mode and the performed maintenance action, and
wherein the off-board computer configured to update the onboard diagnostic causal model further includes the off-board computer configured to update the onboard diagnostic causal model to describe the new relationship between the respective diagnosed failure mode and the performed maintenance action.

### Claim 20 (depends on 14)

The system of claim 14, wherein the onboard computer is further configured to:
receive a fault report of the aircraft, from an aircraft system of the aircraft systems, the fault report indicating failed tests reported by the aircraft system;
access, by the onboard reasoner, the updated onboard diagnostic causal model;
diagnose, by the onboard reasoner, a failure mode of the aircraft system or another of the aircraft systems, from the failed tests, and using a graph-theoretic algorithm and the updated onboard diagnostic causal model;
determine a maintenance action for the failure mode; and
generate a maintenance message including at least the maintenance action.

### Claim 21 (depends on 20)

The system of claim 20, wherein the graph-theoretic algorithm is an optimal solution set (OSS) algorithm.
