Systems and methods of monitoring cargo load systems for damage detection

A method for inspecting components of a cargo handling system, the method comprising:

• receiving, by an inspection system controller, a begin component inspection operation command;
• receiving, by the inspection system controller, image data from a camera configured to capture images of a detection zone;
• identifying, by the inspection system controller, a component of the cargo handling system in the image data, wherein identifying, by the inspection system controller, the component of the cargo handling system in the image data comprises:
• inputting, by the inspection system controller, the image data into a trained component identification model;
• and
• receiving, by the inspection system controller, a component identification output by the trained component identification model;
• determining, by the inspection system controller, a state of the component, wherein the state of the component comprises at least one of a normal state or a damaged state, wherein determining, by the inspection system controller, the state of the component comprises:
• selecting, by the inspection system controller, a trained damage classification model based on the component identification output by the trained component identification model;
• inputting, by the inspection system controller, the image data into the trained damage classification model;
• and
• receiving, by the inspection system controller, a damage classification output by the trained damage classification model, the damage classification corresponding to the state of the component;
• determining, by the inspection system controller, a confidence score of the damage classification;
• comparing, by the inspection system controller, the confidence score to a threshold confidence;
• and
• commanding, by the inspection system controller, the camera to at least one of rotate, zoom-in, or zoom-out in response to determining the confidence score to is less than the threshold confidence.

An article of manufacture including a tangible, non-transitory computer-readable storage medium having instructions stored thereon for performing a cargo handling system component inspection operation and that, in response to execution by an inspection system controller, cause the inspection system controller to perform operations comprising:

• receiving, by the inspection system controller, a begin component inspection operation command;
• receiving, by the inspection system controller, image data from a camera configured to capture images of a cargo handling system;
• identifying, by the inspection system controller, a component of the cargo handling system in the image data, wherein identifying, by the inspection system controller, the component of the cargo handling system in the image data comprises:
• inputting, by the inspection system controller, the image data into a trained component identification model;
• and
• receiving, by the inspection system controller, a component identification output by the trained component identification model;
• determining, by the inspection system controller, a state of the component, wherein the state of the component comprises at least one of a normal state or a damaged state, wherein determining, by the inspection system controller, the state of the component comprises:
• selecting, by the inspection system controller, a trained damage classification model based on the component identification output by the trained component identification model;
• inputting, by the inspection system controller, the image data into the trained damage classification model;
• and
• receiving, by the inspection system controller, a damage classification output by the trained damage classification model, the damage classification corresponding to the state of the component;
• and
• sending, by the inspection system controller, instructions to a portable electronic device configured to cause the portable electronic device to command the camera to at least one of zoom-in or zoom-out and capture image data of a damaged portion of the component.