# US 2025/0209641 A1 · Systems and Methods for Monitoring Cargo

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0209641 A1
- Document ID: US20250209641A1
- Status: Published application
- Kind: A1
- Application number: 18/394,853
- Filed: 2023-12-22
- Published: 2025-06-26
- Earliest claimed: 2023-12-22
- Applicants: The Boeing Company
- Inventors: Timothy W. Anstey; Arun Ayyagari; Aron Adoney Galvan; Thomas Edwin Garabedian; Lawrence Dean Hettick; Jack William Anstey; Simon-Peter Atuahene Frimpong
- Web page: https://patentgrep.com/patent/US20250209641A1

## CPC

- G06T 7/292: Multi-camera tracking
- B60P 7/06: Securing of load (vehicle retainers B60P3/073)
- B64D 9/003: {Devices for retaining pallets or freight containers}
- B64D 47/08: Arrangements of cameras
- G06T 7/001: {using an image reference approach}
- G06T 7/248: {involving reference images or patches}
- G06V 10/273: {removing elements interfering with the pattern to be recognised}
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/48: by mapping characteristic values of the pattern into a parameter space, e.g. Hough transformation
- G06V 10/753: {Transform-based matching, e.g. Hough transform}
- G06V 10/758: {Involving statistics of pixels or of feature values, e.g. histogram matching}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/7715: {Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods}
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- B64D 45/00: Aircraft indicators or protectors not otherwise provided for
- G06T 2207/20061: Hough transform
- G06T 2207/30108: Industrial image inspection
- G06T 2207/30268: Vehicle interior
- G06V 2201/06: Recognition of objects for industrial automation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60P: VEHICLES ADAPTED FOR LOAD TRANSPORTATION OR TO TRANSPORT, TO CARRY, OR TO COMPRISE SPECIAL LOADS OR OBJECTS (vehicles with special provisions for transporting patients or disabled persons, or their personal conveyances A61G3/00)
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A monitoring system to monitor cargo on a vehicle. The monitoring system includes cameras configured to capture images of the cargo while on the vehicle with the cameras aligned to capture images of the cargo from different views. A computing device includes processing circuitry configured to process the images received from the cameras. The computing device is configured to: identify a base of the cargo; track a location of the cargo within the vehicle based on a position of the base within the images; determine that the cargo is a pallet; and determine a volume of the pallet.

## Claims

### Claim 1

A monitoring system to monitor cargo on a vehicle, the monitoring system comprising:
cameras configured to capture images of the cargo while on the vehicle, the cameras aligned to capture images of the cargo from different views;
a computing device comprising processing circuitry configured to process the images received from the cameras, the computing device configured to:
perform coarse detection and fine detection on the images and detect the cargo within the images;
identify a feature of the cargo from the fine detection; and
determine a type of cargo based on the feature.

### Claim 2 (depends on 1)

The monitoring system of claim 1, wherein:
the coarse detection comprises identifying a foreground section of the images and removing a background section of the images; and
the fine detection comprises detecting the feature based on generalized Hough transforms.

### Claim 3 (depends on 1)

The monitoring system of claim 1, wherein the computing device is further configured to identify the feature as a mesh and determine that the cargo is a pallet.

### Claim 4 (depends on 1)

The monitoring system of claim 1, wherein the computing device is configured to perform the fine detection on a limited section of the images that comprises a base of the cargo and a limited number of vertical rows of pixels upward from the base.

### Claim 5 (depends on 1)

The monitoring system of claim 1, wherein the computing device is further configured to determine a confidence value of the images based on a match between the cargo captured in the image and image templates.

### Claim 6 (depends on 5)

The monitoring system of claim 5, wherein the computing device is configured to determine that the image captures the cargo when the confidence value is above a predetermined threshold.

### Claim 7 (depends on 6)

The monitoring system of claim 6, wherein the computing device is configured to determine a direction of movement of the cargo within the vehicle based on changes in the confidence values of the images.

### Claim 8 (depends on 1)

The monitoring system of claim 1, wherein the computing device is configured to identify the feature as a lack of one or more of a mesh and a belt.

### Claim 9 (depends on 1)

The monitoring system of claim 1, wherein the computing device is configured to:
determine dimensions of the cargo based on the images;
determine a scale of the images; and
determine a volume of the cargo based on the dimensions and the scale.

### Claim 10 (depends on 1)

The monitoring system of claim 1, wherein the computing device determines a volume of the cargo just when the type of the cargo is a pallet.

### Claim 11 (depends on 1)

The monitoring system of claim 1, wherein the computing device is further configured to:
identify a reference point on the cargo; and
track a location of the cargo within the vehicle based on a position of the reference point within the images.

### Claim 12

A monitoring system to monitor cargo on a vehicle, the monitoring system comprising:
cameras configured to capture images of the cargo while in the vehicle, the cameras are aligned to capture images of the cargo from different views;
a computing device comprising processing circuitry with the computing device configured to:
receive the images from the cameras;
remove a background section of the images from a foreground section of the images;
perform generalized Hough transforms and detect the cargo in the foreground sections of the images; and
determine a type of the cargo.

### Claim 13 (depends on 12)

The monitoring system of claim 12, wherein the computing device is further configured to:
identify a feature of the cargo; and
determine the type of the cargo based on the feature.

### Claim 14 (depends on 12)

The monitoring system of claim 12, wherein the computing device is further configured to:
determine a confidence score for each of the images; and
track a location of the cargo within the vehicle based on the confidence score of the images and a location of a reference point of the cargo in the images.

### Claim 15 (depends on 12)

The monitoring system of claim 12, wherein the computing device is configured to perform the generalized Hough transforms on a lower section of the foreground section that comprises a base of the cargo.

### Claim 16

A method of monitoring cargo within a vehicle, the method comprising:
receiving images of the cargo while the cargo is positioned within the vehicle;
for each of the images, performing a coarse detection and a fine detection;
identifying a feature of the cargo after performing the fine detection; and
identifying the cargo based on the feature.

### Claim 17 (depends on 16)

The method of claim 16, wherein identifying the feature comprises identifying a mesh that extends over packages of the cargo.

### Claim 18 (depends on 16)

The method of claim 16, wherein identifying the feature comprises failing to locate a particular visible item in the images with the particular visible item comprising a mesh, a belt, and a particular shape of the cargo.

### Claim 19 (depends on 16)

The method of claim 16, further comprising performing the fine detection and identifying edges of the cargo.

### Claim 20 (depends on 16)

The method of claim 16, further comprising:
determining one of the images in which the cargo fills a bounding box; and
determining a center of the cargo based on the one image.
