# US 10,311,315 B2 · Camera array system and method to detect a load status of a semi-trailer truck

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,315 B2
- Document ID: US10311315B2
- Status: Granted
- Kind: B2
- Application number: 15/491,040
- Filed: 2017-04-19
- Published: 2017-09-14
- Granted: 2019-06-04
- Earliest claimed: 2015-04-08
- Applicants: Spireon, Inc.
- Inventors: Jeffrey M. Drazan; James Brady; Jim Epler
- Web page: https://patentgrep.com/patent/US10311315B2

## CPC

- H04N 7/181: {for receiving images from a plurality of remote sources}
- B60R 1/26: to the rear of the vehicle
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 23/56: provided with illuminating means
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- B60R 2011/0003: {inside the vehicle}
- B60R 2300/105: using multiple cameras
- B60R 2300/406: using wireless transmission
- B60R 2300/8006: for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
- B60R 2300/8046: for replacing a rear-view mirror system
- G01G 19/08: for incorporation in vehicles
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G01G: WEIGHING (sorting by weighing B07C5/16)

## Abstract

Disclosed are a method, a device and/or a system of utilizing a camera array system to detect a load status of a semi-trailer truck. A sensor array is affixed to a surface of a trailer of the semi-trailer truck to automatically determine whether a cargo area of the semi-trailer truck is occupied. A set of cameras of the sensor array have each camera embedded in individual recesses of the sensor array. The cargo area is illuminated using at least one light source of the sensor array. A memory and a processor associated with the sensor array are configured to store one baseline image of the cargo area of the trailer in an empty state. The processor is configured to detect a triggering event. The processor determines a cargo status based upon a difference between the current image and the baseline image, and sends the cargo status to a dispatcher.

## Claims

### Claim 1

An apparatus for monitoring a cargo area within an interior cavity of a cargo transport trailer, the apparatus comprising:
a plurality of imaging devices distributed along a length of the interior cavity of the cargo transport trailer, each of the imaging devices having a field of view encompassing at least a portion of one or more projection areas of the cargo area, wherein each projection area comprises a portion of the cargo area within the interior cavity, the imaging devices positioned such that the field of view of one or more of the imaging devices overlaps a field of view of at least one adjacent imaging device within at least one of the projection areas, each imaging device operable to generate an image corresponding to its field of view;
one or more computer processors that are operable to receive the images generated by the plurality of imaging devices and execute instructions for processing data associated with the images, the instructions including:
instructions for processing an overlapping distortion present in one or more of the images in which the field of view of one imaging device overlaps the field of view of an adjacent imaging device, wherein the overlapping distortion provides information regarding the presence of cargo within the projection area in which the fields of view overlap;
instructions for determining, based on the overlapping distortion, a number of the projection areas in which cargo is present; and
instructions for determining, based on the number of the projection areas in which cargo is present, a percent load value indicating a percentage of the cargo area of the interior cavity that contains cargo.

### Claim 2 (depends on 1)

The apparatus of claim 1 further comprising:
one or more of the plurality of imaging devices operable to generate a reference baseline image of the cargo area when there is no cargo present within the interior cavity of the cargo transport trailer; and
the one or more computer processors operable to receive the reference baseline image and execute instructions to compare the reference baseline image to images that were generated by the plurality of imaging devices subsequent to the generation of the reference baseline image, wherein the overlapping distortion is indicative of one or more differences between the reference baseline image and one or more of the subsequently generated images.

### Claim 3 (depends on 1)

The apparatus of claim 1 wherein the plurality of imaging devices comprise X number of imaging devices distributed along the length of the interior cavity of the cargo transport trailer, and the one or more projection areas comprise X+1 number of projection areas distributed along the length of the cargo area, wherein each projection area encompasses 100/x+1 percent of the length of the cargo area.

### Claim 4 (depends on 1)

The apparatus of claim 1 wherein the one or more computer processors are operable to execute instructions to activate the plurality of imaging devices to generate images of the cargo area upon an occurrence of a triggering event, wherein the triggering event comprises a trailer opening event, a trailer closing event, a motion detection event, a stopping event, a time based event, a geographic location based event, or a velocity based event.

### Claim 5 (depends on 1)

The apparatus of claim 1 wherein the one or more computer processors are operable to execute instructions to activate the plurality of imaging devices to generate images of the cargo area upon an occurrence of a geographic location based event related to a location of the cargo transport trailer as determined by a geographic positioning receiver.

### Claim 6 (depends on 1)

The apparatus of claim 1 further comprising a display device in electrical communication with the one or more computer processors for displaying at least the percent load value for viewing by an operator.

### Claim 7 (depends on 6)

The apparatus of claim 6 wherein the display device is disposed in a cab of a truck that pulls the cargo transport trailer and is viewable by an operator of the truck.

### Claim 8 (depends on 6)

The apparatus of claim 6 wherein the display device is connected to a dispatch server computer and is viewable by a dispatcher at a location that is remote from the cargo transport trailer.

### Claim 9 (depends on 1)

The apparatus of claim 1 wherein at least one of the one or more computer processors is disposed in or on the cargo transport trailer.

### Claim 10 (depends on 1)

The apparatus of claim 1 wherein at least one computer processor of the one or more computer processors is a component of a dispatch server computer disposed at a location that is remote from the cargo transport trailer.

### Claim 11 (depends on 10)

The apparatus of claim 10 wherein the at least one computer processor executes instructions to generate graphical information for simultaneously showing percent load values for multiple cargo transport trailers for display on a display device for viewing by a dispatcher.

### Claim 12

A method for monitoring a cargo area within an interior cavity of a cargo transport trailer, the method comprising:
(a) activating a plurality of imaging devices distributed along a length of the interior cavity of the cargo transport trailer to generate a plurality of images of a cargo area within the interior cavity, wherein each of the imaging devices has a field of view encompassing at least a portion of one or more projection areas of the cargo area, wherein each projection area comprises a portion of the cargo area within the interior cavity, wherein the imaging devices are positioned such that the field of view of one or more of the imaging devices overlaps a field of view of at least one adjacent imaging device within at least one of the projection areas;
(b) detecting an overlapping distortion present in one or more of the images in which the field of view of one imaging device overlaps the field of view of an adjacent imaging device, wherein the overlapping distortion provides information regarding the presence of cargo within the projection area in which the fields of view overlap;
(c) determining, based on the overlapping distortion, a number of the projection areas in which cargo is present; and
(d) determining, based on the number of the projection areas in which cargo is present, a percent load value indicating a percentage of the cargo area of the interior cavity that contains cargo.

### Claim 13 (depends on 12)

The method of claim 12 further comprising:
(e) prior to step (a), generating a reference baseline image of the cargo area when there is no cargo present within the interior cavity of the cargo transport trailer; and
(f) comparing the reference baseline image to one or more of the images generated in step (a), wherein the overlapping distortion is indicative of one or more differences between the reference baseline image and one or more of the images generated in step (a).

### Claim 14 (depends on 12)

The method of claim 12 wherein the plurality of images are generated using X number of imaging devices distributed along the length of the interior cavity of the cargo transport trailer, wherein the one or more projection areas comprise X+1 number of projection areas distributed along the length of the cargo area, wherein each projection area encompasses 100/x+1 percent of the length of the cargo area.

### Claim 15 (depends on 12)

The method of claim 12 wherein step (a) is initiated based on an occurrence of a triggering event, wherein the triggering event comprises a trailer opening event, a trailer closing event, a motion detection event, a stopping event, a time based event, a geographic location based event, or a velocity based event.

### Claim 16 (depends on 12)

The method of claim 12 wherein step (a) is initiated based on an occurrence of a geographic location based event related to a location of the cargo transport trailer as determined by a geographic positioning receiver.

### Claim 17 (depends on 12)

The method claim 12 further comprising providing at least the percent load value to a display device for viewing by an operator.

### Claim 18 (depends on 17)

The method of claim 17 wherein the display device is disposed in a cab of a truck that pulls the cargo transport trailer and is viewable by an operator of the truck.

### Claim 19 (depends on 17)

The method of claim 17 wherein the display device is connected to a dispatch server computer and is viewable by a dispatcher at a location that is remote from the cargo transport trailer.

### Claim 20 (depends on 19)

The method of claim 19 further comprising providing graphical information to the display device for simultaneously showing percent load values for multiple cargo transport trailers for viewing by the dispatcher.

### Claim 21 (depends on 12)

The method of claim 12 wherein one or more of steps (b), (c) and (d) are performed by one or more computer processors disposed in or on the cargo transport trailer.

### Claim 22 (depends on 12)

The method of claim 12 wherein one or more of steps (b), (c) and (d) are performed by one or more computer processors that are components of a dispatch server computer disposed at a location remote from the cargo transport trailer.
