# US 2016/0253576 A1 · Automatic identification of changes in objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253576 A1
- Document ID: US20160253576A1
- Status: Published application
- Kind: A1
- Application number: 14/633,217
- Filed: 2015-02-27
- Published: 2016-09-01
- Earliest claimed: 2015-02-27
- Assignees: Charter Communications Operating, LLC
- Applicants: Charter Communications Operating, LLC
- Inventors: THOMAS M. KILPATRICK
- Web page: https://patentgrep.com/patent/US20160253576A1

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/001: {using an image reference approach}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06T 2207/30236: Traffic on road, railway or crossing
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The specification and drawings present a new method, apparatus and software related product (e.g., a computer readable memory or a storage device) for automatic timely finding of deficiencies in objects such as automobiles, railcar, airplane tractor trailer, intermodal containers and the like, by automatically monitoring the object's appearance changes while they are moving in a course of normal operation using their camera pictures/images, e.g., during passing through a check point.

## Claims

### Claim 1

A method for automatically monitoring objects at a facility, comprising:
storing, via a computing device, baseline picture data comprising baseline pictures of each of a plurality of objects at the facility, the baseline picture data including a unique identification associated with a corresponding object;
receiving, from one or more cameras located at a check point of the facility and configured to take pictures of objects moving therethrough, further picture data comprising pictures of some objects of the plurality of objects taken automatically during movement of the some objects through the check point in a course of normal operation;
identifying on each taken picture the corresponding object and the unique identification associated with the corresponding object;
storing, via the computing device, the received further pictured data including the taken pictures and corresponding unique identification of the some objects;
comparing at least a latest picture of each object taken during each of one or more predefined time intervals with the corresponding stored baseline picture of the object; and
determining whether a difference between at least the latest picture of the each object and the corresponding stored baseline picture of the each object exceeds a corresponding threshold or a plurality of thresholds set for each of the one or more predefined time intervals: and
providing, in response to a determination that a threshold or plurality of thresholds has been exceeded, indication of a corresponding object which requires a corrective action or multiple correction actions.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The method of claim 1, wherein said one or more cameras comprise an array of cameras.

### Claim 4

(canceled)

### Claim 5 (depends on 1)

The method of claim 1, wherein the data and the received data are in a digital form.

### Claim 6 (depends on 1)

The method of claim 1, wherein the received data indicate for each picture a time the each picture is taken during the predefined time interval, so that the storing also includes storing a respectful time of taking a corresponding picture of the each object.

### Claim 7 (depends on 1)

The method of claim 1, wherein the object is a truck, an airplane, an automobile, a tractor trailer or an object carrying an intermodal container.

### Claim 8

(canceled)

### Claim 9 (depends on 1)

The method of claim 1, wherein the corrective action comprises one or more of:
washing the at least one object,
repairing the at least one object,
requiring about reporting of the accident involving the at least one object,
correcting addition or removal of an unauthorized feature or item from the at
least one object,
inflating a tire on the at least one object, and
installing proper locks on a container on the at least one object.

### Claim 10 (depends on 1)

The method of claim 1, wherein said indication is one or more of:
a report not requiring any action, a report requiring an action, a sound alarm requiring an immediate action and an urgent e-mail message requiring said immediate action or a further immediate action.

### Claim 11 (depends on 1)

The method of claim 1, wherein the unique identification is a license plate number, a barcode or a radio frequency identification (RFID).

### Claim 12 (depends on 1)

The method of claim 1, wherein the one or more predefined time intervals are one or more of: one hour, one day, one week and one month.

### Claim 13 (depends on 1)

The method of claim 1, wherein the plurality of objects is associated with a facility, so that each corresponding picture of the object is automatically taken while entering or exiting the facility.

### Claim 14 (depends on 1)

The method of claim 1, wherein the movement of the object in the normal course of operation comprises crossing the check point in any direction.

### Claim 15 (depends on 1)

The method of claim 1, wherein said comparing is performed every hour or every day for an accident indicator.

### Claim 16

(canceled)

### Claim 17

An apparatus comprising:
a processor;
a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:
logic to store baseline picture data comprising baseline pictures of each of a plurality of objects at the facility, the baseline picture data including a unique identification associated with a corresponding object;
logic to receive from one or more cameras located at a check point of the facility and configured to take pictures of objects moving therethrough, further picture data comprising pictures of some objects of the plurality of objects taken automatically during movement of the some objects through the check point in a course of normal operation;
logic to identify on each taken picture the corresponding object and the unique identification associated with the corresponding object;
logic to store the received further pictured data including the taken pictures and corresponding unique identification of the some objects;
logic to compare at least a latest picture of each object taken during each of one or more predefined time intervals with the corresponding stored baseline picture of the object;
logic to determine whether a difference between at least the latest picture of the each object and the corresponding stored baseline picture of the each object exceeds a corresponding threshold or a plurality of thresholds set for each of the one or more predefined time intervals: and
logic to provide in response to a determination that a threshold or plurality of thresholds has been exceeded, indication of a corresponding object which requires a corrective action or multiple correction actions.

### Claim 18

(canceled)

### Claim 19

A non-transitory computer readable storage medium tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining code for:
storing, via a computing device, baseline picture data comprising baseline pictures of each of a plurality of objects at the facility, the baseline picture data including a unique identification associated with a corresponding object;
receiving, from one or more cameras located at a check point of the facility and configured to take pictures of objects moving therethrough, further picture data comprising [[for ]]pictures of some objects of the plurality of objects taken automatically during movement of the some objects through the check point in a course of normal operation;
identifying on each taken picture the corresponding object and the unique identification associated with the corresponding object;
storing, via the computing device, the received further pictured data including the taken pictures and corresponding unique identification of the some objects;
comparing at least a latest picture of each object taken during each of one or more predefined time intervals with the corresponding stored baseline picture of the object; and
determining whether a difference between at least the latest picture of the each object and the corresponding stored baseline picture of the each object exceeds a corresponding threshold or a plurality of thresholds set for each of the one or more predefined time intervals: and
providing, in response to a determination that a threshold or plurality of thresholds has been exceeded, indication of a corresponding object which requires a corrective action or multiple correction actions.

### Claim 20

(canceled)
