# US 12,770,289 B1 · Detection and tracking of low signal-to-noise ratio moving targets in remote sensing imagery

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,770,289 B1
- Document ID: US12770289B1
- Status: Granted
- Kind: B1
- Application number: 18/103,661
- Filed: 2023-01-31
- Granted: 2026-10-20
- Earliest claimed: 2023-01-31
- Assignees: National Technology & Engineering Solutions of Sandia, LLC
- Applicants: National Technology & Engineering Solutions of Sandia, LLC
- Inventors: Daniel Paul Barrett
- Web page: https://patentgrep.com/patent/US12770289B1

## CPC

- G06T 7/74: {involving reference images or patches}
- G06T 7/254: involving subtraction of images
- G06T 2207/20224: Image subtraction
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for detecting and tracking objects in low signal-to-noise ratio (SNR) remote sensing imagery includes receiving a sequence of images depicting a scene over time. A set of velocity-state images representative of possible positions and velocities of objects is computed for each time at which an image was received. When a current image is received after a prior image, the current set of velocity-state images is computed based on the current image and the set of velocity-state images corresponding to the prior time. The likely presence of a moving object in the scene is determined based upon pixel values of the velocity-state images.

## Claims

### Claim 1

A system comprising:
at least one of a processor or a hardware logic component configured to perform acts comprising:
obtaining a sequence of images each depicting a scene at a different respective time;
computing, based upon the sequence of images, a first set of velocity-state images, wherein the set of velocity-state images corresponds to a first time, wherein pixels of the velocity-state images collectively represent position and velocity states that objects in the scene may take, wherein pixel values of the pixels are indicative of the presence of objects at locations in the scene at the first time;
obtaining a second set of velocity-state images, wherein the second set of velocity-state images corresponds to a second time prior to the first time and wherein the pixel values of the first set of velocity-state images are based upon the second set of velocity-state images and a first image in the sequence of images that depicts the scene at the first time
determining, based upon the set of velocity-state images, that an object is likely present at a first location in the scene at the first time; and
outputting an indication of the presence of the object at the first location in the scene at the first time to a device comprising one of hardware or software or a combination thereof,
wherein the first set of velocity-state images comprises a first velocity-state image, the first velocity-state image including a first pixel that is representative of the first location in the scene and that has a first pixel value, the first image in the sequence of images including a second pixel that is representative of the first location in the scene and that has a second pixel value, wherein the first pixel value is based upon the second pixel value.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
a memory that is operably coupled to the processor and that stores instructions that, when executed by the processor, cause the processor to perform the acts.

### Claim 3 (depends on 1)

The system of claim 1, wherein obtaining the sequence of images comprises:
receiving a remote sensing image that is representative of the scene at the first time; and
generating a second image by executing, over the remote sensing image, an algorithm configured to increase a difference between pixel values of first pixels that are representative of objects and pixel values of second pixels that are representative of background clutter.

### Claim 4 (depends on 1)

The system of claim 1, wherein the first set of velocity-state images comprises a first velocity-state image, the first velocity-state image including a first pixel that is representative of a first position and that has a first pixel value, wherein the second set of velocity-state images comprises a second velocity-state image that includes a third pixel that is representative of a second position and that has a second pixel value, wherein the first pixel value is based upon the second pixel value, and wherein the second position is a position at which an object present at the second time could transition into the first position at the first time if the object present at the second time were traveling according to a state machine model of possible positions, velocities, and allowed acceleration transitions.

### Claim 5 (depends on 4)

The system of claim 4, wherein the first pixel is associated with a first velocity and the third pixel is associated with a second velocity, wherein the second velocity is a velocity at which an object present at the second time could transition to the first velocity at the first time if it were traveling according to the state machine model of possible positions, velocities, and allowed acceleration transitions.

### Claim 6 (depends on 1)

The system of claim 1, wherein determining that the object is present at the first location in the scene at the first time comprises:
executing a background suppression algorithm over each of the velocity-state images to generate a plurality of velocity-state difference images; and
determining, based upon the velocity-state difference images, that the object is likely present at the first location in the scene at the first time.

### Claim 7 (depends on 1)

The system of claim 1, the acts further comprising:
identifying a track of the object that indicates estimated positions of the object over time, the estimated positions including the first location in the scene, wherein the indication of the presence of the object includes an indication of the track.

### Claim 8 (depends on 1)

The system of claim 1, the acts further comprising:
identifying a track of the object that indicates estimated positions of the object over time, the estimated positions including the first location in the scene;
computing a track-specific set of velocity-state images that represent a constrained region about the estimated positions of the object over time; and
outputting an indication of a location of the object within the constrained region based upon the track-specific set of velocity-state images.

### Claim 9

A system comprising:
at least one of a processor or a hardware logic component configured to perform acts comprising:
obtaining a sequence of images each depicting a scene at a different respective time;
computing, based upon the sequence of images, a set of velocity-state images, wherein the set of velocity-state images corresponds to a first time, wherein pixels of the velocity-state images collectively represent position and velocity states that objects in the scene may take, wherein pixel values of the pixels are indicative of the presence of objects at locations in the scene at the first time;
identifying a track of the object that indicates estimated positions of the object over time and a predicted position of the object at a future time;
receiving an update to the track indicating that the object is estimated to be at a first estimated position at the future time;
computing at least one of a position frame-of-reference (FOR) shift or a velocity FOR shift based upon a difference between the first estimated position and the predicted position; and computing a track-specific set of velocity-state images within a constrained region centered about the track based upon the at least one of the position FOR shift or the velocity FOR shift;
determining, based upon the set of velocity-state images, that an object is likely present at a first location in the scene at the first time; and
outputting an indication of the presence of the object at the first location in the scene at the first time to a device comprising one of hardware or software or a combination thereof.

### Claim 10 (depends on 1)

The system of claim 1, the acts further comprising:
scaling pixels of a first image in the sequence of images according to a scaling function, wherein the scaling function is configured to reduce a pixel value of a first pixel in the first image based upon the pixel value.

### Claim 11 (depends on 1)

The system of claim 1, wherein the set of velocity-state images is a second set of velocity-state images, wherein computing the second set of velocity-state images comprises:
computing, based upon the sequence of images, a first set of velocity-state images corresponding to the first time; and
generating the second set of velocity-state images by scaling pixels of the first set of velocity-state images according to a scaling function that is configured to reduce a pixel value of a first pixel of the first set of velocity-state images based upon the pixel value.

### Claim 12 (depends on 1)

The system of claim 1, wherein determining, based upon the set of velocity-state images, that the object is likely present at the first location in the scene at the first time comprises:
generating a signal-to-noise-ratio (SNR)-enhanced image based on the velocity-state images, wherein a pixel value of a first pixel of the SNR-enhanced image that represents the first location is based upon pixels in the velocity-state images that correspond to the same first location; and
determining that the object is likely present at the first location in the scene based upon the pixel value of the first pixel of the SNR-enhanced image.

### Claim 13

A method comprising:
receiving a plurality of images that each depict a scene at a different respective time;
generating, from the received images, a set of velocity-state images, wherein pixels of the velocity-state images collectively represent position and velocity states that objects in the scene may take, wherein pixel values of the pixels of the velocity-state images are indicative of the presence of objects at locations in the scene at a first time;
determining, based upon the set of velocity-state images, that an object is likely present at a first location in the scene at the first time; and
outputting an indication of the presence of the object at the first location in the scene at the first time to a device comprising one of hardware or software or a combination thereof; and
wherein the plurality of images are received as a stream of images over time and responsive to receiving an additional image in the stream of images, generating an additional set of velocity-state images, wherein the additional set of velocity-state images is generated based upon a prior set of velocity-state images, the prior set of velocity-state images generated in response to receipt of a prior image that precedes the additional image in the stream of images.

### Claim 14 (depends on 13)

The method of claim 13, wherein pixel values of the additional set of velocity-state images are based upon pixel values of the prior set of velocity-state images and pixel values of the additional image.

### Claim 15 (depends on 13)

The method of claim 13, wherein pixel values of the additional set of velocity-state images are based upon pixel values of a plurality of sets of velocity-state images, each of the plurality of sets of velocity-state images generated in response to receipt of a respective image in the stream of images.

### Claim 16 (depends on 15)

The method of claim 15, wherein further the pixel values of the additional set of velocity-state images are based upon a forgetting factor.
