Method and system for fusion of fast surprise and motion-based saliency for finding objects of interest in dynamic scenes
AssigneeHRL Laboratories, LLC
InventorsDeepak Khosla, David J. Huber, Kyungnam Kim
Life of this patent
Estimating the term…
Abstract
Described is a system for object detection from dynamic visual imagery. Dynamic visual input obtained from a stationary sensor is processed by a surprise-based module. The surprise-based module detects a stationary object in a scene to generate surprise scores. The dynamic visual input is also processed by a motion-based saliency module which detects foreground in the scene to generate motion scores. The surprise scores and motion scores are fused into a single score, and the single score is used to determine the presence of an object of interest.
Claims18
A system for object detection from dynamic visual imagery, the system comprising:
- one or more processors and a non-transitory memory having instructions encoded thereon such that when the instructions are executed, the one or more processors perform operations of:
- receiving dynamic visual input obtained from a stationary sensor;
- processing the dynamic visual input by a surprise-based module, wherein the surprise-based module detects at least one stationary object in a scene to generate a plurality of surprise scores;
- processing the dynamic visual input by a motion-based saliency module, wherein the motion-based saliency module detects foreground in the scene to generate a plurality of motion scores;
- and
- fusing at least one of the plurality of surprise scores with at least one of the plurality of motion scores into a single score, wherein the single score is used to determine the presence of at least one object of interest in the dynamic visual input.
A computer-implemented method for object detection from dynamic visual imagery, comprising an act of causing a data processor to execute instructions stored on a non-transitory computer-readable medium such that upon execution, the data processor performs operations of:
- receiving dynamic visual input obtained from a stationary sensor;
- processing the dynamic visual input by a surprise-based module, wherein the surprise-based module detects at least one stationary object in a scene to generate a plurality of surprise scores;
- processing the dynamic visual input by a motion-based saliency module, wherein the motion-based saliency module detects foreground in the scene to generate a plurality of motion scores;
- and
- fusing at least one of the plurality of surprise scores with at least one of the plurality of motion scores into a single score, wherein the single score is used to determine the presence of at least one object of interest in the dynamic visual input.
A computer program product for object detection from dynamic visual imagery, the computer program product comprising:
- computer-readable instructions stored on a non-transitory computer-readable medium that are executable by a computer having a processor for causing the processor to perform operations of:
- receiving dynamic visual input obtained from a stationary sensor;
- processing the dynamic visual input by a surprise-based module, wherein the surprise-based module detects at least one stationary object in a scene to generate a plurality of surprise scores;
- processing the dynamic visual input by a motion-based saliency module, wherein the motion-based saliency module detects foreground in the scene to generate a plurality of motion scores;
- and
- fusing at least one of the plurality of surprise scores with at least one of the plurality of motion scores into a single score, wherein the single score is used to determine the presence of at least one object of interest in the dynamic visual input.
Dependencies are inferred from the claim text.