Temporal saliency map
AssigneeQUALCOMM Incorporated
InventorsXin Zhong, Yu Sun, Dashan Gao
Life of this patent
Estimating the term…
Abstract
A method of generating a temporal saliency map is disclosed. In a particular embodiment, the method includes receiving an object bounding box from an object tracker. The method includes cropping a video frame based at least in part on the object bounding box to generate a cropped image. The method further includes performing spatial dual segmentation on the cropped image to generate an initial mask and performing temporal mask refinement on the initial mask to generate a refined mask. The method also includes generating a temporal saliency map based at least in part on the refined mask.
Claims30
A method comprising:
- receiving information associated with an object bounding box from an object tracker;
- cropping a video frame based at least in part on the object bounding box to generate a cropped image;
- performing, at a processor, spatial dual-layer segmentation on the cropped image to generate an initial mask;
- performing, at the processor, temporal mask refinement on the initial mask to generate a refined mask;
- and
- generating a temporal saliency map based at least in part on the refined mask.
An apparatus comprising:
- a processor;
- an object tracker component executable by the processor to generate information associated with an object bounding box;
- a frame cropping component executable by the processor to crop a video frame based at least in part on the information associated with the object bounding box to generate a cropped image;
- a segmentation component executable by the processor to perform spatial multiple-layer segmentation on the cropped image to generate an initial mask;
- a mask refinement component executable by the processor to perform temporal mask refinement on the initial mask to generate a refined mask;
- and
- a temporal saliency map generation component executable by the processor to generate a temporal saliency map based at least in part on the refined mask.
A method comprising:
- receiving information associated with an object bounding box from an object tracker;
- performing, at a processor, spatial dual-layer segmentation on a portion of a video frame to generate an initial mask, wherein a boundary of the portion of the video frame is determined based at least in part on the information associated with the object bounding box;
- performing, at the processor, temporal mask refinement on the initial mask to generate a refined mask;
- generating a temporal saliency map based at least in part on the refined mask;
- and
- providing the temporal saliency map as feedback to the object tracker.
An apparatus comprising:
- a processor;
- an object tracker component executable by the processor to generate information associated with an object bounding box;
- a segmentation component executable by the processor to perform spatial dual-layer segmentation on a portion of a video frame to generate an initial mask, wherein a boundary of the portion of the video frame is determined based at least in part on the information associated with the object bounding box;
- a mask refinement component executable by the processor to perform temporal mask refinement on the initial mask to generate a refined mask;
- and
- a temporal saliency map generation component executable by the processor to:
- generate a temporal saliency map based at least in part on the refined mask;
- and
- provide the temporal saliency map as feedback to the object tracker component.
Dependencies are inferred from the claim text.