Mitigating people distractors in images
AssigneeAdobe Inc.
InventorsScott David Cohen, Zhihong Ding, Zhe Lin, Mingyang Ling, Luis Angel Figueroa
Life of this patent
Estimating the term…
Abstract
Systems, methods, and software are described herein for removing people distractors from images. A distractor mitigation solution implemented in one or more computing devices detects people in an image and identifies salient regions in the image. The solution then determines a saliency cue for each person and classifies each person as wanted or as an unwanted distractor based at least on the saliency cue. An unwanted person is then removed from the image or otherwise reduced from the perspective of being an unwanted distraction.
Claims20
A computer system comprising one or more processors and memory configured to provide computer program instructions to the one or more processors, the computer program instructions comprising:
- a salience module configured to direct the one or more processors to:
- generate a saliency map representing one or more salient regions of an image by applying a saliency filter at multiple scales, each pixel of the saliency map storing a saliency value that represents a measure of saliency of the pixel;
- and
- determine, based on the saliency value for each pixel in the saliency map corresponding to a detected person in the image, a salience cue representing an extent to which the detected person overlaps with the one or more salient regions;
- and
- a distractor mitigation module configured to direct the one or more processors to:
- classify the detected person as an unwanted distractor based on one or more cues comprising the salience cue for the detected person;
- and
- based on classifying the detected person as the unwanted distractor, trigger a recommendation to remove the detected person from one or more versions of the image.
A method comprising:
- generating a mask of a detected person in an image;
- generating a saliency map of an image by applying a saliency filter at multiple scales, each pixel of the saliency map storing a saliency value that represents a measure of saliency of the pixel;
- determining, based on the saliency value for each pixel in the saliency map that falls within the mask of the detected person, a salience cue representing an extent to which the detected person overlaps with the one or more salient regions;
- classifying the detected person as an unwanted distractor based on one or more cues comprising the salience cue for the detected person;
- and
- based on classifying the detected person as the unwanted distractor, triggering a recommendation to remove the detected person from one or more versions of the image.
One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:
- generating a mask of a detected person in an image;
- generating a saliency map representing one or more salient regions of an image by applying a saliency filter at multiple scales, each pixel of the saliency map storing a saliency value that represents a measure of saliency of the pixel;
- determining, based on the saliency value for each pixel in the saliency map corresponding to the mask of the detected person, a salience cue representing an extent to which the detected person overlaps with the one or more salient regions;
- classifying the detected person unwanted based on one or more cues comprising the salience cue for the detected person;
- and
- determining, based on classifying the detected person as unwanted, whether to trigger a recommendation to remove the detected person from one or more versions of the image.
Dependencies are inferred from the claim text.