Orientation-based subject-matching in images
AssigneeHuawei Technologies Co., Ltd.
InventorShane Anthony Bergsma
Life of this patent
Estimating the term…
Abstract
A system and method for subject-matching in images comprises detecting a first orientation of a first subject in a target image; comparing the first orientation with a second orientation of a second subject in a source image to obtain at least one orientation parameter; extracting at least one features from the target image; computing a visual similarity score between the target image and the source image using the features, the visual similarity score being computed as a function of the at least one feature and the at least one orientation parameter; and determining a match between the first subject and the second subject in accordance with the visual similarity score.
Claims19
A computer-implemented method for subject-matching in images, the method comprising:
- detecting, by a processor, a first orientation of a first subject in a target image using at least two angles, the at least two angles comprising a first angle α, in a horizontal plane, between a facing direction of the first subject and a viewing axis of an image acquisition device having acquired the target image, and a second angle β, in a vertical plane, between the viewing axis of the image acquisition device and a horizontal axis, the first orientation indicative of the facing direction of the first subject relative to the image acquisition device;
- comparing, by the processor, the first orientation of the first subject with a second orientation of a second subject in a source image to obtain an orientation parameter indicative of a relative orientation of the first subject in the target image to the second subject in the source image;
- extracting, by the processor, one or more features from the target image;
- computing, by the processor, a visual similarity score between the target image and the source image as a function of the one or more features extracted from the target image and weights assigned to the one or more features extracted from the target image as a function of the orientation parameter;
- and
- determining, by the processor, a match between the first subject and the second subject in accordance with the visual similarity score.
A system comprising:
- a memory having stored therein a program comprising instructions for subject-matching in images;
- and
- at least one processor coupled to the memory for executing the instructions for:
- detecting a first orientation of a first subject in a target image using at least two angles, the at least two angles comprising a first angle α, in a horizontal plane, between a facing direction of the first subject and a viewing axis of an image acquisition device having acquired the target image, and a second angle β, in a vertical plane, between the viewing axis of the image acquisition device and a horizontal axis, the first orientation indicative of the facing direction of the first subject relative to the image acquisition device;
- comparing the first orientation of the first subject with a second orientation of a second subject in a source image to obtain an orientation parameter indicative of a relative orientation of the first subject in the target image to the second subject in the source image;
- extracting one or more features from the target image;
- computing a visual similarity score between the target image and the source image as a function of the one or more features extracted from the target image and weights assigned to the one or more features extracted from the target image as a function of the orientation parameter;
- determining a match between the first subject and the second subject in accordance with the visual similarity score.
A non-transitory computer readable medium or media having stored thereon computer readable instructions which when executed by at least one processor, cause the at least one processor to:
- detect a first orientation of a first subject in a target image using at least two angles, the at least two angles comprising a first angle α, in a horizontal plane, between a facing direction of the first subject and a viewing axis of an image acquisition device having acquired the target image, and a second angle β, in a vertical plane, between the viewing axis of the image acquisition device and a horizontal axis, the first orientation indicative of the facing direction of the first subject relative to the image acquisition device;
- compare the first orientation of the first subject with a second orientation of a second subject in a source image to obtain an orientation parameter indicative of a relative orientation of the first subject in the target image to the second subject in the source image;
- extract one or more features from the target image;
- compute a visual similarity score between the target image and the source image as a function of the one or more features and weights assigned to the one or more features extracted from the target image as a function of the orientation parameter;
- and
- determine a match between the first subject and the second subject in accordance with the visual similarity score.
Dependencies are inferred from the claim text.