Back to results
US 9,317,783 B2Granted
Clustering images
AssigneeHewlett-Packard Development Company, L.P.
InventorsWei Zhang, Tong Zhang, Daniel R. Tretter
Life of this patent
Estimating the term…
Abstract
A method and system for clustering images, comprising detecting faces in respective images to generate face data, generating a first cluster of images using the face data, the first cluster comprising images with a common face and representing a corresponding person, generating a second cluster of images using clothes data representing a set of clothing signatures, the second cluster comprising images with a common set of clothes, and using the first and second clusters to link an image of the person to the clusters in order to generate a third cluster for the person.
Claims12
A method for clustering images, comprising:
- detecting faces in respective images to generate face data;
- generating a first cluster of images using the face data, the first cluster comprising images with a common face and representing a corresponding person;
- generating a set of clothing signatures in which regions of the face data corresponding to the faces and hair are disregarded;
- generating a second cluster of images using clothes data representing the set of clothing signatures, the second cluster comprising images with a common set of clothes, the second cluster separately clustering the images as compared to the first cluster according to clothing worn by people in the images irrespective of the people wearing the clothing;
- and
- using the first and second clusters to link an image of the person to the clusters in order to generate a third cluster for the person,
- wherein a clothing signature is generated by:
- using the face data, defining respective facial regions for identified faces, and, on the basis of the facial regions, defining respective corresponding regions for hair and clothing;
- using image pixel data within the facial and hair regions, generating a measure of the skin and hair tones for the person;
- and
- using the measure to discard those regions of the image corresponding to skin and hair within the clothing region in order to provide a clothing mask representing a region of clothing for the person.
8 more elements
The method as claimed in claimed 3, further comprising:
- using the distance matrix, grouping clothes pieces into multiple clothing clusters using average-link hierarchical clustering.
An image processing system for clustering a set of images comprising:
- a processor;
- a non-transitory computer-readable medium storing computer code executable by the processor to:
- detect faces in respective images in the set to generate face data;
- generate a first cluster of images using the face data, the first cluster comprising images with a common face and representing a corresponding person;
- generate a set of clothing signatures in which regions of the face data corresponding to the faces and hair are disregarded;
- generate a second cluster of images using clothes data representing the set of clothing signatures, the second cluster comprising images with a common set of clothes, the second cluster separately clustering the images as compared to the first cluster according to clothing worn by people in the images irrespective of the people wearing the clothing;
- and
- use the first and second clusters to link an image of the person to the clusters in order to generate a third cluster for the person,
- wherein a clothing signature is generated by:
- using the face data defining respective facial regions for identified faces, and, on the basis of the facial regions, defining respective corresponding regions for hair and clothing;
- using image pixel data within the facial and hair regions, generating a measure of the skin and hair tones for the person;
- and
- using the measure to discard those regions of the image corresponding to skin and hair within the clothing region in order to provide a clothing mask representing a region of clothing for the person.
10 more elements
A non-transitory computer-readable data storage medium storing computer-executable code executable by a processor to perform a method comprising:
- detecting faces in respective images to generate face data;
- generating a first cluster of images using the face data, the first cluster comprising images with a common face and representing a corresponding person;
- generating a second cluster of images using clothes data representing a set of clothing signatures, the second cluster comprising images with a common set of clothes, the second cluster separately clustering the images as compared to the first cluster according to clothing worn by people in the images irrespective of the people wearing the clothing;
- and
- using the first and second clusters to link an image of the person to the clusters in order to generate a third cluster for the person,
- wherein a clothing signature is generated by:
- using the face data, defining respective facial regions for identified faces, and, on the basis of the facial regions, defining respective corresponding regions for hair and clothing;
- using image pixel data within the facial and hair regions, generating a measure of the skin and hair tones for the person;
- and
- using the measure to discard those regions of the image corresponding to skin and hair within the clothing region in order to provide a clothing mask representing a region of clothing for the person.
7 more elements
Dependencies are inferred from the claim text.