Back to results
US 9,286,325 B2Granted
Methods and systems for ranking images using semantic and aesthetic models
AssigneeXerox Corporation
InventorsNaila Murray, Luca Marchesotti, Florent Perronnin
Life of this patent
Estimating the term…
Abstract
A method, a system, and a computer program product for extracting one or more images from a storage medium. A search model is selected based on the availability of a semantically related aesthetic model. A search model includes a generic aesthetic model if the semantically related aesthetic model for query is not available. A semantic score and an aesthetic score are computed based on the selected search model. The images are further ranked based on the semantic and aesthetic score.
Claims25
A method for extracting one or more images from a storage medium, the method comprising:
- determining a semantic class from a query based on a natural language processing technique;
- checking an availability of a semantically related aesthetic model for the determined semantic class, wherein the semantically related aesthetic model corresponds to an aesthetic model that is configured to compute an aesthetic score for a first image that is associated with a predetermined semantic class, and wherein the semantically related aesthetic model is unable to compute aesthetic score for a second image that is associated with a semantic class other than the predetermined semantic class;
- selecting a first search model or a second search model based on the availability of the semantically related aesthetic model, wherein the first search model comprises a semantic model and the semantically related aesthetic model, wherein the second search model comprises the semantic model and a generic aesthetic model, wherein the first search model is selected when the semantically related aesthetic model is available for the determined semantic class, and wherein the second search model is selected when the semantically related aesthetic model is unavailable for the determined semantic class;
- computing a semantic score and an aesthetic score for each of the one or more images based on the selected search model;
- and
- ranking the one or more images based on the semantic score and the aesthetic score.
3 more elements
A method for extracting one or more images from a storage medium, the method comprising:
- selecting a semantic model based on a semantic class determined from a query;
- checking an availability of a semantically related aesthetic model for the determined semantic class, wherein the semantically related aesthetic model corresponds to an aesthetic model that is configured to compute an aesthetic score for a first image that is associated with a predetermined semantic class, and wherein the semantically related aesthetic model is unable to compute aesthetic score for a second image that is associated with a semantic class other than the predetermined semantic class;
- selecting one of the semantically related aesthetic model or a generic aesthetic model based on the availability of the semantically related aesthetic model for the determined semantic class, wherein the semantically related aesthetic model is selected if available, and wherein the generic aesthetic model is selected when the semantically related aesthetic model is unavailable for the semantic class;
- computing a semantic score and an aesthetic score for each of the one or more images based on the semantic model and the selected aesthetic model, respectively;
- and
- ranking the one or more images based on the semantic score and the aesthetic score.
3 more elements
A system for extracting one or more images from a storage medium, the system comprising:
- a processor configured to:
- determine a semantic class from a query based on a natural language processing technique;
- check an availability of a semantically related aesthetic model for the determined semantic class determined from a query, wherein the semantically related aesthetic model corresponds to an aesthetic model that is configured to compute an aesthetic score for a first image that is associated with a predetermined semantic class, and wherein the semantically related aesthetic model is unable to compute aesthetic score for a second image that is associated with a semantic class other than the predetermined semantic class;
- select a first search model or a second search model based on the availability of the semantically related aesthetic model, wherein the first search model comprises a semantic model and the semantically related aesthetic model, wherein the second search model comprises the semantic model and a generic aesthetic model, wherein the first search model is selected when the semantically related aesthetic model is available for the determined semantic class, and wherein the second search model is selected when the semantically related aesthetic model is unavailable for the determined semantic class;
- compute a semantic score and an aesthetic score for each of the one or more images based on the selected search model;
- and
- rank the one or more images based on the semantic score and the aesthetic score.
4 more elements
A computer program product for use with a computer, the computer program product comprising a non-transitory computer-usable data carrier storing a computer readable program code embodied therein for extracting one or more images from a storage medium, the computer readable program code comprising:
- a program instruction means for determining a semantic class from a query based on a natural language processing technique;
- a program instruction means for checking an availability of a semantically related aesthetic model for the determined semantic class, wherein the semantically related aesthetic model corresponds to an aesthetic model that is configured to compute an aesthetic score for a first image that is associated with a predetermined semantic class, and wherein the semantically related aesthetic model is unable to compute aesthetic score for a second image that is associated with a semantic class other than the predetermined semantic class;
- a program instruction means for selecting a first search model or a second search model based on the availability of the semantically related aesthetic model, wherein the first search model comprises a semantic model and the semantically related aesthetic model, wherein the second search model comprises the semantic model and a generic aesthetic model, wherein the first search model is selected when the semantically related aesthetic model is available for the determined semantic class, and wherein the second search model is selected when the semantically related aesthetic model is unavailable for the determined semantic class;
- a program instruction means for computing a semantic score and an aesthetic score for each of the one or more images based on the selected search model;
- and
- a program instruction means for ranking the one or more images based on the semantic score and the aesthetic score.
3 more elements
Dependencies are inferred from the claim text.