Image annotation
AssigneeMicrosoft Technology Licensing, LLC
InventorsYokesh KUMAR, Kuang-Huei LEE, Houdong HU, Li HUANG, Arun SACHETI, Meenaz MERCHANT, Linjun YANG, Tianjun XIAO, Saurajit MUKHERJEE
Life of this patent
Estimating the term…
Abstract
The description relates to diversified hybrid image annotation for annotating images. One implementation includes generating first image annotations for a query image using a retrieval-based image annotation technique. Second image annotations can be generated for the query image using a model-based image annotation technique. The first and second image annotations can be integrated to generate a diversified hybrid image annotation result for the query image.
Claims20
A system, comprising:
- a processor;
- and
- storage storing computer-readable instructions which, when executed by the processor, cause the processor to:
- receive a selection of a query image,
- generate first image annotations for the query image by:
- retrieving similar images to the query image,
- obtaining textual metadata for the similar images, and
- constructing a vocabulary from the textual metadata for the first image annotations,
- generate second image annotations for the query image using a model-based image annotation technique,
- integrate and rank the first and second image annotations to generate a diversified hybrid image annotation result for the query image, and
- output the diversified hybrid image annotation result in association with the query image.
A method implemented by one or more computing devices, the method comprising:
- receiving a query image;
- generating first image annotations for the query image using a retrieval-based image annotation technique;
- generating second image annotations for the query image using a model-based image annotation technique;
- integrating the first and second image annotations to generate diversified hybrid image annotations for the query image;
- and
- outputting the diversified hybrid image annotations.
A system, comprising:
- a processor;
- and
- storage storing computer-readable instructions which, when executed by the processor, cause the processor to:
- receive a selection of a query image,
- generate first image annotations for the query image using a retrieval-based image annotation technique;
- generate second image annotations for the query image using a model-based image annotation technique;
- integrate and rank the first and second image annotations to generate diversified hybrid image annotations;
- and
- cause the diversified hybrid image annotations to be displayed with the query image.
Dependencies are inferred from the claim text.