Hand-drawn sketch recognition
AssigneeMicrosoft Technology Licensing, LLC
InventorsChanghu Wang, Lei Zhang, Zhenbang Sun
Life of this patent
Estimating the term…
Abstract
Some examples of a sketch-based image recognition system may generate a model for identifying a subject of a sketch. The model is formed from a plurality of images having visual features similar to the visual features of the sketch. The model may include object topics representative of categories which may correspond to the subject of the sketch and shape topics representative of the visual features of the sketch.
Claims20
A method comprising:
- receiving, from a computing device over a network, a sketch;
- searching a database of images using the sketch as a query to identify a set of images, an individual image of the set of images including a shape feature similar to at least one shape feature of the sketch;
- determining, based at least in part on the set of images, at least one object topic;
- and
- generating, based at least in part on the set of images, a model for identifying a subject of the sketch, the model including:
- the at least one object topic, the at least one object topic being representative of a category that is descriptive of the subject of the sketch;
- and
- at least one shape topic associated with the at least one object topic, the at least one shape topic representative of a shape feature of the sketch.
A computing device comprising:
- one or more input interfaces for receiving a sketch;
- one or more processors;
- and
- a computer-readable storage media storing instructions, which when executed by the one or more processors, cause the one or more processors to perform operations comprising:
- performing an image-based search of a database of images using the sketch as a search query;
- identifying a set of images, an individual image of the set of images including a shape feature similar to a shape feature of the sketch;
- determining an object topic based at least in part on the set of images;
- and
- generating, based at least in part on the set of images, a model for identifying a subject associated with the sketch, the model including:
- the object topic, the object topic representative of a category for the subject that is associated with the sketch;
- and
- a shape topic associated with the object topic, the shape topic representative of the shape feature of the sketch.
A computer-readable storage media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
- searching a database of images using a sketch as a query to identify a set of images, an individual image of the set of images including a shape feature similar to at least one shape feature of the sketch;
- determining, based at least in part on the set of images, at least one object topic;
- and
- generating, based at least in part on the set of images, a model for identifying a subject of the sketch, the model including:
- the at least one object topic, the at least one object topic being representative of a category that is descriptive of the subject of the sketch;
- and
- at least one shape topic associated with the at least one object topic, the at least one shape topic representative of a shape feature of the sketch.
Dependencies are inferred from the claim text.