Sketch-based image retrieval using feedback and hierarchies

A computer program product stored on a computer readable storage medium, which when executed by a computing system, provides sketch-based retrieval, the program product comprising:

• program code for rendering an interface having a canvas for entering inputs including user generated strokes, and for extracting features associated with the inputs;
• program code for assigning an importance to the inputs;
• program code for retrieving matches from a database based on extracted features and importance associated with the extracted features;
• program code that provides real-time feedback on the canvas to suggest improved inputs for the user,
• wherein the interface includes a toolbar having a first actuatable button, and in response to actuation of the first actuatable button, the program code that provides real-time feedback prompts the user to highlight at least one of the entered inputs on the canvas,
• wherein the toolbar further includes a second actuatable button, and in response to actuation of the second actuatable button, the program code that provides real-time feedback suggests additional inputs to the canvas or corrective actions to the entered inputs on the canvas to enhance the retrieved matches from the database;
• and
• program code that ranks the retrieved matches and outputs the retrieved matches at the interface.

A computerized method of providing sketch-based retrieval, comprising:

• rendering an interface having a canvas for receiving inputs including user generated strokes, and for extracting features associated with the inputs;
• assigning an importance to the inputs;
• retrieving matches from a database based on extracted features and importance associated with the extracted features;
• providing real-time feedback on the canvas to suggest improved inputs for the user,
• wherein the interface includes a toolbar having a first actuatable button, and in response to actuation of the first actuatable button, the method further comprises prompting the user to highlight at least one of the entered inputs on the canvas,
• wherein the toolbar further includes a second actuatable button, and in response to actuation of the second actuatable button, the method further comprises suggesting additional inputs to the canvas or corrective actions to the entered inputs on the canvas to enhance the retrieved matches from the database;
• and
• ranking retrieved matches for output at the interface.