Voice directed context sensitive visual search
AssigneeMicrosoft Corporation
InventorsMonty Lee Hammontree, Vikram Bapat, Emmanuel John Athans
Life of this patent
Estimating the term…
Abstract
Various technologies described herein pertain to voice directed context sensitive visual searching. Visual content can be rendered on a display, and a voice directed query related to the visual content can be received. Contextual information related to the visual content can also be identified. Moreover, a search word recognized from the voice directed query and/or the contextual information can be used to detect an object from the visual content, where the object can be a part of the visual content. Further, a search can be performed using the object detected from the visual content, and a result of the search can be rendered on the display.
Claims22
A method of searching, comprising:
- receiving a voice directed query related to visual content rendered on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image;
- identifying contextual information pertaining to the visual content rendered on the display;
- causing a processor to detect an object from the visual content based on at least one of a search word from the voice directed query or the contextual information, wherein the object is a part of the visual content;
- performing a search using the object detected from the visual content;
- and
- rendering a result of the search on the display.
(canceled)
A system that performs a visual search, comprising:
- a processor;
- and
- a memory that comprises a plurality of components that are executed by the processor, the plurality of components comprising:
- a context identification component that recognizes contextual information related to at least one of visual content rendered on a display or a voice directed query related to the visual content, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image;
- an object detection component that detects an object from the visual content based on one or more of a search word recognized from the voice directed query or the contextual information, wherein the object is part of the visual content;
- and
- a search component that performs a search using the object detected from the visual content to generate a result.
(canceled)
A computer-readable storage medium including computer-executable instructions that, when executed by a processor, cause the processor to perform acts including:
- rendering visual content on a display, wherein the visual content is one of a frame from a video stream, a two-dimensional image, or a three-dimensional image;
- receiving a voice directed query related to the visual content rendered on the display, wherein the voice directed query comprises at least a search word;
- recognizing contextual information related to the visual content rendered on the display;
- performing a first search using at least one of the search word from the voice directed query or the contextual information;
- detecting an object from the visual content as a function of a first result of the first search, wherein the object is a part of the visual content;
- performing a second search using the object detected from the visual content;
- and
- rendering a second result of the second search on the display.
Dependencies are inferred from the claim text.