Query modification based on non-textual resource context
AssigneeGoogle Inc.
InventorsGokhan H. Bakir, Behshad Behzadi
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, modifying queries based on non-textual content. In one aspect, a method includes receiving, from a user device, a query including a plurality of terms; determining active non-textual data displayed in an application environment on the user device; determining, from the non-textual textual data, modification data for the query; generating a set of modified queries based on the query and the modification parameters; scoring the modified queries according to one or more scoring criteria; selecting one of the modified queries based on the scoring; and providing, to the user device, search results responsive to the selected modified query.
Claims18
A method implemented in a data processing apparatus, the method comprising:
- receiving, at a data processing apparatus including one or more hardware processors, a plurality of terms spoken by a user of a user device, the user device displaying a plurality of active non-textual data elements in an active window of an application environment when the user spoke the plurality of terms;
- determining, by the data processing apparatus, that the plurality of terms is an ambiguous query and that the user device is displaying the active non-textual data elements that were displayed when the plurality of terms were spoken by the user and in response:
- identifying, by the data processing apparatus, the active non-textual data displayed in the application environment on the user device;
- automatically determining, by the data processing apparatus, for each of the active non-textual data elements, modification data from the active non-textual data element for the query;
- automatically generating, by the data processing apparatus, for each modification data for each active non-textual data element, a set of modified queries based on the query and the modification data;
- automatically scoring, by the data processing apparatus, the modified queries according to one or more scoring criteria;
- automatically selecting, by the data processing apparatus, one of the modified queries based on the scoring;
- and
- providing, by the data processing apparatus, to the user device, search results responsive to the selected modified query.
A system, comprising:
- a data processing apparatus, including one or more hardware processors;
- and
- one or more data stores in communication with the data processing apparatus and storing instructions that upon execution causes the data processing apparatus to perform operations comprising:
- receiving, from a user device displaying a plurality of active non-textual data elements in an active window of an application environment, a plurality of terms spoken by a user of the user device when the user device was displaying the active window;
- determining, by the data processing apparatus, that the plurality of terms is an ambiguous query and that the user device is displaying the active non-textual data elements that were displayed when the plurality of terms were spoken by the user and in response:
- identifying, by the data processing apparatus, active non-textual data displayed in the application environment on the user device;
- automatically determining, by the data processing apparatus, for each of the active non-textual data elements, modification data from the active non-textual data element for the query;
- automatically generating, by the data processing apparatus, for each modification data for each active non-textual data element, a set of modified queries based on the query and the modification data;
- automatically scoring, by the data processing apparatus, the modified queries according to one or more scoring criteria;
- automatically selecting, by the data processing apparatus, one of the modified queries based on the scoring;
- and
- providing, by the data processing apparatus, to the user device, search results responsive to the selected modified query.
A non-transitory computer storage medium encoded with instructions that when executed by one or more data processing apparatus cause the one or more data processing apparatus to perform operations comprising:
- receiving, from a user device displaying a plurality of active non-textual data elements in an active window of an application environment, a plurality of terms spoken by a user of the user device when the user device was displaying the active window;
- determining, by the data processing apparatus, that the plurality of terms is an ambiguous query and that the user device is displaying the active non-textual data elements that were displayed when the plurality of terms were spoken by the user of the user and in response:
- identifying, by the data processing apparatus, the active non-textual data displayed in the application environment on the user device;
- automatically determining, by the data processing apparatus, for each of the active non-textual textual data elements, modification data from the active non-textual data element for the query;
- automatically generating, by the data processing apparatus, for each modification data for each active non-textual data element, a set of modified queries based on the query and the modification data;
- automatically scoring, by the data processing apparatus, the modified queries according to one or more scoring criteria;
- automatically selecting, by the data processing apparatus, one of the modified queries based on the scoring;
- and
- providing, by the data processing apparatus, to the user device, search results responsive to the selected modified query.
Dependencies are inferred from the claim text.