Back to results
US 9,002,835 B2Granted
Query response using media consumption history
AssigneeGoogle Inc.
InventorMatthew Sharifi
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus for receiving a natural language query of a user, and environmental data, identifying a media item based on the environmental data, determining an entity type based on the natural language query, selecting an entity associated with the media item that matches the entity type, selecting, from a media consumption database that identifies media items that have been indicated as consumed by the user, one or more media items that have been indicated as consumed by the user and that are associated with the selected entity, and providing a response to the query based on selecting the one or more media items that have been indicated as consumed by the user and that are associated with the selected entity.
Claims20
A computer-implemented method comprising:
- receiving (i) environmental audio data, and (ii) a natural language query from a user that requests identification of a media item that has previously been consumed by the user, wherein the natural language query includes one or more terms that reference an entity type of an entity associated with the environmental audio data, and does not include one or more terms that uniquely identify the entity associated with the environmental audio data;
- identifying a particular media item that includes one or more acoustic features that match one or more corresponding acoustic features of the environmental audio data;
- identifying, as the entity associated with the environmental audio data, a particular entity (i) that matches the entity type and (ii) that is associated with the particular media item;
- selecting, from a media consumption database that identifies media items that are identified as having been previously consumed by the user, one or more previously consumed media items that are identified as having been previously consumed by the user and that are associated with the entity associated with the environmental audio data;
- and
- providing a response to the natural language query that identifies one or more of the previously consumed media items, based on selecting the one or more previously consumed media items that are identified as having been previously consumed by the user and that are associated with the entity associated with the environmental audio data.
3 more elements
A system comprising:
- one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
- receiving (i) environmental audio data, and (ii) a natural language query from a user that requests identification of a media item that has previously been consumed by the user, wherein the natural language query includes one or more terms that reference an entity type of an entity associated with the environmental audio data, and does not include one or more terms that uniquely identify the entity associated with the environmental audio data;
- identifying a particular media item that includes one or more acoustic features that match one or more corresponding acoustic features of the environmental audio data;
- identifying, as the entity associated with the environmental audio data, a particular entity (i) that matches the entity type and (ii) that is associated with the particular media item;
- selecting, from a media consumption database that identifies media items that are identified as having been previously consumed by the user, one or more previously consumed media items that are identified as having been previously consumed by the user and that are associated with the entity associated with the environmental audio data;
- and
- providing a response to the natural language query that identifies one or more of the previously consumed media items, based on selecting the one or more previously consumed media items that are identified as having been previously consumed by the user and that are associated with the entity associated with the environmental audio data.
4 more elements
A computer-readable storage device encoded with a computer program, the program comprising instructions that, if executed by one or more computers, cause the one or more computers to perform operations comprising:
- receiving (i) environmental audio data, and (ii) a natural language query from a user that requests identification of a media item that has previously been consumed by the user, wherein the natural language query includes one or more terms that reference an entity type of an entity associated with the environmental audio data, and does not include one or more terms that uniquely identify the entity associated with the environmental audio data;
- identifying a particular media item that includes one or more acoustic features that match one or more corresponding acoustic features of the environmental audio data;
- identifying, as the entity associated with the environmental audio data, a particular entity (i) that matches the entity type and (ii) that is associated with the particular media item;
- selecting, from a media consumption database that identifies media items that are identified as having been previously consumed by the user, one or more previously consumed media items that are identified as having been previously consumed by the user and that are associated with the entity associated with the environmental audio data;
- and
- providing a response to the natural language query that identifies one or more of the previously consumed media items, based on selecting the one or more previously consumed media items that are identified as having been previously consumed by the user and that are associated with the entity associated with the environmental audio data.
3 more elements
Dependencies are inferred from the claim text.