Contextual voice search suggestions
AssigneeGoogle Inc.
InventorsVikram Aggarwal, Aparna Rajan Ramchandran
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus for receiving user input that invokes digital assistant functionality; obtaining screen data indicating content displayed on a screen of the computing device; determining a classification for an entity referenced in the content indicated by the screen data; determining a suggested request that refers to the entity based on the determined classification; and providing the suggested request in response to receiving the user input that invokes the digital assistant functionality.
Claims20
A method performed by one or more processors of a user device, the method comprising:
- receiving user input that invokes digital assistant functionality;
- obtaining context data indicating:
- displayed content that is displayed on a screen of the user device,
- off-screen information that comprises content that is not currently visible on the screen of the user device, but would be shown in a left, right, up, or down swiping, or scrolling view of the screen of the user device, and
- previous information relating to previous user interactions with the user device;
- generating, based on the context data including the displayed content, the off-screen information, and the previous information, a suggested query that refers to an entity in the displayed content;
- and
- providing the suggested query in response to receiving the user input that invokes the digital assistant functionality and before the user provides query terms following invocation of the digital assistant functionality.
A client device comprising:
- a screen;
- a memory storing instructions;
- and
- one or more processors operable to execute the instructions, stored in the memory, to:
- receive user input that invokes digital assistant functionality;
- obtain context data indicating:
- displayed content that is displayed on the screen,
- off-screen information that comprises content that is not currently visible on the screen, but would be shown in a left, right, up, or down swiping, or scrolling view of the screen, and
- previous information relating to previous user interactions with the client device;
- generate, based on the context data including the displayed content, the off-screen information, and the previous information, a suggested query that refers to an entity in the displayed content;
- and
- provide the suggested query in response to receiving the user input that invokes the digital assistant functionality and before the user provides query terms following invocation of the digital assistant functionality.
One or more non-transitory computer-readable storage media encoded with a software program, the program comprising instructions that, when executed by one or more computing devices, cause the one or more computing devices to execute instructions to:
- receive user input that invokes digital assistant functionality;
- obtain context data indicating:
- displayed content that is displayed on a screen of a user device,
- off-screen information that comprises content that is not currently visible on the screen of the user device, but would be shown in a left, right, up, or down swiping, or scrolling view of the screen of the user device, and
- previous information relating to previous user interactions with the user device;
- generate, based on the context data including the displayed content, the off-screen information, and the previous information, a suggested query that refers to an entity in the displayed content;
- and
- provide the suggested query in response to receiving the user input that invokes the digital assistant functionality and before the user provides query terms following invocation of the digital assistant functionality.
Dependencies are inferred from the claim text.