US 10,896,457 B2 · Synchronized audiovisual responses to user requests

Abstract

Systems and methods are disclosed related to presenting an interactive audiovisual presentation that provides a user with information regarding individual items matching a user's search request or other request that results in a set of items. The audiovisual content may be generated to include a summary of a subset of item attributes associated with the individual items, and may include both an audio summary and visual content that are presented in synchronization with each other based on markup information in a presentation file.

A system comprising:

computer-readable memory storing executable instructions;
and
one or more hardware processors in communication with the computer-readable memory and configured by the executable instructions to at least:
send, to a computing device over a network, an item search request received from a user, wherein the search request is received as a spoken utterance by the user;
receive, from the computing device over the network, supporting data associated with item search results for the item search request, wherein the supporting data includes ordinal numbering of individual items in the item search results, the ordinal numbering defining presentation order comprising at least a first item followed by a second item;
receive an audio file that includes speech content regarding at least an initial subset of the item search results;
identify, in the audio file, first markup information that includes a reference to a first object to be visually presented during playback of first speech content in the audio file, wherein the first speech content describes the first item in the item search results;
based on the first markup information, retrieve the first object from the supporting data, wherein the first object comprises an attribute or image associated with the first item;
cause synchronous audible presentation of the first speech content and visual presentation that includes the first object;
during audible presentation of second speech content associated with the first item, cause a first updated visual presentation that includes a second object associated with the first item, such that the first object and second object are simultaneously presented, wherein the second object is identified in second markup information of the audio file as associated with the second speech content;
cause a second updated visual presentation comprising presenting a zoom-out effect that results in visual display of at least the first object associated with the first item and a third object associated with the second item in the item search results, wherein the third object associated with the second item is presented in the second updated visual presentation with the first object associated with the first item based in part on the presentation order indicating that the second item follows the first item, wherein the zoom-out effect is automatically applied when presenting the second updated visual presentation based at least in part on display instructions including executable instructions previously stored by the computing device for use across a plurality of item search requests;
and
cause a third updated visual presentation comprising presenting a zoom-in effect that results in visual display of the third object without display of the first object, wherein the third updated visual presentation is visually presented during audible presentation of third speech content, wherein the third speech content relates to the second item and is identified in third markup information of the audio file as associated with the third object.

10 more elements

Synchronized audiovisual responses to user requests

Life of this patent

Synchronized audiovisual responses to user requests

Life of this patent

Abstract

Claims20