US 10,475,450 B1Granted

Multi-modality presentation and execution engine

AssigneeAmazon Technologies, Inc.

InventorsFelix Wu, Rohan Mutagi, Manuel Jesus Leon Rivas, Noel Evans, Frédéric Johan Georges Deramat, Miguel Alberdi Lorenzo, Lev Danielyan, Vikram Kumar Gundeti, Vijitha Raji

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

Techniques for synchronously outputting content by one or more devices are described. A system may receive a user command and may receive content responsive to the command from an application(s). The content may include various kinds of data (e.g., audio data, image data, video data, etc.). The system may also receive a presentation framework from the application, with the presentation framework indicating how content responsive to the input command should be synchronously output by one or more devices. The system determines one or more devices proximate to the user, determines which of the one or more devices may be used to output content indicated in the presentation framework, and causes the one or more devices to output content in a synchronous manner.

Claims23

Dependent claims

A computer-implemented method comprising:

receiving, from a first device associated with a user profile, input data corresponding to a command;
sending, to at least one remote device associated with the command, a signal requesting data responsive to the command;
receiving, from the at least one remote device, first data responsive to the command;
receiving, from the at least one remote device, presentation framework data including:
a first instruction indicating how and when a first portion of the first data is to be output, and
a second instruction indicating how and when a second portion of the first data to be output;
determining the first device is configured to output the first portion of the first data;
determining a second device associated with the user profile;
determining the second device is configured to output the second portion of the first data;
sending, to the first device, the first instruction and the first portion of the first data;
and
sending, to the second device, the second instruction and the second portion of the first data.

9 more elements

A system comprising:

at least one processor;
and
at least one memory including instructions that, when executed by the at least one processor, cause the system to:
receive, from a first device, input data corresponding to a command;
send, to at least one remote device associated with the command, a signal requesting data responsive to the command;
receive, from the at least one remote device, first data responsive to the command;
receive, from the at least one remote device, presentation framework data including:
a first instruction indicating how a first portion of the first data is to be output,
first trigger data indicating when the first portion of the first data is to be output,
a second instruction indicating how a second portion of the first data is to be output, and
second trigger data indicating when the second portion of the first data is to be output;
determine the first device is configured to output data corresponding to the first portion of the first data and the second portion of the first data;
and
send, to the first device, the presentation framework data and the first data.

11 more elements

A computer-implemented method comprising:

receiving, from a first device, input data corresponding to a command;
sending, to at least one remote device associated with the command, a signal requesting data responsive to the command;
receiving, from the at least one remote device, first data responsive to the command;
receiving, from the at least one remote device, presentation framework data including:
a first instruction indicating how a first portion of the first data is to be output,
first trigger data indicating when the first portion of first data is to be output,
a second instruction indicating how a second portion of the first data is to be output, and
second trigger data indicating when the second portion of the first data is to be output;
determining the first device is configured to output data corresponding to the first portion of the first data and the second portion of the first data;
and
sending, to the first device, the presentation framework data and the first data.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/696,829Filed 6 Sep 2017
Granted: 12 Nov 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

G06F 3/167
Sound input; Sound output: audio in a user interface, e.g. using voice commands for navigating, audio feedback
G10L 15/22
Speech recognition: procedures used during a speech recognition process, e.g. man-machine dialogue
G10L 15/1815
Using natural language modelling: semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
G10L 15/30
Constructional details of speech recognition systems: distributed recognition, e.g. in client-server systems, for mobile phones or network…