Back to results
US 2022/0068264 A1Published application
Systems and methods for reducing latency in cloud services
AssigneeMicron Technology, Inc.
InventorAmeen D. Akel
Life of this patent
Estimating the term…
Abstract
Systems and methods for distributing cloud-based language processing services to partially execute in a local device to reduce latency perceived by the user. For example, a local device may receive a request via audio input, that requires a cloud-based service to process the request and generate a response. A partial response may be generated locally and played back while a more complete response is generated remotely.
Claims21
A system comprising:
- a processor of a client device;
- a memory configured to store a plurality of instructions, which, when executed, cause the processor to:
- encode an audio input signal received from a microphone, the audio input signal comprising a request;
- transmit the encoded audio input signal to a cloud service that is configured to generate a primary response;
- determine an initial response to the request, the initial response corresponding to a first audio clip;
- render the first audio clip for presentation prior to receiving the primary response, the primary response corresponding to a second audio clip;
- and
- append the second audio clip to follow the first audio clip, the second audio clip being presented after the presentation of the first audio clip.
5 more elements
A client device comprising:
- a memory configured to store a local application;
- and
- a processor coupled to the memory configured to execute the local application, the processor configured to;
- encode an input signal received at the client device, the input signal comprising a request;
- transmit the encoded input signal to a cloud service that is configured to generate a primary response;
- determine an initial response to the request, the initial response corresponding to a first audio clip;
- rendering the first audio clip for presentation;
- receive the primary response from the cloud server, the primary response corresponding to a second audio clip;
- append the second audio clip to the first audio clip during presentation of the first audio clip.
6 more elements
A method comprising:
- encoding, by a local device, an audio input signal received from a microphone coupled to the local device, the audio input signal comprising a request;
- transmitting, by the local device, the encoded audio input signal to a remote service that is configured to generate a primary response;
- generating, by the local device, an initial response to the request, the initial response corresponding to a first audio clip;
- rendering, by the local device, the first audio clip for presentation prior to receiving the primary response, the primary response corresponding to a second audio clip;
- and
- rendering, by the local device, the second audio clip for presentation to follow the presentation of the first audio clip.
3 more elements
Dependencies are inferred from the claim text.