Dynamic adaptation of device interfaces in a voice-based system
AssigneeGoogle Inc.
InventorJian Wei Leong
Life of this patent
Estimating the term…
Abstract
Implementations relate to dynamic adaptation of images for projection by a projector, based on one or more properties of user(s) that are in an environment with the projector. The projector can be associated with an automated assistant client of a client device. In some versions of those implementations, a pose of a user in the environment is determined and, based on the pose, a base image for projecting onto a surface is warped to generate a transformed image. The transformed image, when projected onto a surface and viewed from the pose of the user, mitigates perceived differences relative to the base image.
Claims21
-20. (canceled)
A system to generate interfaces in an audio-based networked system, comprising:
- a computing device comprising one or more processors and a memory, the one or more processors configured to execute:
- a natural language processor to:
- receive an input audio signal detected by a sensor at a client device;
- parse input audio signal to identify a first request in the input audio signal and a keyword associated with the first request;
- a content selector component to:
- select a first base digital component based on at least the first digital component request;
- select a second base digital component based on at least the keyword associated with the first digital component request;
- and
- a transformation component to:
- determine a distance between the client device and a projection surface;
- determine, based on the distance between the client device and the projection surface, transformation parameters for the first base digital component and the second base digital component, the transformation parameters configured to correct a skew of images projected onto the projection surface;
- generate a first transformed image based at least on the transformation parameters and the first base digital component and a second transformed image based at least on the transformation parameters and the second digital component;
- and
- transmit the first transformed image and the second transformed image to the client device for projection onto the projection surface.
A method to generate interfaces in an audio-based networked system, comprising:
- receiving, by a natural language processor executed by one or more processors of a computing device, an input audio signal detected by a sensor at a client device;
- parsing, by the natural language processor, the input audio signal to identify a first request in the input audio signal and a keyword associated with the first request;
- selecting, by a content selector component of the computing device, a first base digital component based on at least the first digital component request;
- selecting, by the content selector component, a second base digital component based on at least the keyword associated with the first digital component request;
- determining, by a transformation component executed by the one or more processors of the computing device and based on sensor data from the client device, a distance between the client device and a projection surface;
- determining, by the transformation component, based on the distance between the client device and the projection surface, transformation parameters for the first base digital component and the second base digital component, the transformation parameters configured to correct a skew of images projected onto the projection surface;
- generating, by the transformation component, a first transformed image based at least on the transformation parameters and the first base digital component and a second transformed image based at least on the transformation parameters and the second digital component;
- and
- transmitting, by the transformation component, the first transformed image and the second transformed image to the client device for projection onto the projection surface.
Dependencies are inferred from the claim text.