US 2026/0010273 A1Published application

Interactive gui elements for indicating objects to supplement requests for generative output

AssigneeGoogle Inc.

InventorsRamprasad Sedouram, Karthik Srinivas, Dharma Teja, Saachi Grover, Ajay Prasad

Life of this patent

Estimating the term…

Loading patent…

Abstract

Implementations set forth herein relate to a graphical user interface (GUI) element that can be manipulated at an interface to indicate a particular object and/or feature of interest to be considered when providing generative output for a separate user request. One or more GUI elements can be provided at a display interface, such as a touch display panel and/or virtual or augmented reality display interface, thereby allowing the GUI elements to be associated with rendered and/or tangible objects. When a user interacts with a GUI element, the GUI element can exhibit responsive behavior that is based on features of the interaction and/or other features of a particular object. When an object of interest is identified, processing can be performed to identify information about the object, and this information can then be utilized to facilitate provisioning of a generative output that is responsive to a separate user request.

Claims20

Dependent claims

A method implemented by one or more processors, the method comprising:

receiving a user input directed to causing a graphical user interface (GUI) element to relocate the GUI element relative to an object that is visible via a display interface of a computing device,
wherein the GUI element can be relocated at the display interface to be associated with a rendered or tangible object that is visible to a user who is viewing the display interface;
generating, in response to receiving the user input, object data for the object that is visible via the display interface,
wherein the object data characterizes an object feature of the object;
causing the GUI element to exhibit a change to an element feature for the GUI element based on the object data, and in response to the user input directed to the GUI element,
wherein the change to the element feature causes the GUI element to exhibit one or more features that are based on the object data;
receiving a natural language input directed to an automated assistant, and/or another application, that uses one or more generative models to provide generative output based on the natural language input;
causing, in response to receiving the natural language input, the one or more generative models to be employed for processing input data that is based on the natural language input and the object data;
and
causing the computing device, or a separate computing device, to render the generative output.

7 more elements

Dependencies are inferred from the claim text.