# US 2026/0038501 A1 · Generating and/or causing rendering of video playback-based assistant suggestion(s) that link to other application(s) > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0038501 A1 - Document ID: US20260038501A1 - Status: Published application - Kind: A1 - Application number: 19/350,761 - Filed: 2025-10-06 - Published: 2026-02-05 - Earliest claimed: 2022-08-18 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Wendy Look; Evgeny Cherepanov; Olga Kapralova; Dan Vallejo; Mikhail Reutov - Web page: https://patentgrep.com/patent/US20260038501A1 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06Q 10/1093: Calendar-based scheduling for persons or groups - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Implementations set forth herein relate to incorporating automated assistant suggestions into an interface of a video application, when the video application is rendering video content. The video content—as well as any relevant content, can provide a basis for the automated assistant suggestions. The assistant suggestions can optionally link to one or more additional applications, which can be controlled in response to a user selecting one or more of the automated assistant suggestions. In response to a selection of an assistant suggestion, resulting data generated by another application can be rendered over an interface of the video application, while video content is being rendered and/or otherwise played. This can allow the user to control relevant actions of other applications without completely leaving an interface of the video application, thereby preserving memory and other computational resources that may be consumed when switching between application interfaces. ## Claims ### Claim 1 A method implemented by one or more processors, the method comprising: determining that video content, that is being rendered via an application at a display interface of a computing device, is relevant to assistant data that is stored in association with a user of the computing device; generating suggestion data based on processing the video content and the assistant data, wherein generating the suggestion data based on the video content is responsive to the video content being rendered, wherein generating the suggestion data based on the assistant data is responsive to determining that the video content is relevant to the assistant data, and wherein the suggestion data characterizes one or more actions capable of being performed using the assistant data; and causing rendering, at the display interface, of a selectable element that is based on the suggestion data, wherein a selection of the selectable element causes performance of at least an action of the one or more actions characterized by the suggestion data. ### Claim 2 (depends on 1) The method of claim 1, wherein the assistant data, determined to be relevant to the video content, includes multiple instances of assistant data. ### Claim 3 (depends on 1) The method of claim 1, wherein the assistant data, determined to be relevant to the video content, includes an instance of assistant data that is based on a prior interaction between the user and an automated assistant. ### Claim 4 (depends on 1) The method of claim 1, wherein determining that the video content being rendered via the application is relevant to the assistant data comprises: processing, using one or more machine learning models, one or more images that capture the video content being rendered via the application. ### Claim 5 (depends on 1) The method of claim 1, wherein the selection of the selectable element causes performance of the action via an additional application of the computing device. ### Claim 6 (depends on 5) The method of claim 5, wherein generating the suggestion data is further based on processing additional data provided by the additional application. ### Claim 7 (depends on 6) The method of claim 6, wherein the additional data is provided by the additional application responsive to a request that is provided to the additional application. ### Claim 8 (depends on 6) The method of claim 6, wherein the additional application is a messaging application and the at least one action includes the messaging application creating a draft message. ### Claim 9 (depends on 1) The method of claim 1, wherein the selectable element is rendered while an image frame of the video content is rendered at the display interface of the computing device. ### Claim 10 (depends on 9) The method of claim 9, wherein the selectable element is rendered via the application. ### Claim 11 A computing device, comprising: a display interface; memory storing instructions; one or more processors operable to execute the instructions to: determine that video content, that is being rendered via an application at the display interface, is relevant to assistant data that is stored in association with a user of the computing device; generate suggestion data based on processing the video content and the assistant data, wherein generating the suggestion data based on the video content is responsive to the video content being rendered, wherein generating the suggestion data based on the assistant data is responsive to determining that the video content is relevant to the assistant data, and wherein the suggestion data characterizes one or more actions capable of being performed using the assistant data; and cause rendering, at the display interface, of a selectable element that is based on the suggestion data, wherein a selection of the selectable element causes performance of at least an action of the one or more actions characterized by the suggestion data. ### Claim 12 (depends on 11) The computing device of claim 11, wherein the assistant data, determined to be relevant to the video content, includes multiple instances of assistant data. ### Claim 13 (depends on 11) The computing device of claim 11, wherein the assistant data, determined to be relevant to the video content, includes an instance of assistant data that is based on a prior interaction between the user and an automated assistant. ### Claim 14 (depends on 11) The computing device of claim 11, wherein in determining that the video content being rendered via the application is relevant to the assistant data one or more of the processors are to: process, using one or more machine learning models, one or more images that capture the video content being rendered via the application. ### Claim 15 (depends on 11) The computing device of claim 11, wherein the selection of the selectable element causes performance of the action via an additional application of the computing device. ### Claim 16 (depends on 15) The computing device of claim 15, wherein in generating the suggestion data one or more of the processors are to generate the suggestion data further based on processing additional data provided by the additional application. ### Claim 17 (depends on 16) The computing device of claim 16, wherein the additional data is provided by the additional application responsive to a request that is provided to the additional application. ### Claim 18 (depends on 16) The computing device of claim 16, wherein the additional application is a messaging application and the at least one action includes the messaging application creating a draft message. ### Claim 19 (depends on 11) The computing device of claim 11, wherein the selectable element is rendered while an image frame of the video content is rendered at the display interface of the computing device. ### Claim 20 (depends on 19) The computing device of claim 19, wherein the selectable element is rendered via the application.