# US 2021/0342168 A1 · Systems, methods, and apparatus for providing dynamic auto-responses at a mediating assistant application

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342168 A1
- Document ID: US20210342168A1
- Status: Published application
- Kind: A1
- Application number: 16/326,814
- Filed: 2019-01-23
- Published: 2021-11-04
- Earliest claimed: 2018-01-24
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Justin Lewis; Scott Davies
- Web page: https://patentgrep.com/patent/US20210342168A1

## CPC

- G06F 9/453: {Help systems}
- G06F 16/3329: Natural language query formulation
- G06F 16/3334: {Selection or weighting of terms from queries, including natural language queries}
- G06F 16/3344: {using natural language analysis}
- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G06F 40/30: Semantic analysis
- B62D 1/184: Mechanisms for locking columns at selected positions
- B62D 1/185: adjustable by axial displacement, e.g. telescopically (B62D1/183, B62D1/187, B62D1/19 take precedence)
- B62D 1/195: {Yieldable supports for the steering column}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/332: Query formulation
- G06F 16/3323: {using document space presentation or visualization, e.g. category, hierarchy or range presentation and selection}
- G06F 16/3326: {using relevance feedback from the user, e.g. relevance feedback on documents, documents sets, document terms or passages}
- G06F 16/3331: Query processing
- G06F 16/3343: {using phonetics}
- G06F 16/3346: {using probabilistic model}
- G06F 16/3347: {using vector based model}
- G06F 16/338: Presentation of query results
- G06F 16/353: into predefined classes
- G06F 16/383: using metadata automatically derived from the content
- G06F 16/387: using geographical or spatial information, e.g. location
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)

## Abstract

Methods, apparatus, systems, and computer-readable media are provided for providing context specific schema files that allow an automated assistant to broker human-to-computer dialogs between a user and an application that is separate from the automated assistant. The context specific schema file can provide the automated assistant with sufficient data to be responsive to user queries without necessarily communicating with a remote device, such as a server. Multiple different context specific schema files can be made available to the automated assistant according to a context in which a user is interacting with the automated assistant. In this way, latency otherwise exhibited by the automated assistant can be mitigated by providing the automated assistant with the information needed to respond to a user without continually retrieving the information over a network.

## Claims

### Claim 1

A method implemented by one or more processors, the method comprising:
determining that an application is available at a computing device, wherein the computing device includes an automated assistant that is configured to mediate performance of an action by the application;
providing, in response to determining that the application is available at the computing device, a first context specific schema file to the computing device, wherein the first context specific schema file includes responsive content provided in anticipation of the automated assistant receiving a request for the application to perform the action;
determining that the automated assistant has received the request for the application to perform the action; and
providing, in response to determining that the automated assistant has received the request, a second context specific schema file to the computing device, wherein the second context specific schema file includes other content provided in anticipation of the automated assistant receiving a separate request associated with the action being performed by the application.

### Claim 2 (depends on 1)

The method of claim 1, wherein the computing device includes an automated assistant interface and the responsive content includes natural language data adoptable by the automated assistant.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first context specific schema file identifies multiple different actions capable of being performed by the application and initialized via the automated assistant.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
modifying a status identifier to indicate that at least the first context specific schema file and the second context specific schema file are accessible to the automated assistant.

### Claim 5 (depends on 4)

The method of claim 4, wherein the status identifier further indicates that another context specific schema file associated with the application is inaccessible from the computing device.

### Claim 6 (depends on 1)

The method of claim 1, wherein the automated assistant is configured to bypass contacting a remote device associated with the application in response to receiving the separate request, and provide a response to the separate request in accordance with the second context specific schema file.

### Claim 7

A method implemented by one or more processors, the method comprising:
receiving, at an automated assistant interface, a first request for an automated assistant to mediate performance of an action by an application that is separate from the automated assistant;
determining, by the automated assistant, whether a context specific schema file is accessible to the automated assistant and includes content that corresponds to the action to be performed by the application, wherein the context specific schema file is configured to enable the automated assistant to provide responses on behalf of the application;
when the automated assistant determines that the context specific schema file is accessible and provides content that corresponds to the action to be performed by the application:
causing the application to initialize performance of the action;
receiving, at the automated assistant interface, a second request for the automated assistant to provide a response that is associated with the action being performed by the application;
determining, by the automated assistant, whether the content of the context specific schema file is capable of satisfying the second request; and
when the automated assistant determines that the content of the context specific schema file is capable of satisfying the second request:
generating the response according to the content of the context specific schema file.

### Claim 8 (depends on 7)

The method of claim 7, when the automated assistant determines that the content of the context specific schema file is incapable of satisfying the second request:
generating a schema file request, wherein the schema file request corresponds to a query for retrieving another context specific schema file for fulfilling the second request.

### Claim 9 (depends on 8)

The method of claim 8, when the automated assistant determines that the content of the context specific schema file is incapable of satisfying the second request:
receiving the other context specific schema file, and
generating a separate response according to other content that is provided in the other context specific schema file.

### Claim 10 (depends on 8)

The method of claim 8, wherein the schema file request includes contextual data that identifies a context in which the automated assistant received the first request.

### Claim 11 (depends on 7)

The method of claim 7, when the automated assistant determines that the content of the context specific schema file is void of content that corresponds to the action to be performed by the application:
generating a schema file request, wherein the schema file request corresponds to a query for retrieving another context specific schema file that includes content corresponding to the action to be performed by the application.

### Claim 12 (depends on 11)

The method of claim 11, when the automated assistant determines that the content of the context specific schema file is void of content that corresponds to the action to be performed by the application:
receiving the other context specific schema file, and
causing the application to initialize performance of the action at least based on other content provided in the other context specific schema file.

### Claim 13 (depends on 7)

The method of claim 7, wherein determining whether the context specific schema file is accessible to the automated assistant includes:
accessing a file storage that includes one or more context specific schema files, and
comparing request content from the first request to schema file content from the one or more context specific schema files.

### Claim 14

A method implemented by one or more processors, the method comprising:
receiving a first request for an automated assistant to initialize performance of an action by an application that is accessible to a client device, wherein the client device includes a schema file configured to provide responsive content that allows the automated assistant to respond to requests on behalf of the application;
determining whether a correspondence exists between the action associated with the first request and the schema file;
causing, based on determining that the correspondence between the action and the schema file exists, the application to initialize performance of the action;
receiving a second request for the automated assistant to provide a response associated with the action on behalf of the application; and
determining whether the schema file includes responsive content that is correlated with the second request; and
providing, based on determining that the schema file includes responsive content that is correlated with the second request, the response associated with the action via an automated assistant interface of the client device.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
causing, based on determining that the schema file is void of a correspondence to the first request, the automated assistant or the application to request a different schema file that provides the correspondence to the first request.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
causing, based on determining that the schema file is void of responsive content that is correlated with the second request, the automated assistant or the application to request a different schema file that provides other responsive content that is correlated to the second request.

### Claim 17 (depends on 14)

The method of claim 14, wherein providing the response associated with the action includes:
generating a natural language response that is based on the responsive content provided in the schema file.

### Claim 18 (depends on 14)

The method of claim 14, wherein determining whether the correspondence exists between the action associated with the first request and the schema file includes:
identifying, from multiple schema files available at the computing device, the schema file that includes intent data that identifies the action.

### Claim 19 (depends on 14)

The method of claim 14, further comprising:
causing, in response to receiving the first request, contextual data to be provided to a remote device that is associated with the application, wherein the contextual data identifies the action.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
receiving, from the remote device, a separate schema file that includes supplemental content that allows the automated assistant to be responsive to a user on behalf of the application when the application is performing the action.
