# US 2019/0171414 A1 · Systems and methods for enabling user voice interaction with a host computing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171414 A1
- Document ID: US20190171414A1
- Status: Published application
- Kind: A1
- Application number: 16/271,562
- Filed: 2019-02-08
- Published: 2019-06-06
- Earliest claimed: 2015-03-20
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Asaf Zomet; Michael Shynar
- Web page: https://patentgrep.com/patent/US20190171414A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/957: Browsing optimisation, e.g. caching or content distillation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A content management computing device for managing voice-interactive online content includes a memory for storing data and a processor in communication with the memory. The processor is programmed to retrieve an online content item including content metadata, identify at least one voice interaction associated with the content metadata, serve the online content item to a user computing device, wherein serving the online content item further comprises instructing the user computing device to collect voice response data that is responsive to at least one voice interaction, receive the voice response data from the user computing device, identify a user request based on the voice response data, and transmit a response, based on the user request, to a user account.

## Claims

### Claim 1

(canceled)

### Claim 2

A system, comprising:
a memory device storing data, including machine executable instructions; and
one or more processors in communication with the memory device, wherein the processor is configured to execute the executable instructions, which cause the one or more processors to perform operations, including:
retrieving an online content item including content metadata that designates one or more interaction labels of one or more voice interactions that are enabled for the online content item;
causing a client device to present the online content item at a client device and listen for an audio response from a user for a specified amount of time following presentation of the online content item;
detecting a particular audio response submitted through the client device;
determining that the audio response matches a particular voice interaction label, among the one or more interaction labels;
deferring, in response to determining that the audio response matches the particular voice interaction label, interaction with the user to a later time, including transmitting additional information to an account of the user rather than responding to the audio response with the additional information.

### Claim 3 (depends on 2)

The system of claim 2, wherein the instructions cause the one or more processors to request an additional audio response form the user prior to deferring the interaction, wherein deferring the interaction is performed in response to determining that the audio response matches the particular voice interaction label and the additional audio response received from the user provides information required to transmit the additional information to the account of the user.

### Claim 4 (depends on 2)

The system of claim 2, wherein the instructions cause the one or more processors to perform operations comprising:
processing the particular audio response into a set of text data using a speech processing algorithm; and
identifying the particular voice interaction label from the set of text data by applying at least one of a regular expression algorithm and a context-free grammar algorithm.

### Claim 5 (depends on 2)

The system of claim 2, wherein the instructions cause the one or more processors to perform operations comprising:
determining that the audio response represents a request for an offer; and
retrieving at least a set of contact data for the user from a profile of the user, wherein:
transmitting the response comprises transmitting the response using the contact data for the user.

### Claim 6 (depends on 2)

The system of claim 2, wherein the instructions cause the one or more processors to perform operations comprising:
determining that the audible response represents a request for a purchase;
retrieving a set of payment information for the user; and
initiating an order based on the set of payment information and the request for purchase.

### Claim 7 (depends on 6)

The system of claim 6, wherein transmitting additional information to an account of the user comprises transmitting order details to the account of the user, wherein the order details enable the user to review, approve, cancel, or modify the order.

### Claim 8 (depends on 2)

The system of claim 2, wherein the instructions cause the one or more processors to perform operations comprising:
determining that the audio response represents a request to a scheduled event; and
identifying a set of calendar options for the user, wherein:
transmitting the additional information comprises transmitting information about the scheduled event based on the set of calendar options.

### Claim 9

A method, comprising:
retrieving, by one or more processors, an online content item including content metadata that designates one or more interaction labels of one or more voice interactions that are enabled for the online content item;
causing, by the one or more processors, a client device to present the online content item at a client device and listen for an audio response from a user for a specified amount of time following presentation of the online content item;
detecting, by the one or more processors, a particular audio response submitted through the client device;
determining, by the one or more processors, that the audio response matches a particular voice interaction label, among the one or more interaction labels;
deferring, by the one or more processors and in response to determining that the audio response matches the particular voice interaction label, interaction with the user to a later time, including transmitting additional information to an account of the user rather than responding to the audio response with the additional information.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
requesting an additional audio response form the user prior to deferring the interaction, wherein deferring the interaction is performed in response to determining that the audio response matches the particular voice interaction label and the additional audio response received from the user provides information required to transmit the additional information to the account of the user.

### Claim 11 (depends on 9)

The method of claim 9, further comprising:
processing the particular audio response into a set of text data using a speech processing algorithm; and
identifying the particular voice interaction label from the set of text data by applying at least one of a regular expression algorithm and a context-free grammar algorithm.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
determining that the audio response represents a request for an offer; and
retrieving at least a set of contact data for the user from a profile of the user, wherein:
transmitting the response comprises transmitting the response using the contact data for the user.

### Claim 13 (depends on 9)

The method of claim 9, further comprising:
determining that the audible response represents a request for a purchase;
retrieving a set of payment information for the user; and
initiating an order based on the set of payment information and the request for purchase.

### Claim 14 (depends on 13)

The method of claim 13, wherein transmitting additional information to an account of the user comprises transmitting order details to the account of the user, and wherein the order details enable the user to review, approve, cancel, or modify the order.

### Claim 15 (depends on 9)

The method of claim 9, further comprising:
determining that the audio response represents a request to a scheduled event; and
identifying a set of calendar options for the user, wherein:
transmitting the additional information comprises transmitting information about the scheduled event based on the set of calendar options.

### Claim 16

A non-transitory computer-readable storage device, storing processor-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:
retrieving an online content item including content metadata that designates one or more interaction labels of one or more voice interactions that are enabled for the online content item;
causing a client device to present the online content item at a client device and listen for an audio response from a user for a specified amount of time following presentation of the online content item;
detecting a particular audio response submitted through the client device;
determining that the audio response matches a particular voice interaction label, among the one or more interaction labels;
deferring, in response to determining that the audio response matches the particular voice interaction label, interaction with the user to a later time, including transmitting additional information to an account of the user rather than responding to the audio response with the additional information.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage device of claim 16, wherein the instructions cause the one or more processors to request an additional audio response form the user prior to deferring the interaction, wherein deferring the interaction is performed in response to determining that the audio response matches the particular voice interaction label and the additional audio response received from the user provides information required to transmit the additional information to the account of the user.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage device of claim 16, wherein the instructions cause the one or more processors to perform operations comprising:
processing the particular audio response into a set of text data using a speech processing algorithm; and
identifying the particular voice interaction label from the set of text data by applying at least one of a regular expression algorithm and a context-free grammar algorithm.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage device of claim 16, wherein the instructions cause the one or more processors to perform operations comprising:
determining that the audio response represents a request for an offer; and
retrieving at least a set of contact data for the user from a profile of the user, wherein:
transmitting the response comprises transmitting the response using the contact data for the user.

### Claim 20 (depends on 16)

The non-transitory computer-readable storage device of claim 16, wherein the instructions cause the one or more processors to perform operations comprising:
determining that the audible response represents a request for a purchase;
retrieving a set of payment information for the user; and
initiating an order based on the set of payment information and the request for purchase.

### Claim 21 (depends on 20)

The non-transitory computer-readable storage device of claim 20, wherein transmitting additional information to an account of the user comprises transmitting order details to the account of the user, wherein the order details enable the user to review, approve, cancel, or modify the order.
